-- Logs begin at Mon 2022-09-19 09:44:55 UTC, end at Mon 2022-09-19 10:46:18 UTC. -- Sep 19 10:12:04.997514 dv-cinder-858275-1-smb systemd[1]: Starting Devstack devstack@keystone.service... Sep 19 10:12:05.004812 dv-cinder-858275-1-smb devstack@keystone.service[81339]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Sep 19 10:12:05.006858 dv-cinder-858275-1-smb devstack@keystone.service[81339]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Sep 19 10:12:05 2022] *** Sep 19 10:12:05.006858 dv-cinder-858275-1-smb devstack@keystone.service[81339]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 19 10:12:05.006858 dv-cinder-858275-1-smb devstack@keystone.service[81339]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 19 10:12:05.006858 dv-cinder-858275-1-smb devstack@keystone.service[81339]: nodename: dv-cinder-858275-1-smb Sep 19 10:12:05.006858 dv-cinder-858275-1-smb devstack@keystone.service[81339]: machine: x86_64 Sep 19 10:12:05.006858 dv-cinder-858275-1-smb devstack@keystone.service[81339]: clock source: unix Sep 19 10:12:05.006858 dv-cinder-858275-1-smb devstack@keystone.service[81339]: pcre jit disabled Sep 19 10:12:05.006858 dv-cinder-858275-1-smb devstack@keystone.service[81339]: detected number of CPU cores: 4 Sep 19 10:12:05.007987 dv-cinder-858275-1-smb devstack@keystone.service[81339]: current working directory: / Sep 19 10:12:05.007987 dv-cinder-858275-1-smb devstack@keystone.service[81339]: detected binary path: /usr/bin/uwsgi-core Sep 19 10:12:05.007987 dv-cinder-858275-1-smb devstack@keystone.service[81339]: your processes number limit is 47680 Sep 19 10:12:05.007987 dv-cinder-858275-1-smb devstack@keystone.service[81339]: your memory page size is 4096 bytes Sep 19 10:12:05.007987 dv-cinder-858275-1-smb devstack@keystone.service[81339]: detected max file descriptor number: 2048 Sep 19 10:12:05.007987 dv-cinder-858275-1-smb devstack@keystone.service[81339]: lock engine: pthread robust mutexes Sep 19 10:12:05.007987 dv-cinder-858275-1-smb devstack@keystone.service[81339]: thunder lock: enabled Sep 19 10:12:05.007987 dv-cinder-858275-1-smb devstack@keystone.service[81339]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Sep 19 10:12:05.007987 dv-cinder-858275-1-smb devstack@keystone.service[81339]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 19 10:12:05.047434 dv-cinder-858275-1-smb devstack@keystone.service[81339]: Python main interpreter initialized at 0x55f8e4eb69c0 Sep 19 10:12:05.047434 dv-cinder-858275-1-smb devstack@keystone.service[81339]: python threads support enabled Sep 19 10:12:05.047434 dv-cinder-858275-1-smb devstack@keystone.service[81339]: your server socket listen backlog is limited to 100 connections Sep 19 10:12:05.047434 dv-cinder-858275-1-smb devstack@keystone.service[81339]: your mercy for graceful operations on workers is 90 seconds Sep 19 10:12:05.047821 dv-cinder-858275-1-smb devstack@keystone.service[81339]: mapped 403077 bytes (393 KB) for 2 cores Sep 19 10:12:05.047902 dv-cinder-858275-1-smb devstack@keystone.service[81339]: *** Operational MODE: preforking *** Sep 19 10:12:05.048158 dv-cinder-858275-1-smb devstack@keystone.service[81339]: *** uWSGI is running in multiple interpreter mode *** Sep 19 10:12:05.048158 dv-cinder-858275-1-smb devstack@keystone.service[81339]: spawned uWSGI master process (pid: 81339) Sep 19 10:12:05.048384 dv-cinder-858275-1-smb systemd[1]: Started Devstack devstack@keystone.service. Sep 19 10:12:05.049199 dv-cinder-858275-1-smb devstack@keystone.service[81339]: spawned uWSGI worker 1 (pid: 81351, cores: 1) Sep 19 10:12:05.049301 dv-cinder-858275-1-smb devstack@keystone.service[81339]: spawned uWSGI worker 2 (pid: 81352, cores: 1) Sep 19 10:12:05.052294 dv-cinder-858275-1-smb devstack@keystone.service[81339]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 19 10:12:09.385371 dv-cinder-858275-1-smb devstack@keystone.service[81352]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 19 10:12:09.385371 dv-cinder-858275-1-smb devstack@keystone.service[81352]: from cryptography.utils import int_from_bytes Sep 19 10:12:09.386184 dv-cinder-858275-1-smb devstack@keystone.service[81352]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 19 10:12:09.386184 dv-cinder-858275-1-smb devstack@keystone.service[81352]: from cryptography.utils import int_from_bytes Sep 19 10:12:09.386306 dv-cinder-858275-1-smb devstack@keystone.service[81351]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 19 10:12:09.386306 dv-cinder-858275-1-smb devstack@keystone.service[81351]: from cryptography.utils import int_from_bytes Sep 19 10:12:09.386715 dv-cinder-858275-1-smb devstack@keystone.service[81351]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 19 10:12:09.386715 dv-cinder-858275-1-smb devstack@keystone.service[81351]: from cryptography.utils import int_from_bytes Sep 19 10:12:09.435994 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 19 10:12:09.436195 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 19 10:12:09.436380 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] command line args: [] {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 19 10:12:09.436651 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 19 10:12:09.436827 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] ================================================================================ {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 19 10:12:09.436911 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 19 10:12:09.437033 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 19 10:12:09.437123 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] admin_token = **** {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:12:09.437229 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] command line args: [] {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 19 10:12:09.437314 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] config_dir = [] {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:12:09.437496 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:12:09.437613 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 19 10:12:09.437699 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] ================================================================================ {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 19 10:12:09.437770 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] config_source = [] {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:12:09.437835 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] debug = True {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:12:09.437924 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] admin_token = **** {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:12:09.438033 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:12:09.438296 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] config_dir = [] {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:12:09.438367 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:12:09.438430 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:12:09.438558 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] config_source = [] {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:12:09.438644 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:12:09.438704 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] debug = True {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:12:09.438823 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:12:09.438897 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:12:09.439060 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:12:09.439149 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:12:09.439287 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:12:09.439372 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] list_limit = None {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:12:09.439476 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] log_config_append = None {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:12:09.439548 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:12:09.439646 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:12:09.439780 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:12:09.439886 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] log_dir = None {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:12:09.440040 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] log_file = None {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:12:09.440143 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] list_limit = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:12:09.440274 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] log_config_append = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:12:09.440402 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:12:09.440485 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:12:09.440608 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:12:09.440691 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] log_dir = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:12:09.440761 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:12:09.440829 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] log_file = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:12:09.440949 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:12:09.441032 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:12:09.441113 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:12:09.441185 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:12:09.441299 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:12:09.441404 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:12:09.441481 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:12:09.441655 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:12:09.441745 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:12:09.441824 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:12:09.441942 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:12:09.442015 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:12:09.442129 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:12:09.442236 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:12:09.442358 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:12:09.442485 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:12:09.442590 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:12:09.442720 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:12:09.442834 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:12:09.442959 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:12:09.443080 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:12:09.443196 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:12:09.443351 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:12:09.443424 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:12:09.443667 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:12:09.443840 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.66/identity {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:12:09.443926 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:12:09.444023 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] publish_errors = False {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:12:09.444200 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:12:09.444321 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:12:09.444529 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:12:09.444708 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:12:09.444884 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.66/identity {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:12:09.444976 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:12:09.445101 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] publish_errors = False {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:12:09.445224 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:12:09.445345 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:12:09.445430 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] standard_threads = False {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:12:09.445569 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:12:09.445656 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:12:09.445755 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:12:09.445833 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:12:09.446005 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:12:09.446126 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:12:09.446217 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] use_journal = False {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:12:09.446289 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:12:09.446358 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] use_json = False {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:12:09.446484 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] standard_threads = False {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:12:09.446563 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] use_stderr = False {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:12:09.446660 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] use_syslog = False {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:12:09.446804 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:12:09.446880 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:12:09.446950 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:12:09.447119 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:12:09.447203 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.447274 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] use_journal = False {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:12:09.447355 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.447433 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] use_json = False {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:12:09.447603 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] use_stderr = False {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:12:09.447684 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.447782 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] use_syslog = False {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:12:09.447860 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.448017 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:12:09.448102 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.448299 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.448379 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.448626 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.448729 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.448812 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.448883 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.449026 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.449108 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.449276 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.449357 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.449515 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.449595 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.449748 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.449824 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.450011 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.450090 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.450228 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.450311 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.450477 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.450554 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.450724 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.450808 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.450960 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.451043 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.451211 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.451294 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.451448 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.451531 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.451696 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.451779 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.451932 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.452019 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.452187 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.452354 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.452437 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.452509 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.452696 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.452774 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.452942 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.453030 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.453172 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.453249 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.453404 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.453483 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.453634 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.453724 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.453869 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.453955 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.454117 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.454195 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.454365 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.454450 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.454595 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.454672 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.454825 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.454908 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.455064 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.455149 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.455309 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.455386 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.455547 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.455624 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.455784 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.455868 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.456014 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.456091 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.456282 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.456374 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.456519 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.456608 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.456749 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.456835 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.456980 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.457059 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.457209 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.457295 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.457438 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.457518 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.457676 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.457761 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.457911 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.458068 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.458149 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.458220 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.458366 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.458444 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.458600 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.458689 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.458834 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.458911 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.459067 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.459151 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.459306 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.459391 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.459533 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.459619 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.459766 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.459847 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.460000 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.460085 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.460282 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.460374 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.460532 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.460609 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.460764 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.460842 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.460992 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.461071 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.461232 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.461346 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.461452 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.461550 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.461692 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.461797 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.462033 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.462126 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.462247 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.462370 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.462447 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.462563 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.462644 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.462721 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.462846 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.462924 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.463068 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.463148 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.463330 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.463420 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.463565 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.463642 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.463798 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.463880 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.464038 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.464116 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.464296 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.464389 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.464532 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.464619 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.464768 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.464890 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.465013 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.465093 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.465250 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.465330 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.465486 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.465567 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.465724 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.465843 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.465958 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.466043 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.466205 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.466282 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.466720 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.466811 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.466939 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.467016 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.467093 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.467203 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.467343 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.467428 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.467508 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.467585 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.467660 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.467730 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.467846 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.467921 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.468043 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.468120 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.468282 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.468362 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.468520 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.468598 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.468762 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.468849 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.468996 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.469074 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.469232 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.469311 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.469505 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.469585 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.469687 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.469765 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.469916 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.470004 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.470146 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.470279 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.470362 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.470434 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.470596 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.470674 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.470833 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.470919 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.471066 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.471143 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.471304 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.471382 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.471535 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.471627 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.471767 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.471844 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.472011 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.472089 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.472275 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.472369 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.472506 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] auth.external = None {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.472584 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.472740 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.472820 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.473003 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.473094 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.473251 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.473336 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.473482 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] auth.password = None {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.473561 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.473713 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] auth.token = None {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.473799 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] auth.external = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.473947 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.474033 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.474178 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.474256 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.474422 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.474502 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.474654 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.474748 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] auth.password = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.474900 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.474984 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] auth.token = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.475145 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.475224 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.475375 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.475463 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.475610 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] credential.caching = True {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.476220 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.476401 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.476484 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.476649 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.476742 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.476897 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.476977 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.477139 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.477219 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.477377 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] credential.caching = True {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.477463 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.477608 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.477686 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.477854 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.477933 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.478106 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.478198 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.478346 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.478424 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.478591 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.478670 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.478830 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.478921 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.479082 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.479162 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.479341 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.479431 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.479581 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.479667 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.479835 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.479914 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.480066 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] federation.caching = True {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.480145 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.480325 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.480418 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.480571 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.480657 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.480817 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.480896 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.481048 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.481128 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.481293 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.481373 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] federation.caching = True {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.481528 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.481607 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.481781 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.481863 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.482017 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.482095 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.482264 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.482342 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.482498 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.482578 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.482744 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.482822 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.482977 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] identity.caching = True {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.483055 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.483226 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.483312 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.483473 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.483558 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.483712 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.483792 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.483942 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.484017 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.484262 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.484359 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] identity.caching = True {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.484433 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.484504 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.484658 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.484739 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.484908 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.484988 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.485157 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.485235 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.485385 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.485465 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.485617 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.485696 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.485846 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.485932 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.486089 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.486169 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.486334 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.486413 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.486573 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.486658 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.486812 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.486892 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.487050 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.487129 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.487294 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.487381 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.487543 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.487628 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.487777 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.487856 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.488008 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.488087 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.488271 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.488364 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.488504 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.488584 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.488739 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.488818 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.488978 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.489058 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.489216 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.489295 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.489462 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.489549 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.489696 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.489774 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.489937 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.490016 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.490183 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.490270 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.490421 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.490556 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.490681 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.490819 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.490946 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.491077 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.491204 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.491286 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.491986 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.492116 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.492310 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.492445 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.492575 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.492703 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.492831 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.492958 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.493087 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.493233 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.493364 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.493492 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.493619 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.493746 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.493892 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.494035 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.494035 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.494235 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.494310 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.494381 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.494450 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.494529 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.494601 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.494672 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.494742 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.494812 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.494964 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.495055 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.495202 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.495281 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.495439 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.495518 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.495674 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] ldap.user = None {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.495808 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.495916 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.496066 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.496188 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.496333 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.496412 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.496577 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.496658 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.496821 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.496900 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.497059 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] ldap.user = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.497138 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.497305 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.497387 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.497570 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.497649 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.497805 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.497885 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.498041 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.498122 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.498281 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.498361 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.498511 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.498590 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.498758 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.498839 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.498993 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.499071 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.499234 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.499314 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.499473 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.499554 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.499713 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.499792 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.499942 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.500019 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.500211 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.500325 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.500451 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.500546 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.500686 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.500766 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.500921 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.501003 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.501154 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.501241 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.501394 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.501472 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.501638 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.501718 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.501875 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.501954 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.502113 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.502190 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.502344 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.502423 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.502580 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.502658 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.502811 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.502889 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.503045 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.503125 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.503280 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.503359 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.503525 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.503604 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.503765 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.503844 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.503994 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.504072 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.504252 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.504335 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.504493 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.504573 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] resource.caching = True {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.504736 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.504815 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.504980 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.505058 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.505216 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.505296 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.505450 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.505528 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.505692 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.505783 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.505925 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.506003 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] resource.caching = True {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.506171 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.506250 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.506407 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.506494 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.506643 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.506723 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.506878 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] role.caching = True {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.506980 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.507161 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.507317 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] role.driver = sql {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.507394 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.507464 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.507624 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.507704 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.507867 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.507954 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.508111 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.508210 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.508384 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] role.caching = True {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.508463 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.508629 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.508719 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] role.driver = sql {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.508863 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.508941 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.509110 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.509189 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.509358 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.509445 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.509590 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.509676 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.509836 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.509916 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.510082 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.510170 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.510330 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.510409 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.510574 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.510658 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.510825 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.510975 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.511056 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.511208 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.511288 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.511457 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.511536 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.511704 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.511785 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.511950 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.512030 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.512215 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.512440 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.512533 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.512689 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.512769 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.512935 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.513014 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.513172 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.513254 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.513402 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.513481 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.513632 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.513712 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.513862 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.513943 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.514109 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.514188 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.514360 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.514440 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.514606 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.514687 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.514841 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.514920 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.515073 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.515152 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.515302 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.515390 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.515535 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] token.caching = True {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.515615 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.515770 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.515849 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.516015 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.516095 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.516271 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.516352 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.516513 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.516591 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.516749 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.516831 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.516982 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.517062 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] token.caching = True {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.517220 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.517299 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.517460 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.517540 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.517697 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.517775 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.517929 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.518007 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.518169 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.518249 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.518402 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.518482 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.518646 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.518726 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.518892 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.518971 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.519139 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.519229 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.519377 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.519495 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.519613 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.519698 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.519847 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.519926 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] database.connection = **** {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.520096 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.520194 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.520373 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.520466 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.520608 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.520693 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.520847 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.520936 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.521079 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.521158 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.521312 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.521401 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] database.connection = **** {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.521545 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.521625 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.521779 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.521858 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.522021 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.522113 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.522255 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.522335 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.522494 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.522633 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.522750 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.522840 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.522996 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.523075 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.523228 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.523308 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.523469 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.523556 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.523697 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.523778 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.523935 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.524014 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.524225 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.524324 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.524400 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 19 10:12:09.524471 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.524681 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.524931 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.525167 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.525411 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.525650 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:12:09.525823 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 19 10:12:09.555128 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81352) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 10:12:09.555352 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81352) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 10:12:09.555463 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 10:12:09.555577 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81352) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 10:12:09.555665 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 10:12:09.555857 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 10:12:09.564080 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81352) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 10:12:09.564321 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 10:12:09.592295 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81352) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 10:12:09.592526 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81352) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 10:12:09.592667 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 10:12:09.592903 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 10:12:09.648260 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 10:12:09.649684 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81352) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 10:12:09.698406 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 10:12:09.698523 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81352) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 10:12:09.698638 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81352) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 10:12:09.698746 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 10:12:09.856566 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 10:12:09.856804 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 10:12:09.857005 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81352) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 10:12:09.857095 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 10:12:09.857234 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 10:12:09.857317 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81352) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 10:12:09.857459 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81352) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 10:12:09.857584 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 10:12:09.857669 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 10:12:09.857761 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81352) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 10:12:09.857860 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81352) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 10:12:09.858076 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81352) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 10:12:09.880761 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 10:12:09.880970 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81352) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 10:12:09.881060 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 10:12:09.881204 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81352) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 10:12:09.881292 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 10:12:09.881426 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 10:12:09.881510 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81352) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 10:12:09.881645 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 10:12:09.881739 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81352) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 10:12:09.881860 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 10:12:09.881997 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81352) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 10:12:09.882113 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 10:12:09.882186 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81352) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 10:12:09.882331 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81352) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 10:12:09.893473 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 10:12:09.893637 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81352) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 10:12:09.907012 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 10:12:09.907153 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81352) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 10:12:09.907233 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 10:12:09.907322 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81352) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 10:12:09.907398 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 10:12:09.907471 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81352) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 10:12:09.907614 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 10:12:09.907699 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81352) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 10:12:09.907835 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 10:12:09.907919 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81352) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 10:12:09.908047 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81352) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 10:12:09.908129 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 10:12:09.908286 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 10:12:09.908382 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81352) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 10:12:09.925724 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:12:09.925930 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 19 10:12:09.926154 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:12:09.926277 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:12:09.926360 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 19 10:12:09.926479 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 19 10:12:09.926701 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:12:09.926784 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:12:09.926904 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 19 10:12:09.926986 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:12:09.927183 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:12:09.927265 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:12:09.927457 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:12:09.927539 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:12:09.927721 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:12:09.927982 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:12:09.937102 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:12:09.937385 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:12:09.937661 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:12:09.937744 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:12:09.937946 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:12:09.938047 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:12:09.938234 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:12:09.938521 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:12:09.945472 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81352) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 10:12:09.947727 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81351) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 10:12:09.948405 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81352) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 10:12:09.948692 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:12:09.948982 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:12:09.949268 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:12:09.949557 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:12:09.949823 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:12:09.950101 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:12:09.950376 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:12:09.950651 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:12:09.950731 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81351) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 10:12:09.950929 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:12:09.951021 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:12:09.951207 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:12:09.951289 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:12:09.951527 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:12:09.951819 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:12:09.952089 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:12:09.952389 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:12:09.952673 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:12:09.952952 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:12:09.953233 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:12:09.953507 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:12:09.974426 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:12:09.976517 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81352) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 10:12:09.976807 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:12:09.977423 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:12:09.978916 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81351) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 10:12:09.979198 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:12:09.981484 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81352) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 10:12:09.981798 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:12:09.982060 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:12:09.983919 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81351) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 10:12:09.984231 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:12:09.984522 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:12:09.988462 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81352) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 10:12:09.988750 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:12:09.990923 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81351) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 10:12:09.991215 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:12:09.994978 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81352) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 10:12:09.995272 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:12:09.995562 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:12:09.995854 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:12:09.996134 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:12:09.996438 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:12:09.996715 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:12:09.996988 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:12:09.997530 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81351) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 10:12:09.997832 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:12:09.998135 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:12:09.998432 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:12:09.998720 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:12:09.999008 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:12:09.999291 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:12:09.999571 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:12:10.013171 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:12:10.013451 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:12:10.015745 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:12:10.016030 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:12:10.017334 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81352) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 10:12:10.019972 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81351) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 10:12:10.020759 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:12:10.020892 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:12:10.023288 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:12:10.023587 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:12:10.025243 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81352) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 10:12:10.027856 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81351) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 10:12:10.028413 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81352) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 10:12:10.031096 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81351) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 10:12:10.031640 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:12:10.031947 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:12:10.032261 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:12:10.032610 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:12:10.032844 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:12:10.033131 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:12:10.034376 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:12:10.034680 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:12:10.034973 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:12:10.035261 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:12:10.035543 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:12:10.035840 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:12:10.049746 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81352) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 10:12:10.050036 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:12:10.050306 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:12:10.050572 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:12:10.052594 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81351) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 10:12:10.052884 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:12:10.053158 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:12:10.053424 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:12:10.057522 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:12:10.059067 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:12:10.060382 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:12:10.060631 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:12:10.060917 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:12:10.061938 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:12:10.063485 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:12:10.063618 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81352) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 10:12:10.063774 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:12:10.063905 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:12:10.064210 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:12:10.064500 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:12:10.064934 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:12:10.066471 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81351) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 10:12:10.066767 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:12:10.067056 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:12:10.067345 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:12:10.067738 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:12:10.076642 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81352) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 10:12:10.076927 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:12:10.077207 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:12:10.077489 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:12:10.077868 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:12:10.078161 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:12:10.078446 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:12:10.079554 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81351) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 10:12:10.079842 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:12:10.080128 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:12:10.080439 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:12:10.080826 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:12:10.081125 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:12:10.081420 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:12:10.094566 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81352) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 10:12:10.097500 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81351) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 10:12:10.097597 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81352) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 10:12:10.100414 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:12:10.100503 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81351) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 10:12:10.101896 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:12:10.103366 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81352) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 10:12:10.103449 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:12:10.103650 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:12:10.104045 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:12:10.104939 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:12:10.106420 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81351) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 10:12:10.106708 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:12:10.107108 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:12:10.110447 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:12:10.111908 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81352) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 10:12:10.113570 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:12:10.114826 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:12:10.115035 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81351) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 10:12:10.115223 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:12:10.115513 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:12:10.115797 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:12:10.118053 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:12:10.118455 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:12:10.118750 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:12:10.119043 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:12:10.127225 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81352) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 10:12:10.127520 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:12:10.127803 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:12:10.128350 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81351) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 10:12:10.128655 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:12:10.128950 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:12:10.136380 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81352) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 10:12:10.136876 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:12:10.137340 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:12:10.137657 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:12:10.137896 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:12:10.138177 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:12:10.138305 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81351) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 10:12:10.138440 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:12:10.138739 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:12:10.138865 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:12:10.139002 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:12:10.139263 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:12:10.139399 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:12:10.139534 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:12:10.139750 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:12:10.139880 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:12:10.140036 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:12:10.140379 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:12:10.140508 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:12:10.140634 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:12:10.140759 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:12:10.140943 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:12:10.141157 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:12:10.141447 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:12:10.141723 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:12:10.141991 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:12:10.142262 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:12:10.142591 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:12:10.175635 dv-cinder-858275-1-smb devstack@keystone.service[81352]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55f8e4eb69c0 pid: 81352 (default app) Sep 19 10:12:10.178971 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5be780a-c73e-4ff5-84fc-02aec87b247a None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:10.179259 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5be780a-c73e-4ff5-84fc-02aec87b247a None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:10.179534 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5be780a-c73e-4ff5-84fc-02aec87b247a None None] PATH_INFO: `/v3` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:10.180117 dv-cinder-858275-1-smb devstack@keystone.service[81351]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55f8e4eb69c0 pid: 81351 (default app) Sep 19 10:12:10.183725 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1/1] 10.222.0.66 () {50 vars in 791 bytes} [Mon Sep 19 10:12:10 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:12:17.044772 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8928736-17f2-4efa-9eda-936439ee8027 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:17.045304 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8928736-17f2-4efa-9eda-936439ee8027 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:17.045304 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8928736-17f2-4efa-9eda-936439ee8027 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:17.049613 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1/2] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:12:17 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 10:12:17.055539 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9911886-a7d4-410f-95b6-f74d6d309f5f None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:17.056058 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9911886-a7d4-410f-95b6-f74d6d309f5f None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:17.056150 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9911886-a7d4-410f-95b6-f74d6d309f5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:17.126558 dv-cinder-858275-1-smb devstack@keystone.service[81352]: INFO dbcounter [None req-a9911886-a7d4-410f-95b6-f74d6d309f5f None None] Registered counter for database keystone Sep 19 10:12:17.145419 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG oslo_db.sqlalchemy.engines [None req-a9911886-a7d4-410f-95b6-f74d6d309f5f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81352) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 19 10:12:17.152179 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writer thread running {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 19 10:12:17.333917 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG passlib.handlers.bcrypt [None req-a9911886-a7d4-410f-95b6-f74d6d309f5f None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81352) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 19 10:12:17.334228 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG passlib.handlers.bcrypt [None req-a9911886-a7d4-410f-95b6-f74d6d309f5f None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81352) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 19 10:12:17.392676 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-a9911886-a7d4-410f-95b6-f74d6d309f5f None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:12:17.394306 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-a9911886-a7d4-410f-95b6-f74d6d309f5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:12:17.524539 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 2/3] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:12:17 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 471 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 19 10:12:17.985237 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8928736-17f2-4efa-9eda-936439ee8027 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:12:18.054800 dv-cinder-858275-1-smb devstack@keystone.service[81351]: INFO dbcounter [None req-b8928736-17f2-4efa-9eda-936439ee8027 None None] Registered counter for database keystone Sep 19 10:12:18.076501 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG oslo_db.sqlalchemy.engines [None req-b8928736-17f2-4efa-9eda-936439ee8027 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81351) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 19 10:12:18.083316 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writer thread running {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 19 10:12:18.204242 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8928736-17f2-4efa-9eda-936439ee8027 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:12:18.208501 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d2e17a-f128-4327-99d7-4ded66273953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:12:18.209120 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d2e17a-f128-4327-99d7-4ded66273953 admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:18.209399 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d2e17a-f128-4327-99d7-4ded66273953 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:18.209677 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d2e17a-f128-4327-99d7-4ded66273953 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:18.217802 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d2e17a-f128-4327-99d7-4ded66273953 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:12:18.269071 dv-cinder-858275-1-smb devstack@keystone.service[81351]: WARNING keystone.common.rbac_enforcer.enforcer [None req-d9d2e17a-f128-4327-99d7-4ded66273953 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 19 10:12:18.269344 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d2e17a-f128-4327-99d7-4ded66273953 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:12:18.279109 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 2/4] 10.222.0.66 () {58 vars in 1324 bytes} [Mon Sep 19 10:12:17 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 19 10:12:18.285120 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9911886-a7d4-410f-95b6-f74d6d309f5f None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:12:18.305950 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9911886-a7d4-410f-95b6-f74d6d309f5f None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:12:18.310308 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d0e648-f151-457e-9811-d64a9438d854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:12:18.311434 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d0e648-f151-457e-9811-d64a9438d854 admin admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:18.311712 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d0e648-f151-457e-9811-d64a9438d854 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:18.311988 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d0e648-f151-457e-9811-d64a9438d854 admin admin] PATH_INFO: `/v3/projects/3c18c45cef234ea9b13f7b650328fff6` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:18.313607 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d0e648-f151-457e-9811-d64a9438d854 admin admin] RBAC: Authorizing `identity:get_project(project_id=3c18c45cef234ea9b13f7b650328fff6)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:12:18.365277 dv-cinder-858275-1-smb devstack@keystone.service[81352]: WARNING keystone.common.rbac_enforcer.enforcer [None req-21d0e648-f151-457e-9811-d64a9438d854 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 19 10:12:18.365625 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d0e648-f151-457e-9811-d64a9438d854 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:12:18.370838 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 3/5] 10.222.0.66 () {56 vars in 1207 bytes} [Mon Sep 19 10:12:18 2022] GET /identity/v3/projects/3c18c45cef234ea9b13f7b650328fff6 => generated 344 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:12:20.534779 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d1e19b-6e88-4641-aa18-61e5bc027eef None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:20.535313 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d1e19b-6e88-4641-aa18-61e5bc027eef None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:20.535313 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d1e19b-6e88-4641-aa18-61e5bc027eef None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:20.540085 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 3/6] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:12:20 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:12:20.545748 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27eca9e-d441-4b91-b8af-f52ef3d21756 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:20.546136 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27eca9e-d441-4b91-b8af-f52ef3d21756 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:20.546340 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27eca9e-d441-4b91-b8af-f52ef3d21756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:20.566872 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-a27eca9e-d441-4b91-b8af-f52ef3d21756 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:12:20.568624 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-a27eca9e-d441-4b91-b8af-f52ef3d21756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:12:20.576581 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 4/7] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:12:20 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 19 10:12:20.850258 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d1e19b-6e88-4641-aa18-61e5bc027eef None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:12:20.862882 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d1e19b-6e88-4641-aa18-61e5bc027eef None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:12:20.867700 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f231d66-ceaf-43ba-82db-53a91ec8dad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:12:20.868337 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f231d66-ceaf-43ba-82db-53a91ec8dad0 admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:20.868621 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f231d66-ceaf-43ba-82db-53a91ec8dad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:20.868897 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f231d66-ceaf-43ba-82db-53a91ec8dad0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:20.876453 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f231d66-ceaf-43ba-82db-53a91ec8dad0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:12:20.878218 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f231d66-ceaf-43ba-82db-53a91ec8dad0 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:12:20.886940 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 4/8] 10.222.0.66 () {58 vars in 1324 bytes} [Mon Sep 19 10:12:20 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 19 10:12:20.892410 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27eca9e-d441-4b91-b8af-f52ef3d21756 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:12:20.902268 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27eca9e-d441-4b91-b8af-f52ef3d21756 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:12:20.906684 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b499fe-2f75-45bb-9d48-b5caff09da78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:12:20.907323 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b499fe-2f75-45bb-9d48-b5caff09da78 admin admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:20.907610 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b499fe-2f75-45bb-9d48-b5caff09da78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:20.907889 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b499fe-2f75-45bb-9d48-b5caff09da78 admin admin] PATH_INFO: `/v3/users/a561b673cfae437daade9297a694cc7c` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:20.909250 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b499fe-2f75-45bb-9d48-b5caff09da78 admin admin] RBAC: Authorizing `identity:get_user(user_id=a561b673cfae437daade9297a694cc7c)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:12:20.911105 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b499fe-2f75-45bb-9d48-b5caff09da78 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:12:20.912697 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 5/9] 10.222.0.66 () {56 vars in 1198 bytes} [Mon Sep 19 10:12:20 2022] GET /identity/v3/users/a561b673cfae437daade9297a694cc7c => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:12:23.135981 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee89f9a-62e8-4947-8008-6d8316844cd3 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:23.136546 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee89f9a-62e8-4947-8008-6d8316844cd3 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:23.136546 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee89f9a-62e8-4947-8008-6d8316844cd3 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:23.137900 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 5/10] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:12:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 10:12:23.143423 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9b61f8-58f3-4b2b-af8e-bdf9e03af05a None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:23.143807 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9b61f8-58f3-4b2b-af8e-bdf9e03af05a None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:23.144094 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9b61f8-58f3-4b2b-af8e-bdf9e03af05a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:23.162725 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-cd9b61f8-58f3-4b2b-af8e-bdf9e03af05a None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:12:23.163051 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffed9b78-1a55-47ee-b582-a7bf69e9795a None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:23.163729 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffed9b78-1a55-47ee-b582-a7bf69e9795a None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:23.163957 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffed9b78-1a55-47ee-b582-a7bf69e9795a None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:23.164542 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-cd9b61f8-58f3-4b2b-af8e-bdf9e03af05a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:12:23.165300 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 6/11] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:12:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:12:23.170994 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c230354b-431c-45da-bf01-d082883f2c59 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:23.171329 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c230354b-431c-45da-bf01-d082883f2c59 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:23.171558 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c230354b-431c-45da-bf01-d082883f2c59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:23.214003 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG passlib.handlers.bcrypt [None req-c230354b-431c-45da-bf01-d082883f2c59 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81351) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 19 10:12:23.214393 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG passlib.handlers.bcrypt [None req-c230354b-431c-45da-bf01-d082883f2c59 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81351) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 19 10:12:23.245671 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 6/12] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:12:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 10:12:23.264547 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-c230354b-431c-45da-bf01-d082883f2c59 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:12:23.266191 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-c230354b-431c-45da-bf01-d082883f2c59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:12:23.366429 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 7/13] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:12:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 10:12:23.515815 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9b61f8-58f3-4b2b-af8e-bdf9e03af05a None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:12:23.542509 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:12:23.620621 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9b61f8-58f3-4b2b-af8e-bdf9e03af05a None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:12:23.646182 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c230354b-431c-45da-bf01-d082883f2c59 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:12:23.655042 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecdfff0-c8d5-4035-941c-e9c7ce47d5fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:12:23.655692 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecdfff0-c8d5-4035-941c-e9c7ce47d5fe None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:23.655984 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecdfff0-c8d5-4035-941c-e9c7ce47d5fe None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:23.656300 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecdfff0-c8d5-4035-941c-e9c7ce47d5fe None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:23.668397 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecdfff0-c8d5-4035-941c-e9c7ce47d5fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 10:12:23.677319 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-3ecdfff0-c8d5-4035-941c-e9c7ce47d5fe None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 10:12:23.677319 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:12:23.677319 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:12:23.677319 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:12:23.677319 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:12:23.677319 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:12:23.677319 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:12:23.677319 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:12:23.677319 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:12:23.677319 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:12:23.677319 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:12:23.677319 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:12:23.677319 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 10:12:23.677319 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 10:12:23.677319 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 10:12:23.677319 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 10:12:23.678253 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 10:12:23.678253 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 10:12:23.678253 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 10:12:23.678253 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 10:12:23.678253 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:12:23.678253 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:12:23.678253 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:12:23.678253 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:12:23.678253 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:12:23.678253 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:12:23.678253 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:12:23.678253 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Sep 19 10:12:23.678253 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:12:23.678253 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:12:23.678253 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:12:23.678253 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:12:23.679166 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:12:23.679166 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:12:23.679166 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:12:23.679166 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:12:23.679166 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 10:12:23.679166 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 10:12:23.679166 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 10:12:23.679166 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 10:12:23.679166 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 10:12:23.679166 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 10:12:23.679166 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 10:12:23.679166 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Sep 19 10:12:23.679166 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 7/14] 10.222.0.66 () {56 vars in 1096 bytes} [Mon Sep 19 10:12:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:12:23.684130 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecdfff0-c8d5-4035-941c-e9c7ce47d5fe None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:12:23.755882 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c230354b-431c-45da-bf01-d082883f2c59 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:12:23.758740 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:12:23.769012 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:12:23.791283 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecdfff0-c8d5-4035-941c-e9c7ce47d5fe None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:12:23.795336 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66753d33-70c0-471f-ac52-39a113862017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:12:23.798111 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66753d33-70c0-471f-ac52-39a113862017 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:23.798402 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66753d33-70c0-471f-ac52-39a113862017 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:23.798686 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66753d33-70c0-471f-ac52-39a113862017 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:23.827169 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef64e235-e3e2-41d6-b418-d4eab21fdf31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:12:23.827781 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef64e235-e3e2-41d6-b418-d4eab21fdf31 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:23.828058 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef64e235-e3e2-41d6-b418-d4eab21fdf31 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:23.828371 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef64e235-e3e2-41d6-b418-d4eab21fdf31 None admin] PATH_INFO: `/v3/roles` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:23.829040 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef64e235-e3e2-41d6-b418-d4eab21fdf31 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:12:23.829341 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef64e235-e3e2-41d6-b418-d4eab21fdf31 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:12:23.830749 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef64e235-e3e2-41d6-b418-d4eab21fdf31 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:12:23.842991 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 8/15] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Sep 19 10:12:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 10:12:23.848697 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef64e235-e3e2-41d6-b418-d4eab21fdf31 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:12:23.870678 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66753d33-70c0-471f-ac52-39a113862017 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:12:23.872334 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66753d33-70c0-471f-ac52-39a113862017 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:12:23.952035 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef64e235-e3e2-41d6-b418-d4eab21fdf31 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:12:23.972124 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 8/16] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Sep 19 10:12:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 19 10:12:23.977632 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66753d33-70c0-471f-ac52-39a113862017 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:12:23.980339 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:12:23.985770 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0064ff4d-4e4b-4141-9215-8e42e1e1784b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:12:23.986340 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0064ff4d-4e4b-4141-9215-8e42e1e1784b None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:23.986621 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0064ff4d-4e4b-4141-9215-8e42e1e1784b None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:23.986895 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0064ff4d-4e4b-4141-9215-8e42e1e1784b None admin] PATH_INFO: `/v3/users/a561b673cfae437daade9297a694cc7c` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:23.988042 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0064ff4d-4e4b-4141-9215-8e42e1e1784b None admin] RBAC: Authorizing `identity:get_user(user_id=a561b673cfae437daade9297a694cc7c)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:12:23.989526 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0064ff4d-4e4b-4141-9215-8e42e1e1784b None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:12:23.991589 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 9/17] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Sep 19 10:12:23 2022] GET /identity/v3/users/a561b673cfae437daade9297a694cc7c => generated 247 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 10:12:23.997028 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0064ff4d-4e4b-4141-9215-8e42e1e1784b None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:12:24.012046 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:12:24.075845 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66753d33-70c0-471f-ac52-39a113862017 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:12:24.096856 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0064ff4d-4e4b-4141-9215-8e42e1e1784b None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:12:24.109398 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8bb62a-a6c9-408b-b8e4-b0850d6ea2f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:12:24.110620 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8bb62a-a6c9-408b-b8e4-b0850d6ea2f6 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:24.110903 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8bb62a-a6c9-408b-b8e4-b0850d6ea2f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:24.111180 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8bb62a-a6c9-408b-b8e4-b0850d6ea2f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:24.129906 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8bb62a-a6c9-408b-b8e4-b0850d6ea2f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:12:24.130497 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39118520-1910-42ac-8b84-89f2017b0256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:12:24.131142 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39118520-1910-42ac-8b84-89f2017b0256 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:24.131368 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8bb62a-a6c9-408b-b8e4-b0850d6ea2f6 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:12:24.131483 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39118520-1910-42ac-8b84-89f2017b0256 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:24.132364 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39118520-1910-42ac-8b84-89f2017b0256 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:24.133491 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39118520-1910-42ac-8b84-89f2017b0256 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:12:24.134945 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39118520-1910-42ac-8b84-89f2017b0256 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:12:24.136554 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 10/18] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 19 10:12:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 10:12:24.142654 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39118520-1910-42ac-8b84-89f2017b0256 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:12:24.155986 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-6e8bb62a-a6c9-408b-b8e4-b0850d6ea2f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 10:12:24.155986 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:12:24.155986 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:12:24.155986 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:12:24.155986 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:12:24.155986 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:12:24.155986 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:12:24.155986 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:12:24.155986 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:12:24.155986 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:12:24.155986 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:12:24.155986 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:12:24.155986 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 10:12:24.155986 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 10:12:24.155986 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 10:12:24.155986 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 10:12:24.157477 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:12:24.157477 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:12:24.157477 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:12:24.157477 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:12:24.157477 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:12:24.157477 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:12:24.157477 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:12:24.157477 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 19 10:12:24.157477 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:12:24.157477 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:12:24.157477 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:12:24.157477 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:12:24.157477 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:12:24.157477 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:12:24.157477 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:12:24.157477 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:12:24.157477 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 10:12:24.158258 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 10:12:24.158258 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 10:12:24.158258 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 19 10:12:24.158258 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 9/19] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 19 10:12:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 10:12:24.166153 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8bb62a-a6c9-408b-b8e4-b0850d6ea2f6 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:12:24.228159 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:12:24.228709 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:12:24.249123 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39118520-1910-42ac-8b84-89f2017b0256 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:12:24.275218 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8bb62a-a6c9-408b-b8e4-b0850d6ea2f6 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:12:24.282402 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fe2a76-7c5f-4e93-a50d-8a719d6fe01a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:12:24.283011 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fe2a76-7c5f-4e93-a50d-8a719d6fe01a None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:24.283294 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fe2a76-7c5f-4e93-a50d-8a719d6fe01a None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:24.283570 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fe2a76-7c5f-4e93-a50d-8a719d6fe01a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:24.284329 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fe2a76-7c5f-4e93-a50d-8a719d6fe01a None admin] RBAC: Adding query filter params (role.id=5c8b89fae4fa45bd944cbeaf442136e1, scope.domain.id=default, user.id=a561b673cfae437daade9297a694cc7c) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:12:24.284639 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fe2a76-7c5f-4e93-a50d-8a719d6fe01a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:12:24.286113 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fe2a76-7c5f-4e93-a50d-8a719d6fe01a None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:12:24.293772 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 11/20] 10.222.0.66 () {56 vars in 1322 bytes} [Mon Sep 19 10:12:24 2022] GET /identity/v3/role_assignments?user.id=a561b673cfae437daade9297a694cc7c&scope.domain.id=default&role.id=5c8b89fae4fa45bd944cbeaf442136e1 => generated 233 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 10:12:24.310337 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de09fed5-7ee0-4c55-8709-1fea7a2f2445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:12:24.310977 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de09fed5-7ee0-4c55-8709-1fea7a2f2445 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:24.311256 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de09fed5-7ee0-4c55-8709-1fea7a2f2445 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:24.311533 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de09fed5-7ee0-4c55-8709-1fea7a2f2445 None admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:24.312235 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de09fed5-7ee0-4c55-8709-1fea7a2f2445 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:12:24.312545 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de09fed5-7ee0-4c55-8709-1fea7a2f2445 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:12:24.313991 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de09fed5-7ee0-4c55-8709-1fea7a2f2445 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:12:24.334678 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 10/21] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Sep 19 10:12:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 10:12:26.809162 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96009f7b-0906-4228-8660-029262f403f2 None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:26.809661 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96009f7b-0906-4228-8660-029262f403f2 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:26.809759 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96009f7b-0906-4228-8660-029262f403f2 None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:26.811043 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 12/22] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:12:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:12:26.816498 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5d7222-2e25-4c81-81cb-e2ccf96f2438 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:26.817357 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5d7222-2e25-4c81-81cb-e2ccf96f2438 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:26.817834 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5d7222-2e25-4c81-81cb-e2ccf96f2438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:26.844417 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-2d5d7222-2e25-4c81-81cb-e2ccf96f2438 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:12:26.845978 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-2d5d7222-2e25-4c81-81cb-e2ccf96f2438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:12:26.911770 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14d4a84-e9e9-4426-8ec3-278e33b28532 None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:26.912500 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14d4a84-e9e9-4426-8ec3-278e33b28532 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:26.913065 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14d4a84-e9e9-4426-8ec3-278e33b28532 None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:26.915320 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 13/23] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:12:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 10:12:26.922369 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d616f89a-cb1d-4729-bec6-f6e2b15eb5c1 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:26.922649 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d616f89a-cb1d-4729-bec6-f6e2b15eb5c1 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:26.923135 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d616f89a-cb1d-4729-bec6-f6e2b15eb5c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:26.946941 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-d616f89a-cb1d-4729-bec6-f6e2b15eb5c1 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:12:26.948558 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-d616f89a-cb1d-4729-bec6-f6e2b15eb5c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:12:26.961310 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 11/24] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:12:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 10:12:27.031244 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 14/25] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:12:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 10:12:27.120769 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073a4ab0-9240-4e6d-9569-6d931c97896c None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:27.121282 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073a4ab0-9240-4e6d-9569-6d931c97896c None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:27.121735 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073a4ab0-9240-4e6d-9569-6d931c97896c None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:27.123222 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 12/26] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:12:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:12:27.128728 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d47de5c-23b7-4bda-aa31-1ddfd08c060e None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:27.129016 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d47de5c-23b7-4bda-aa31-1ddfd08c060e None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:27.129293 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d47de5c-23b7-4bda-aa31-1ddfd08c060e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:27.153578 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-7d47de5c-23b7-4bda-aa31-1ddfd08c060e None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:12:27.154793 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-7d47de5c-23b7-4bda-aa31-1ddfd08c060e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:12:27.235904 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 15/27] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:12:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 10:12:27.418572 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073a4ab0-9240-4e6d-9569-6d931c97896c None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:12:27.453627 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d47de5c-23b7-4bda-aa31-1ddfd08c060e None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:12:27.457660 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:12:27.503064 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:12:27.577484 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073a4ab0-9240-4e6d-9569-6d931c97896c None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:12:27.617260 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccfe773-4d06-4121-a1df-9216ee7c1540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:12:27.618536 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccfe773-4d06-4121-a1df-9216ee7c1540 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:27.619010 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccfe773-4d06-4121-a1df-9216ee7c1540 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:27.619488 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccfe773-4d06-4121-a1df-9216ee7c1540 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:27.632906 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccfe773-4d06-4121-a1df-9216ee7c1540 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 10:12:27.639970 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-1ccfe773-4d06-4121-a1df-9216ee7c1540 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 10:12:27.639970 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:12:27.639970 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:12:27.639970 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:12:27.639970 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:12:27.639970 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:12:27.639970 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:12:27.639970 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:12:27.639970 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:12:27.639970 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:12:27.639970 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:12:27.639970 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:12:27.639970 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 10:12:27.639970 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 10:12:27.639970 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 10:12:27.639970 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 10:12:27.640823 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 10:12:27.640823 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 10:12:27.640823 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 10:12:27.640823 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 10:12:27.640823 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:12:27.640823 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:12:27.640823 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:12:27.640823 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:12:27.640823 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:12:27.640823 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:12:27.640823 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:12:27.640823 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 19 10:12:27.640823 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:12:27.640823 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:12:27.640823 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:12:27.640823 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:12:27.641572 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:12:27.641572 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:12:27.641572 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:12:27.641572 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:12:27.641572 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 10:12:27.641572 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 10:12:27.641572 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 10:12:27.641572 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 10:12:27.641572 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 10:12:27.641572 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 10:12:27.641572 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 10:12:27.641572 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 19 10:12:27.648284 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 13/28] 10.222.0.66 () {56 vars in 1096 bytes} [Mon Sep 19 10:12:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:12:27.650592 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d47de5c-23b7-4bda-aa31-1ddfd08c060e None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:12:27.651516 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccfe773-4d06-4121-a1df-9216ee7c1540 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:12:27.740870 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1951c22-8dbe-47e7-bcfd-1aeb7bd0f207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:12:27.742298 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1951c22-8dbe-47e7-bcfd-1aeb7bd0f207 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:27.742713 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1951c22-8dbe-47e7-bcfd-1aeb7bd0f207 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:27.743150 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1951c22-8dbe-47e7-bcfd-1aeb7bd0f207 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:27.768930 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1951c22-8dbe-47e7-bcfd-1aeb7bd0f207 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:12:27.769273 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccfe773-4d06-4121-a1df-9216ee7c1540 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:12:27.770847 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1951c22-8dbe-47e7-bcfd-1aeb7bd0f207 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:12:27.777230 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:12:27.800701 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-c1951c22-8dbe-47e7-bcfd-1aeb7bd0f207 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 10:12:27.800701 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:12:27.800701 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:12:27.800701 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:12:27.800701 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:12:27.800701 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:12:27.800701 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:12:27.800701 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:12:27.800701 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:12:27.800701 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:12:27.800701 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:12:27.800701 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:12:27.800701 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 10:12:27.800701 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 10:12:27.800701 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 10:12:27.800701 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 10:12:27.801621 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:12:27.801621 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:12:27.801621 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:12:27.801621 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:12:27.801621 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:12:27.801621 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:12:27.801621 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:12:27.801621 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Sep 19 10:12:27.801621 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:12:27.801621 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:12:27.801621 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:12:27.801621 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:12:27.801621 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:12:27.801621 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:12:27.801621 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:12:27.801621 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:12:27.801621 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 10:12:27.802478 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 10:12:27.802478 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 10:12:27.802478 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Sep 19 10:12:27.808725 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a6bfbc-4396-46c0-b384-047ada3493cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:12:27.809421 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a6bfbc-4396-46c0-b384-047ada3493cc None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:27.809774 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a6bfbc-4396-46c0-b384-047ada3493cc None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:27.810052 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 16/29] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 19 10:12:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 357 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:12:27.810477 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a6bfbc-4396-46c0-b384-047ada3493cc None admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:27.811283 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a6bfbc-4396-46c0-b384-047ada3493cc None admin] RBAC: Adding query filter params (name=admin) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:12:27.811656 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a6bfbc-4396-46c0-b384-047ada3493cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:12:27.811813 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1951c22-8dbe-47e7-bcfd-1aeb7bd0f207 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:12:27.813404 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a6bfbc-4396-46c0-b384-047ada3493cc None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:12:27.828507 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 14/30] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Sep 19 10:12:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 10:12:27.830678 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a6bfbc-4396-46c0-b384-047ada3493cc None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:12:27.932326 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:12:27.956190 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a6bfbc-4396-46c0-b384-047ada3493cc None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:12:27.990216 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c3575b-f65c-44c3-ad38-a9189638800c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:12:27.990835 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c3575b-f65c-44c3-ad38-a9189638800c None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:27.991677 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c3575b-f65c-44c3-ad38-a9189638800c None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:27.991959 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c3575b-f65c-44c3-ad38-a9189638800c None admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:27.992639 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c3575b-f65c-44c3-ad38-a9189638800c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:12:27.992945 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c3575b-f65c-44c3-ad38-a9189638800c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:12:27.994337 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c3575b-f65c-44c3-ad38-a9189638800c None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:12:28.000083 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1951c22-8dbe-47e7-bcfd-1aeb7bd0f207 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:12:28.005971 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 15/31] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Sep 19 10:12:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:12:28.007577 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c3575b-f65c-44c3-ad38-a9189638800c None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:12:28.040467 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:12:28.049919 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf542e0-c439-44ff-97b5-d1037eee7472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:12:28.050743 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf542e0-c439-44ff-97b5-d1037eee7472 None admin] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:28.051162 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf542e0-c439-44ff-97b5-d1037eee7472 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:28.051578 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf542e0-c439-44ff-97b5-d1037eee7472 None admin] PATH_INFO: `/v3/roles` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:28.052414 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf542e0-c439-44ff-97b5-d1037eee7472 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:12:28.054661 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf542e0-c439-44ff-97b5-d1037eee7472 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:12:28.115799 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c3575b-f65c-44c3-ad38-a9189638800c None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:12:28.151645 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeef71ee-bb35-4cdc-8195-cc9fe530442b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:12:28.152590 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeef71ee-bb35-4cdc-8195-cc9fe530442b None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:28.153021 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeef71ee-bb35-4cdc-8195-cc9fe530442b None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:28.153466 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeef71ee-bb35-4cdc-8195-cc9fe530442b None admin] PATH_INFO: `/v3/users/a561b673cfae437daade9297a694cc7c` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:28.155102 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeef71ee-bb35-4cdc-8195-cc9fe530442b None admin] RBAC: Authorizing `identity:get_user(user_id=a561b673cfae437daade9297a694cc7c)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:12:28.156904 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeef71ee-bb35-4cdc-8195-cc9fe530442b None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:12:28.158778 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 16/32] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Sep 19 10:12:28 2022] GET /identity/v3/users/a561b673cfae437daade9297a694cc7c => generated 247 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:12:28.160062 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0001385b-e8cf-4240-b5a7-cc24613a9d4c None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:28.160524 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0001385b-e8cf-4240-b5a7-cc24613a9d4c None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:28.160944 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0001385b-e8cf-4240-b5a7-cc24613a9d4c None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:28.162297 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 17/33] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:12:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:12:28.163186 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0001385b-e8cf-4240-b5a7-cc24613a9d4c None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:12:28.192347 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 17/34] 10.222.0.66 () {60 vars in 1131 bytes} [Mon Sep 19 10:12:27 2022] POST /identity/v3/roles => generated 219 bytes in 377 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:12:28.192347 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa299b8-7c20-422e-a9d7-c344814c3256 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:28.192347 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa299b8-7c20-422e-a9d7-c344814c3256 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:28.192347 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa299b8-7c20-422e-a9d7-c344814c3256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:28.213471 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-afa299b8-7c20-422e-a9d7-c344814c3256 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:12:28.215478 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-afa299b8-7c20-422e-a9d7-c344814c3256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:12:28.317951 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 18/35] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:12:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 10:12:28.318553 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa299b8-7c20-422e-a9d7-c344814c3256 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:12:28.328671 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:12:28.338440 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0001385b-e8cf-4240-b5a7-cc24613a9d4c None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:12:28.382914 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed2ec85-faa7-4768-9755-fd52974a483f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:12:28.383899 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed2ec85-faa7-4768-9755-fd52974a483f None admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:28.384494 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed2ec85-faa7-4768-9755-fd52974a483f None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:28.384963 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed2ec85-faa7-4768-9755-fd52974a483f None admin] PATH_INFO: `/v3/projects` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:28.385862 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed2ec85-faa7-4768-9755-fd52974a483f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:12:28.387670 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed2ec85-faa7-4768-9755-fd52974a483f None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:12:28.470032 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:12:28.548320 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 18/36] 10.222.0.66 () {60 vars in 1141 bytes} [Mon Sep 19 10:12:28 2022] POST /identity/v3/projects => generated 301 bytes in 381 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:12:28.550308 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeb0f6a-913f-41ac-a3a5-2c692960c3c6 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:28.550818 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeb0f6a-913f-41ac-a3a5-2c692960c3c6 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:28.551296 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeb0f6a-913f-41ac-a3a5-2c692960c3c6 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:28.552802 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 19/37] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:12:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:12:28.560537 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a72480-4df8-40b0-9739-cf5b801bd472 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:28.561065 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a72480-4df8-40b0-9739-cf5b801bd472 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:28.561696 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a72480-4df8-40b0-9739-cf5b801bd472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:28.585163 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-24a72480-4df8-40b0-9739-cf5b801bd472 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:12:28.587224 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-24a72480-4df8-40b0-9739-cf5b801bd472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:12:28.590182 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa299b8-7c20-422e-a9d7-c344814c3256 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:12:28.671843 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 20/38] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:12:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 10:12:28.680990 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841ddc90-ad63-45d7-87ca-e63fc6b11493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:12:28.681785 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841ddc90-ad63-45d7-87ca-e63fc6b11493 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:28.682145 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841ddc90-ad63-45d7-87ca-e63fc6b11493 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:28.682498 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841ddc90-ad63-45d7-87ca-e63fc6b11493 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:28.688621 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841ddc90-ad63-45d7-87ca-e63fc6b11493 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:12:28.690486 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841ddc90-ad63-45d7-87ca-e63fc6b11493 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:12:28.692454 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 19/39] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 19 10:12:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 374 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:12:28.699045 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a72480-4df8-40b0-9739-cf5b801bd472 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:12:28.728249 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841ddc90-ad63-45d7-87ca-e63fc6b11493 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:12:28.808795 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:12:28.837892 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a72480-4df8-40b0-9739-cf5b801bd472 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:12:28.876857 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec2e513-fec7-456f-827d-526154433a87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:12:28.877918 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec2e513-fec7-456f-827d-526154433a87 None admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:28.878428 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec2e513-fec7-456f-827d-526154433a87 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:28.878874 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec2e513-fec7-456f-827d-526154433a87 None admin] PATH_INFO: `/v3/domains/default/users/a561b673cfae437daade9297a694cc7c/roles/5c8b89fae4fa45bd944cbeaf442136e1` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:28.881187 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec2e513-fec7-456f-827d-526154433a87 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=a561b673cfae437daade9297a694cc7c, role_id=5c8b89fae4fa45bd944cbeaf442136e1)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:12:28.883728 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec2e513-fec7-456f-827d-526154433a87 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:12:28.908812 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 21/40] 10.222.0.66 () {58 vars in 1361 bytes} [Mon Sep 19 10:12:28 2022] PUT /identity/v3/domains/default/users/a561b673cfae437daade9297a694cc7c/roles/5c8b89fae4fa45bd944cbeaf442136e1 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:12:28.914316 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b2c74d-9952-4397-81e5-494659c18d58 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:28.915054 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b2c74d-9952-4397-81e5-494659c18d58 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:28.915526 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b2c74d-9952-4397-81e5-494659c18d58 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:28.917199 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 22/41] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:12:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:12:28.927300 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2ef78c-8dc8-4961-8d8d-e18969e9f7c0 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:28.927300 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2ef78c-8dc8-4961-8d8d-e18969e9f7c0 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:28.927300 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2ef78c-8dc8-4961-8d8d-e18969e9f7c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:28.948899 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-0e2ef78c-8dc8-4961-8d8d-e18969e9f7c0 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:12:28.950260 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-0e2ef78c-8dc8-4961-8d8d-e18969e9f7c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:12:29.046232 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 23/42] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:12:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 10:12:29.047425 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2ef78c-8dc8-4961-8d8d-e18969e9f7c0 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:12:29.050670 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841ddc90-ad63-45d7-87ca-e63fc6b11493 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:12:29.077948 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:12:29.104762 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9d414a-845a-4e0b-8716-c2cfb5f00a95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:12:29.105967 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9d414a-845a-4e0b-8716-c2cfb5f00a95 None admin] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:29.106330 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9d414a-845a-4e0b-8716-c2cfb5f00a95 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:29.106683 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9d414a-845a-4e0b-8716-c2cfb5f00a95 None admin] PATH_INFO: `/v3/roles` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:29.107845 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9d414a-845a-4e0b-8716-c2cfb5f00a95 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:12:29.109924 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9d414a-845a-4e0b-8716-c2cfb5f00a95 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:12:29.132806 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 20/43] 10.222.0.66 () {60 vars in 1131 bytes} [Mon Sep 19 10:12:28 2022] POST /identity/v3/roles => generated 225 bytes in 405 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 10:12:29.144583 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:12:29.184311 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2ef78c-8dc8-4961-8d8d-e18969e9f7c0 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:12:29.224993 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4143a4ee-8f13-4b61-b235-a484d429b36b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:12:29.226184 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4143a4ee-8f13-4b61-b235-a484d429b36b None admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:29.226466 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4143a4ee-8f13-4b61-b235-a484d429b36b None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:29.226743 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4143a4ee-8f13-4b61-b235-a484d429b36b None admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:29.227427 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4143a4ee-8f13-4b61-b235-a484d429b36b None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:12:29.228944 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4143a4ee-8f13-4b61-b235-a484d429b36b None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:12:29.248673 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 24/44] 10.222.0.66 () {60 vars in 1131 bytes} [Mon Sep 19 10:12:29 2022] POST /identity/v3/roles => generated 223 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:12:29.338189 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9d414a-845a-4e0b-8716-c2cfb5f00a95 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:12:29.459629 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9d414a-845a-4e0b-8716-c2cfb5f00a95 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:12:29.496770 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7a28f7-ae9d-401f-9a9b-fceec4505fb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:12:29.497419 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7a28f7-ae9d-401f-9a9b-fceec4505fb3 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:29.497708 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7a28f7-ae9d-401f-9a9b-fceec4505fb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:29.498050 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7a28f7-ae9d-401f-9a9b-fceec4505fb3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:29.499198 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7a28f7-ae9d-401f-9a9b-fceec4505fb3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:12:29.500718 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7a28f7-ae9d-401f-9a9b-fceec4505fb3 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:12:29.502533 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 21/45] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 19 10:12:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:12:29.509041 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4143a4ee-8f13-4b61-b235-a484d429b36b None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:12:29.609348 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4143a4ee-8f13-4b61-b235-a484d429b36b None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:12:29.634941 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:12:29.643684 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ef7417-7135-483e-bdb2-dc02ce3eb069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:12:29.644341 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ef7417-7135-483e-bdb2-dc02ce3eb069 None admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:29.644630 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ef7417-7135-483e-bdb2-dc02ce3eb069 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:29.644906 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ef7417-7135-483e-bdb2-dc02ce3eb069 None admin] PATH_INFO: `/v3/projects` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:29.645564 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ef7417-7135-483e-bdb2-dc02ce3eb069 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:12:29.647023 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ef7417-7135-483e-bdb2-dc02ce3eb069 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:12:29.674260 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 25/46] 10.222.0.66 () {60 vars in 1141 bytes} [Mon Sep 19 10:12:29 2022] POST /identity/v3/projects => generated 312 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:12:31.211768 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee35f503-ce38-4979-8d70-09addfd18f1f None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:31.212363 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee35f503-ce38-4979-8d70-09addfd18f1f None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:31.212363 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee35f503-ce38-4979-8d70-09addfd18f1f None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:31.213695 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 22/47] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:12:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:12:31.219198 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9401c8-ce32-4685-a397-6859f562c107 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:31.219656 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9401c8-ce32-4685-a397-6859f562c107 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:31.219763 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9401c8-ce32-4685-a397-6859f562c107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:31.238098 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-6c9401c8-ce32-4685-a397-6859f562c107 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:12:31.239294 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-6c9401c8-ce32-4685-a397-6859f562c107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:12:31.307835 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 26/48] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:12:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 10:12:31.575874 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee35f503-ce38-4979-8d70-09addfd18f1f None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:12:31.620861 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:12:31.679889 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee35f503-ce38-4979-8d70-09addfd18f1f None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:12:31.714373 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3be78b-d07b-403e-aee6-957210fda9b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:12:31.715042 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3be78b-d07b-403e-aee6-957210fda9b2 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:31.715327 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3be78b-d07b-403e-aee6-957210fda9b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:31.715605 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3be78b-d07b-403e-aee6-957210fda9b2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:31.727980 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3be78b-d07b-403e-aee6-957210fda9b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 10:12:31.733153 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-3c3be78b-d07b-403e-aee6-957210fda9b2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 10:12:31.733153 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:12:31.733153 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:12:31.733153 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:12:31.733153 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:12:31.733153 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:12:31.733153 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:12:31.733153 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:12:31.733153 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:12:31.733153 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:12:31.733153 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:12:31.733153 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:12:31.733153 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 10:12:31.733153 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 10:12:31.733153 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 10:12:31.733153 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 10:12:31.734058 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 10:12:31.734058 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 10:12:31.734058 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 10:12:31.734058 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 10:12:31.734058 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:12:31.734058 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:12:31.734058 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:12:31.734058 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:12:31.734058 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:12:31.734058 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:12:31.734058 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:12:31.734058 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Sep 19 10:12:31.734058 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:12:31.734058 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:12:31.734058 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:12:31.734058 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:12:31.734792 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:12:31.734792 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:12:31.734792 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:12:31.734792 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:12:31.734792 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 10:12:31.734792 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 10:12:31.734792 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 10:12:31.734792 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 10:12:31.734792 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 10:12:31.734792 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 10:12:31.734792 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 10:12:31.734792 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Sep 19 10:12:31.734792 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 23/49] 10.222.0.66 () {56 vars in 1096 bytes} [Mon Sep 19 10:12:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:12:31.740612 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9401c8-ce32-4685-a397-6859f562c107 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:12:31.841509 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a0bdb1-a862-4fcd-9a50-8c7a7fd5b47e None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:31.841718 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a0bdb1-a862-4fcd-9a50-8c7a7fd5b47e None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:31.842004 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a0bdb1-a862-4fcd-9a50-8c7a7fd5b47e None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:31.843366 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 24/50] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:12:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 10:12:31.844417 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9401c8-ce32-4685-a397-6859f562c107 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:12:31.848761 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53727b2d-81c4-481d-b3e4-d0a1e47a0f25 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:31.849048 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53727b2d-81c4-481d-b3e4-d0a1e47a0f25 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:31.849325 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53727b2d-81c4-481d-b3e4-d0a1e47a0f25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:31.873809 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-53727b2d-81c4-481d-b3e4-d0a1e47a0f25 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:12:31.875070 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-53727b2d-81c4-481d-b3e4-d0a1e47a0f25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:12:31.952320 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 25/51] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:12:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 10:12:31.963659 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:12:31.987813 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1eb3efc-454b-437c-9d25-4c9489f4b28e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:12:31.988468 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eb3efc-454b-437c-9d25-4c9489f4b28e None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:31.988807 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eb3efc-454b-437c-9d25-4c9489f4b28e None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:31.989088 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eb3efc-454b-437c-9d25-4c9489f4b28e None admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:31.989780 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1eb3efc-454b-437c-9d25-4c9489f4b28e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:12:31.990089 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1eb3efc-454b-437c-9d25-4c9489f4b28e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:12:31.991487 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1eb3efc-454b-437c-9d25-4c9489f4b28e None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:12:31.999512 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 27/52] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Sep 19 10:12:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:12:32.005360 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53727b2d-81c4-481d-b3e4-d0a1e47a0f25 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:12:32.038212 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:12:32.105990 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53727b2d-81c4-481d-b3e4-d0a1e47a0f25 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:12:32.138659 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032b398e-5098-4c92-a363-060b845c4e76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:12:32.139302 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032b398e-5098-4c92-a363-060b845c4e76 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:32.139583 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032b398e-5098-4c92-a363-060b845c4e76 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:32.139855 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032b398e-5098-4c92-a363-060b845c4e76 None admin] PATH_INFO: `/v3/users/a561b673cfae437daade9297a694cc7c` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:32.141084 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032b398e-5098-4c92-a363-060b845c4e76 None admin] RBAC: Authorizing `identity:get_user(user_id=a561b673cfae437daade9297a694cc7c)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:12:32.142540 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032b398e-5098-4c92-a363-060b845c4e76 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:12:32.144112 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 26/53] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Sep 19 10:12:32 2022] GET /identity/v3/users/a561b673cfae437daade9297a694cc7c => generated 247 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:12:32.150278 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1eb3efc-454b-437c-9d25-4c9489f4b28e None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:12:32.221907 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032b398e-5098-4c92-a363-060b845c4e76 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:12:32.250290 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1eb3efc-454b-437c-9d25-4c9489f4b28e None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:12:32.283931 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e903cdf6-35d2-4c58-bcdd-c8ccbde98575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:12:32.284579 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e903cdf6-35d2-4c58-bcdd-c8ccbde98575 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:32.284862 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e903cdf6-35d2-4c58-bcdd-c8ccbde98575 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:32.285140 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e903cdf6-35d2-4c58-bcdd-c8ccbde98575 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:32.286271 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e903cdf6-35d2-4c58-bcdd-c8ccbde98575 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:12:32.287711 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e903cdf6-35d2-4c58-bcdd-c8ccbde98575 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:12:32.289367 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 28/54] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 19 10:12:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:12:32.295349 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e903cdf6-35d2-4c58-bcdd-c8ccbde98575 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:12:32.321887 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:12:32.325282 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032b398e-5098-4c92-a363-060b845c4e76 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:12:32.337935 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:12:32.360333 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2f6c59-728c-449d-bea3-6b8fda9f1081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:12:32.361106 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2f6c59-728c-449d-bea3-6b8fda9f1081 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:32.361233 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2f6c59-728c-449d-bea3-6b8fda9f1081 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:32.361464 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2f6c59-728c-449d-bea3-6b8fda9f1081 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:32.362589 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2f6c59-728c-449d-bea3-6b8fda9f1081 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:12:32.364060 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2f6c59-728c-449d-bea3-6b8fda9f1081 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:12:32.365706 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 27/55] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 19 10:12:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:12:32.374820 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2f6c59-728c-449d-bea3-6b8fda9f1081 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:12:32.395406 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e903cdf6-35d2-4c58-bcdd-c8ccbde98575 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:12:32.430489 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01121380-6cbc-496f-8dda-670e8248056d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:12:32.431107 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01121380-6cbc-496f-8dda-670e8248056d None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:32.431387 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01121380-6cbc-496f-8dda-670e8248056d None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:32.431662 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01121380-6cbc-496f-8dda-670e8248056d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:32.432415 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01121380-6cbc-496f-8dda-670e8248056d None admin] RBAC: Adding query filter params (role.id=5c8b89fae4fa45bd944cbeaf442136e1, scope.domain.id=default, user.id=a561b673cfae437daade9297a694cc7c) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:12:32.432732 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01121380-6cbc-496f-8dda-670e8248056d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:12:32.434174 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01121380-6cbc-496f-8dda-670e8248056d None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:12:32.442447 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 29/56] 10.222.0.66 () {56 vars in 1322 bytes} [Mon Sep 19 10:12:32 2022] GET /identity/v3/role_assignments?user.id=a561b673cfae437daade9297a694cc7c&scope.domain.id=default&role.id=5c8b89fae4fa45bd944cbeaf442136e1 => generated 530 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 10:12:32.480983 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2f6c59-728c-449d-bea3-6b8fda9f1081 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:12:32.516470 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020b210c-6860-4afc-856b-6eea33a13252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:12:32.517105 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020b210c-6860-4afc-856b-6eea33a13252 None admin] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:32.517388 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020b210c-6860-4afc-856b-6eea33a13252 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:32.517666 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020b210c-6860-4afc-856b-6eea33a13252 None admin] PATH_INFO: `/v3/projects` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:32.518328 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020b210c-6860-4afc-856b-6eea33a13252 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:12:32.519818 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020b210c-6860-4afc-856b-6eea33a13252 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:12:32.551126 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 28/57] 10.222.0.66 () {60 vars in 1140 bytes} [Mon Sep 19 10:12:32 2022] POST /identity/v3/projects => generated 298 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 10:12:34.719163 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c48cc8-a8f5-4f5d-882c-68f207373c25 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:34.719593 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c48cc8-a8f5-4f5d-882c-68f207373c25 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:34.719720 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c48cc8-a8f5-4f5d-882c-68f207373c25 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:34.721095 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 30/58] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:12:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:12:34.726242 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44368ba-b5f7-4126-9817-43f28bc0db17 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:34.726621 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44368ba-b5f7-4126-9817-43f28bc0db17 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:34.726799 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44368ba-b5f7-4126-9817-43f28bc0db17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:34.745041 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-d44368ba-b5f7-4126-9817-43f28bc0db17 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:12:34.746221 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-d44368ba-b5f7-4126-9817-43f28bc0db17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:12:34.760333 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:12:34.813108 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 29/59] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:12:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 10:12:35.084509 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c48cc8-a8f5-4f5d-882c-68f207373c25 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:12:35.183495 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c48cc8-a8f5-4f5d-882c-68f207373c25 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:12:35.185777 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:12:35.216996 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f2d48d-d2b8-4188-9685-be5b02366a9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:12:35.217630 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f2d48d-d2b8-4188-9685-be5b02366a9b None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:35.217915 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f2d48d-d2b8-4188-9685-be5b02366a9b None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:35.218195 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f2d48d-d2b8-4188-9685-be5b02366a9b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:35.219307 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f2d48d-d2b8-4188-9685-be5b02366a9b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:12:35.220794 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f2d48d-d2b8-4188-9685-be5b02366a9b None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:12:35.222368 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 31/60] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 19 10:12:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:12:35.228590 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44368ba-b5f7-4126-9817-43f28bc0db17 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:12:35.337093 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44368ba-b5f7-4126-9817-43f28bc0db17 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:12:35.370300 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb53f1ff-09d7-4517-985d-cbe95ec048bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:12:35.370899 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb53f1ff-09d7-4517-985d-cbe95ec048bf None admin] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:35.371180 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb53f1ff-09d7-4517-985d-cbe95ec048bf None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:35.371454 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb53f1ff-09d7-4517-985d-cbe95ec048bf None admin] PATH_INFO: `/v3/users` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:35.372102 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb53f1ff-09d7-4517-985d-cbe95ec048bf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:12:35.373593 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb53f1ff-09d7-4517-985d-cbe95ec048bf None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:12:35.400849 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 30/61] 10.222.0.66 () {60 vars in 1132 bytes} [Mon Sep 19 10:12:35 2022] POST /identity/v3/users => generated 275 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:12:38.498450 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9a547d-4ed2-4304-96d6-30b6d69de577 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:38.499473 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9a547d-4ed2-4304-96d6-30b6d69de577 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:38.499994 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9a547d-4ed2-4304-96d6-30b6d69de577 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:38.501628 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 32/62] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:12:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:12:38.507798 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8805c147-b24d-4c53-9543-730ed9157541 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:38.508254 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8805c147-b24d-4c53-9543-730ed9157541 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:38.508392 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8805c147-b24d-4c53-9543-730ed9157541 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:38.531348 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:12:38.538832 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-8805c147-b24d-4c53-9543-730ed9157541 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:12:38.541206 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-8805c147-b24d-4c53-9543-730ed9157541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:12:38.641585 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 31/63] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:12:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 10:12:38.651451 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcc3b80-e113-441d-8484-2361dafea392 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:38.652054 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcc3b80-e113-441d-8484-2361dafea392 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:38.652571 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcc3b80-e113-441d-8484-2361dafea392 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:38.654418 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 33/64] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:12:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:12:38.659486 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d603fc6-9b3c-4b6d-b426-6fd0176d05de None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:38.659783 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d603fc6-9b3c-4b6d-b426-6fd0176d05de None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:38.660069 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d603fc6-9b3c-4b6d-b426-6fd0176d05de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:38.696715 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-7d603fc6-9b3c-4b6d-b426-6fd0176d05de None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:12:38.697978 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-7d603fc6-9b3c-4b6d-b426-6fd0176d05de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:12:38.802453 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 32/65] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:12:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 10:12:38.954136 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcc3b80-e113-441d-8484-2361dafea392 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:12:39.086315 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcc3b80-e113-441d-8484-2361dafea392 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:12:39.134508 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647f2662-8f02-41e2-ba96-c71dbb6b9969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:12:39.135605 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647f2662-8f02-41e2-ba96-c71dbb6b9969 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:39.136093 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647f2662-8f02-41e2-ba96-c71dbb6b9969 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:39.136594 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647f2662-8f02-41e2-ba96-c71dbb6b9969 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:39.157910 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647f2662-8f02-41e2-ba96-c71dbb6b9969 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 10:12:39.163784 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-647f2662-8f02-41e2-ba96-c71dbb6b9969 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 19 10:12:39.163784 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:12:39.163784 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:12:39.163784 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:12:39.163784 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:12:39.163784 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:12:39.163784 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:12:39.163784 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:12:39.163784 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:12:39.163784 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:12:39.163784 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:12:39.163784 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:12:39.163784 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 10:12:39.163784 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 10:12:39.163784 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 10:12:39.163784 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 10:12:39.164724 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 10:12:39.164724 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 10:12:39.164724 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 10:12:39.164724 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 10:12:39.164724 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:12:39.164724 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:12:39.164724 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:12:39.164724 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:12:39.164724 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:12:39.164724 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:12:39.164724 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:12:39.164724 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 19 10:12:39.164724 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:12:39.164724 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:12:39.164724 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:12:39.164724 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:12:39.165479 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:12:39.165479 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:12:39.165479 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:12:39.165479 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:12:39.165479 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 10:12:39.165479 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 10:12:39.165479 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 10:12:39.165479 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 10:12:39.165479 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 10:12:39.165479 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 10:12:39.165479 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 19 10:12:39.165479 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 19 10:12:39.165479 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 34/66] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Sep 19 10:12:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:12:39.171710 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d603fc6-9b3c-4b6d-b426-6fd0176d05de None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:12:39.183755 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647f2662-8f02-41e2-ba96-c71dbb6b9969 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:12:39.240595 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:12:39.299612 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:12:39.328271 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647f2662-8f02-41e2-ba96-c71dbb6b9969 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:12:39.339046 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d603fc6-9b3c-4b6d-b426-6fd0176d05de None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:12:39.370551 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ea43a6-1a62-411b-9b41-56093d6bb833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:12:39.371192 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ea43a6-1a62-411b-9b41-56093d6bb833 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:39.371480 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ea43a6-1a62-411b-9b41-56093d6bb833 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:39.371761 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ea43a6-1a62-411b-9b41-56093d6bb833 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:39.379008 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1cc02b-43ba-474d-82be-210c332464b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:12:39.379807 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1cc02b-43ba-474d-82be-210c332464b2 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:39.380285 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1cc02b-43ba-474d-82be-210c332464b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:39.380708 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1cc02b-43ba-474d-82be-210c332464b2 None admin] PATH_INFO: `/v3/roles` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:39.381574 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1cc02b-43ba-474d-82be-210c332464b2 None admin] RBAC: Adding query filter params (name=member) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:12:39.382024 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1cc02b-43ba-474d-82be-210c332464b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:12:39.382247 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ea43a6-1a62-411b-9b41-56093d6bb833 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 10:12:39.383727 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1cc02b-43ba-474d-82be-210c332464b2 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:12:39.387098 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-a8ea43a6-1a62-411b-9b41-56093d6bb833 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 10:12:39.387098 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:12:39.387098 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:12:39.387098 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:12:39.387098 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:12:39.387098 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:12:39.387098 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:12:39.387098 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:12:39.387098 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:12:39.387098 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:12:39.387098 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:12:39.387098 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:12:39.387098 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 10:12:39.387098 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 10:12:39.387098 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 10:12:39.387098 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 10:12:39.388142 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 10:12:39.388142 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 10:12:39.388142 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 10:12:39.388142 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 10:12:39.388142 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:12:39.388142 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:12:39.388142 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:12:39.388142 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:12:39.388142 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:12:39.388142 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:12:39.388142 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:12:39.388142 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 19 10:12:39.388142 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:12:39.388142 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:12:39.388142 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:12:39.388142 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:12:39.388947 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:12:39.388947 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:12:39.388947 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:12:39.388947 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:12:39.388947 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 10:12:39.388947 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 10:12:39.388947 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 10:12:39.388947 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 10:12:39.388947 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 10:12:39.388947 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 10:12:39.388947 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 10:12:39.388947 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 19 10:12:39.388947 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 35/67] 10.222.0.66 () {56 vars in 1096 bytes} [Mon Sep 19 10:12:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:12:39.389560 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246a5e88-0ee7-4443-821e-8067b32ce91d None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:39.389726 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246a5e88-0ee7-4443-821e-8067b32ce91d None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:39.390488 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246a5e88-0ee7-4443-821e-8067b32ce91d None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:39.395393 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 36/68] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:12:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:12:39.395393 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dbf43c-0096-4f15-a07c-c4e1529fdae8 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:39.395393 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dbf43c-0096-4f15-a07c-c4e1529fdae8 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:39.395393 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dbf43c-0096-4f15-a07c-c4e1529fdae8 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:39.395393 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 37/69] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:12:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:12:39.397001 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dbf43c-0096-4f15-a07c-c4e1529fdae8 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:12:39.401688 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 33/70] 10.222.0.66 () {56 vars in 1101 bytes} [Mon Sep 19 10:12:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:12:39.403213 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc62dbc0-7318-4ec6-9fb6-aa895f3e7201 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:39.403693 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc62dbc0-7318-4ec6-9fb6-aa895f3e7201 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:39.404195 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc62dbc0-7318-4ec6-9fb6-aa895f3e7201 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:39.429437 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-fc62dbc0-7318-4ec6-9fb6-aa895f3e7201 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:12:39.431813 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-fc62dbc0-7318-4ec6-9fb6-aa895f3e7201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:12:39.495698 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:12:39.507195 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dbf43c-0096-4f15-a07c-c4e1529fdae8 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:12:39.510235 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 34/71] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:12:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 10:12:39.511494 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea0bbf9-4bf0-4ddb-a47e-f5fbbed60dc9 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:39.511791 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea0bbf9-4bf0-4ddb-a47e-f5fbbed60dc9 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:39.512070 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea0bbf9-4bf0-4ddb-a47e-f5fbbed60dc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:39.530329 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-9ea0bbf9-4bf0-4ddb-a47e-f5fbbed60dc9 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:12:39.531521 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-9ea0bbf9-4bf0-4ddb-a47e-f5fbbed60dc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:12:39.558446 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9de57b6-5c8e-45fa-90ec-50ac5b882ee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:12:39.560044 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9de57b6-5c8e-45fa-90ec-50ac5b882ee4 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:39.560556 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9de57b6-5c8e-45fa-90ec-50ac5b882ee4 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:39.561317 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9de57b6-5c8e-45fa-90ec-50ac5b882ee4 None admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:39.562271 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9de57b6-5c8e-45fa-90ec-50ac5b882ee4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:12:39.562772 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9de57b6-5c8e-45fa-90ec-50ac5b882ee4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:12:39.564623 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9de57b6-5c8e-45fa-90ec-50ac5b882ee4 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:12:39.577983 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 38/72] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Sep 19 10:12:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:12:39.580421 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9de57b6-5c8e-45fa-90ec-50ac5b882ee4 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:12:39.602219 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:12:39.625094 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 35/73] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:12:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 10:12:39.626212 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea0bbf9-4bf0-4ddb-a47e-f5fbbed60dc9 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:12:39.735535 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9de57b6-5c8e-45fa-90ec-50ac5b882ee4 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:12:39.755055 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea0bbf9-4bf0-4ddb-a47e-f5fbbed60dc9 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:12:39.771177 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6544ffa0-2826-4daf-87ab-67814f41e89d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:12:39.771914 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6544ffa0-2826-4daf-87ab-67814f41e89d None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:39.772475 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6544ffa0-2826-4daf-87ab-67814f41e89d None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:39.772801 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6544ffa0-2826-4daf-87ab-67814f41e89d None admin] PATH_INFO: `/v3/users/7a5ad9296c73487a8b276f2728c73013` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:39.788507 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6544ffa0-2826-4daf-87ab-67814f41e89d None admin] RBAC: Authorizing `identity:get_user(user_id=7a5ad9296c73487a8b276f2728c73013)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:12:39.790101 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6544ffa0-2826-4daf-87ab-67814f41e89d None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:12:39.796787 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 39/74] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Sep 19 10:12:39 2022] GET /identity/v3/users/7a5ad9296c73487a8b276f2728c73013 => generated 275 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:12:39.797293 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0258c7-b249-4de8-8fa2-86c8dc75b500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:12:39.798144 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0258c7-b249-4de8-8fa2-86c8dc75b500 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:39.798248 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9112487c-6c7f-49a3-8fb1-aa37c593d5ce None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:39.798610 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9112487c-6c7f-49a3-8fb1-aa37c593d5ce None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:39.798874 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0258c7-b249-4de8-8fa2-86c8dc75b500 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:39.798984 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9112487c-6c7f-49a3-8fb1-aa37c593d5ce None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:39.799420 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0258c7-b249-4de8-8fa2-86c8dc75b500 None admin] PATH_INFO: `/v3/users/a561b673cfae437daade9297a694cc7c` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:39.800704 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 40/75] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:12:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:12:39.801236 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0258c7-b249-4de8-8fa2-86c8dc75b500 None admin] RBAC: Authorizing `identity:get_user(user_id=a561b673cfae437daade9297a694cc7c)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:12:39.801596 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9112487c-6c7f-49a3-8fb1-aa37c593d5ce None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:12:39.803097 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0258c7-b249-4de8-8fa2-86c8dc75b500 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:12:39.805663 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 36/76] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Sep 19 10:12:39 2022] GET /identity/v3/users/a561b673cfae437daade9297a694cc7c => generated 247 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:12:39.806681 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0258c7-b249-4de8-8fa2-86c8dc75b500 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:12:39.818061 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:12:39.868532 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:12:39.922403 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0258c7-b249-4de8-8fa2-86c8dc75b500 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:12:39.924103 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9112487c-6c7f-49a3-8fb1-aa37c593d5ce None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:12:39.957180 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7e24a2-8c9f-445a-9eff-a9fdc1448f21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:12:39.957789 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7e24a2-8c9f-445a-9eff-a9fdc1448f21 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:39.958069 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7e24a2-8c9f-445a-9eff-a9fdc1448f21 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:39.958347 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7e24a2-8c9f-445a-9eff-a9fdc1448f21 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:39.963391 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58d3ce1-754c-4969-9816-ff4a45bbdf25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:12:39.964022 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58d3ce1-754c-4969-9816-ff4a45bbdf25 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:39.964332 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58d3ce1-754c-4969-9816-ff4a45bbdf25 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:39.964606 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58d3ce1-754c-4969-9816-ff4a45bbdf25 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:39.974528 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58d3ce1-754c-4969-9816-ff4a45bbdf25 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 10:12:39.982156 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-e58d3ce1-754c-4969-9816-ff4a45bbdf25 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 10:12:39.982156 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:12:39.982156 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:12:39.982156 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:12:39.982156 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:12:39.982156 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:12:39.982156 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:12:39.982156 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:12:39.982156 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:12:39.982156 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:12:39.982156 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:12:39.982156 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:12:39.982156 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 10:12:39.982156 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 10:12:39.982156 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 10:12:39.982156 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 10:12:39.983126 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 10:12:39.983126 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 10:12:39.983126 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 10:12:39.983126 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 10:12:39.983126 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:12:39.983126 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:12:39.983126 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:12:39.983126 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:12:39.983126 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:12:39.983126 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:12:39.983126 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:12:39.983126 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 19 10:12:39.983126 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:12:39.983126 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:12:39.983126 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:12:39.983126 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:12:39.983889 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:12:39.983889 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:12:39.983889 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:12:39.983889 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:12:39.983889 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 10:12:39.983889 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 10:12:39.983889 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 10:12:39.983889 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 10:12:39.983889 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 10:12:39.983889 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 10:12:39.983889 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 10:12:39.983889 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 19 10:12:39.983889 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 41/77] 10.222.0.66 () {56 vars in 1114 bytes} [Mon Sep 19 10:12:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:12:39.985500 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833a6d46-a2a4-4d1d-bc8d-7bd726ee55ab None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:39.985925 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833a6d46-a2a4-4d1d-bc8d-7bd726ee55ab None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:39.986332 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833a6d46-a2a4-4d1d-bc8d-7bd726ee55ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:40.008318 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-833a6d46-a2a4-4d1d-bc8d-7bd726ee55ab None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:12:40.009576 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-833a6d46-a2a4-4d1d-bc8d-7bd726ee55ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:12:40.034303 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7e24a2-8c9f-445a-9eff-a9fdc1448f21 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:12:40.035787 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7e24a2-8c9f-445a-9eff-a9fdc1448f21 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:12:40.079728 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 42/78] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:12:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 10:12:40.080617 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833a6d46-a2a4-4d1d-bc8d-7bd726ee55ab None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:12:40.082980 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:12:40.107749 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:12:40.163492 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 37/79] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Sep 19 10:12:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 10:12:40.163492 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7e24a2-8c9f-445a-9eff-a9fdc1448f21 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:12:40.189790 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833a6d46-a2a4-4d1d-bc8d-7bd726ee55ab None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:12:40.228888 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85868946-3adc-4d0d-b733-07b299812c09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:12:40.229513 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85868946-3adc-4d0d-b733-07b299812c09 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:40.229802 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85868946-3adc-4d0d-b733-07b299812c09 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:40.230083 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85868946-3adc-4d0d-b733-07b299812c09 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:40.264302 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7e24a2-8c9f-445a-9eff-a9fdc1448f21 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:12:40.300698 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cd8dc1-d319-47f5-adda-b2863be7ae7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:12:40.301555 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cd8dc1-d319-47f5-adda-b2863be7ae7e None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:40.301699 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85868946-3adc-4d0d-b733-07b299812c09 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:12:40.302103 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cd8dc1-d319-47f5-adda-b2863be7ae7e None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:40.302512 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cd8dc1-d319-47f5-adda-b2863be7ae7e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:40.303106 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85868946-3adc-4d0d-b733-07b299812c09 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:12:40.304463 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cd8dc1-d319-47f5-adda-b2863be7ae7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:12:40.305566 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:12:40.306850 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cd8dc1-d319-47f5-adda-b2863be7ae7e None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:12:40.308590 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 38/80] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 19 10:12:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:12:40.309376 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cd8dc1-d319-47f5-adda-b2863be7ae7e None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:12:40.342297 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:12:40.408196 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 43/81] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Sep 19 10:12:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 10:12:40.409308 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85868946-3adc-4d0d-b733-07b299812c09 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:12:40.419840 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cd8dc1-d319-47f5-adda-b2863be7ae7e None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:12:40.452238 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc92b7ad-46c6-4f88-bca0-4945d5f491d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:12:40.452853 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc92b7ad-46c6-4f88-bca0-4945d5f491d5 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:40.453136 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc92b7ad-46c6-4f88-bca0-4945d5f491d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:40.453415 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc92b7ad-46c6-4f88-bca0-4945d5f491d5 None admin] PATH_INFO: `/v3/roles` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:40.454075 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc92b7ad-46c6-4f88-bca0-4945d5f491d5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:12:40.454381 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc92b7ad-46c6-4f88-bca0-4945d5f491d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:12:40.455788 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc92b7ad-46c6-4f88-bca0-4945d5f491d5 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:12:40.464262 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 39/82] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Sep 19 10:12:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:12:40.464262 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc92b7ad-46c6-4f88-bca0-4945d5f491d5 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:12:40.511255 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85868946-3adc-4d0d-b733-07b299812c09 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:12:40.512788 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:12:40.548849 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f95a7c-fe10-4cd2-96f0-bf7f19298d9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:12:40.549498 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f95a7c-fe10-4cd2-96f0-bf7f19298d9a None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:40.549783 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f95a7c-fe10-4cd2-96f0-bf7f19298d9a None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:40.550065 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f95a7c-fe10-4cd2-96f0-bf7f19298d9a None admin] PATH_INFO: `/v3/projects/5f95307582374302a3632bd00efa5a75` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:40.551217 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f95a7c-fe10-4cd2-96f0-bf7f19298d9a None admin] RBAC: Authorizing `identity:get_project(project_id=5f95307582374302a3632bd00efa5a75)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:12:40.551575 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:12:40.552785 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f95a7c-fe10-4cd2-96f0-bf7f19298d9a None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:12:40.554778 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 44/83] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Sep 19 10:12:40 2022] GET /identity/v3/projects/5f95307582374302a3632bd00efa5a75 => generated 298 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:12:40.555592 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f95a7c-fe10-4cd2-96f0-bf7f19298d9a None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:12:40.567970 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc92b7ad-46c6-4f88-bca0-4945d5f491d5 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:12:40.602563 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad72ec8b-233b-42a6-8193-31e92010e461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:12:40.603245 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad72ec8b-233b-42a6-8193-31e92010e461 None admin] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:40.603533 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad72ec8b-233b-42a6-8193-31e92010e461 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:40.603815 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad72ec8b-233b-42a6-8193-31e92010e461 None admin] PATH_INFO: `/v3/users` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:40.604493 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad72ec8b-233b-42a6-8193-31e92010e461 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:12:40.605967 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad72ec8b-233b-42a6-8193-31e92010e461 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:12:40.627716 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 40/84] 10.222.0.66 () {60 vars in 1132 bytes} [Mon Sep 19 10:12:40 2022] POST /identity/v3/users => generated 289 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:12:40.634241 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad72ec8b-233b-42a6-8193-31e92010e461 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:12:40.663805 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f95a7c-fe10-4cd2-96f0-bf7f19298d9a None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:12:40.711960 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134e76ca-f85b-42f3-acb3-6a8dc2d5e5d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:12:40.712661 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134e76ca-f85b-42f3-acb3-6a8dc2d5e5d9 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:40.712937 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134e76ca-f85b-42f3-acb3-6a8dc2d5e5d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:40.713213 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134e76ca-f85b-42f3-acb3-6a8dc2d5e5d9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:40.724752 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134e76ca-f85b-42f3-acb3-6a8dc2d5e5d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 10:12:40.729801 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-134e76ca-f85b-42f3-acb3-6a8dc2d5e5d9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 19 10:12:40.729801 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:12:40.729801 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:12:40.729801 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:12:40.729801 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:12:40.729801 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:12:40.729801 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:12:40.729801 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:12:40.729801 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:12:40.729801 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:12:40.729801 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:12:40.729801 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:12:40.729801 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 10:12:40.729801 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 10:12:40.729801 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 10:12:40.729801 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 10:12:40.730883 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 10:12:40.730883 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 10:12:40.730883 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 10:12:40.730883 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 10:12:40.730883 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:12:40.730883 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:12:40.730883 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:12:40.730883 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:12:40.730883 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:12:40.730883 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:12:40.730883 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:12:40.730883 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 19 10:12:40.730883 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:12:40.730883 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:12:40.730883 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:12:40.730883 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:12:40.736830 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:12:40.736830 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:12:40.736830 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:12:40.736830 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:12:40.736830 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 10:12:40.736830 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 10:12:40.736830 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 10:12:40.736830 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 10:12:40.736830 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 10:12:40.736830 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 10:12:40.736830 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 19 10:12:40.736830 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 19 10:12:40.736830 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 45/85] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Sep 19 10:12:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:12:40.736830 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134e76ca-f85b-42f3-acb3-6a8dc2d5e5d9 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:12:40.766023 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad72ec8b-233b-42a6-8193-31e92010e461 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:12:40.766537 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:12:40.810618 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e689a53f-36b8-47ce-ab6e-da88910ce799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:12:40.811267 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e689a53f-36b8-47ce-ab6e-da88910ce799 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:40.811544 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e689a53f-36b8-47ce-ab6e-da88910ce799 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:40.811813 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e689a53f-36b8-47ce-ab6e-da88910ce799 None admin] PATH_INFO: `/v3/projects/5f95307582374302a3632bd00efa5a75` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:40.812995 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e689a53f-36b8-47ce-ab6e-da88910ce799 None admin] RBAC: Authorizing `identity:get_project(project_id=5f95307582374302a3632bd00efa5a75)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:12:40.814463 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e689a53f-36b8-47ce-ab6e-da88910ce799 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:12:40.816097 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 41/86] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Sep 19 10:12:40 2022] GET /identity/v3/projects/5f95307582374302a3632bd00efa5a75 => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:12:40.816895 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e689a53f-36b8-47ce-ab6e-da88910ce799 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:12:40.829892 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:12:40.848376 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134e76ca-f85b-42f3-acb3-6a8dc2d5e5d9 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:12:40.888884 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be903e49-03ee-4c28-9f02-217f3121b07b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:12:40.889522 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be903e49-03ee-4c28-9f02-217f3121b07b None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:40.889809 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be903e49-03ee-4c28-9f02-217f3121b07b None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:40.890094 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be903e49-03ee-4c28-9f02-217f3121b07b None admin] PATH_INFO: `/v3/users/7a5ad9296c73487a8b276f2728c73013` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:40.892471 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be903e49-03ee-4c28-9f02-217f3121b07b None admin] RBAC: Authorizing `identity:get_user(user_id=7a5ad9296c73487a8b276f2728c73013)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:12:40.892745 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be903e49-03ee-4c28-9f02-217f3121b07b None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:12:40.894384 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 46/87] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Sep 19 10:12:40 2022] GET /identity/v3/users/7a5ad9296c73487a8b276f2728c73013 => generated 275 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:12:40.895292 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be903e49-03ee-4c28-9f02-217f3121b07b None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:12:40.951186 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e689a53f-36b8-47ce-ab6e-da88910ce799 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:12:40.995847 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be65abd2-0f26-4146-acdf-909231443223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:12:40.996860 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be65abd2-0f26-4146-acdf-909231443223 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:40.997147 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be65abd2-0f26-4146-acdf-909231443223 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:40.997426 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be65abd2-0f26-4146-acdf-909231443223 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:40.998291 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be65abd2-0f26-4146-acdf-909231443223 None admin] RBAC: Adding query filter params (role.id=cd5b42ed3b754b58817a62bbe74651b4, scope.project.id=5f95307582374302a3632bd00efa5a75, user.id=7a5ad9296c73487a8b276f2728c73013) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:12:40.998721 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be65abd2-0f26-4146-acdf-909231443223 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:12:41.000274 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be65abd2-0f26-4146-acdf-909231443223 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:12:41.006915 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 42/88] 10.222.0.66 () {56 vars in 1374 bytes} [Mon Sep 19 10:12:40 2022] GET /identity/v3/role_assignments?user.id=7a5ad9296c73487a8b276f2728c73013&scope.project.id=5f95307582374302a3632bd00efa5a75&role.id=cd5b42ed3b754b58817a62bbe74651b4 => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:12:41.007750 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be65abd2-0f26-4146-acdf-909231443223 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:12:41.020003 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be903e49-03ee-4c28-9f02-217f3121b07b None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:12:41.040459 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:12:41.080664 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5b56c7-3f76-486d-bd61-b8494b8d5fbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:12:41.081296 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5b56c7-3f76-486d-bd61-b8494b8d5fbd None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:41.081575 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5b56c7-3f76-486d-bd61-b8494b8d5fbd None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:41.082728 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5b56c7-3f76-486d-bd61-b8494b8d5fbd None admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:41.083441 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5b56c7-3f76-486d-bd61-b8494b8d5fbd None admin] RBAC: Adding query filter params (name=member) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:12:41.083749 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5b56c7-3f76-486d-bd61-b8494b8d5fbd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:12:41.085252 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5b56c7-3f76-486d-bd61-b8494b8d5fbd None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:12:41.105031 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 47/89] 10.222.0.66 () {56 vars in 1101 bytes} [Mon Sep 19 10:12:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:12:41.105929 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5b56c7-3f76-486d-bd61-b8494b8d5fbd None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:12:41.140706 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:12:41.170360 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be65abd2-0f26-4146-acdf-909231443223 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:12:41.210390 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101925f2-e9ae-4932-9dae-34c8ce27a3f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:12:41.210933 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101925f2-e9ae-4932-9dae-34c8ce27a3f7 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:41.211215 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101925f2-e9ae-4932-9dae-34c8ce27a3f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:41.211491 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101925f2-e9ae-4932-9dae-34c8ce27a3f7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:41.212298 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101925f2-e9ae-4932-9dae-34c8ce27a3f7 None admin] RBAC: Adding query filter params (role.id=5c8b89fae4fa45bd944cbeaf442136e1, scope.project.id=5f95307582374302a3632bd00efa5a75, user.id=a561b673cfae437daade9297a694cc7c) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:12:41.212582 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101925f2-e9ae-4932-9dae-34c8ce27a3f7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:12:41.214126 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101925f2-e9ae-4932-9dae-34c8ce27a3f7 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:12:41.220458 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 43/90] 10.222.0.66 () {56 vars in 1374 bytes} [Mon Sep 19 10:12:41 2022] GET /identity/v3/role_assignments?user.id=a561b673cfae437daade9297a694cc7c&scope.project.id=5f95307582374302a3632bd00efa5a75&role.id=5c8b89fae4fa45bd944cbeaf442136e1 => generated 259 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:12:41.221289 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101925f2-e9ae-4932-9dae-34c8ce27a3f7 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:12:41.233022 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5b56c7-3f76-486d-bd61-b8494b8d5fbd None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:12:41.281526 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f99185f-2528-4787-a016-7474508ae941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:12:41.282170 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f99185f-2528-4787-a016-7474508ae941 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:41.282456 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f99185f-2528-4787-a016-7474508ae941 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:41.282732 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f99185f-2528-4787-a016-7474508ae941 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:41.335436 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:12:41.392207 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f99185f-2528-4787-a016-7474508ae941 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:12:41.394827 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f99185f-2528-4787-a016-7474508ae941 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:12:41.447810 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101925f2-e9ae-4932-9dae-34c8ce27a3f7 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:12:41.516682 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 48/91] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Sep 19 10:12:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 10:12:41.521916 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f99538-ddea-4030-8110-4c3ac95d34e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:12:41.522651 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f99538-ddea-4030-8110-4c3ac95d34e3 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:41.522925 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f99538-ddea-4030-8110-4c3ac95d34e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:41.523209 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f99538-ddea-4030-8110-4c3ac95d34e3 None admin] PATH_INFO: `/v3/users/7a5ad9296c73487a8b276f2728c73013` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:41.524426 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f99538-ddea-4030-8110-4c3ac95d34e3 None admin] RBAC: Authorizing `identity:get_user(user_id=7a5ad9296c73487a8b276f2728c73013)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:12:41.525210 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f99185f-2528-4787-a016-7474508ae941 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:12:41.525904 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f99538-ddea-4030-8110-4c3ac95d34e3 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:12:41.527527 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 44/92] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Sep 19 10:12:41 2022] GET /identity/v3/users/7a5ad9296c73487a8b276f2728c73013 => generated 275 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:12:41.533099 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f99538-ddea-4030-8110-4c3ac95d34e3 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:12:41.549388 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:12:41.589885 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:12:41.635151 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f99185f-2528-4787-a016-7474508ae941 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:12:41.686759 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068cfbe1-5ef8-49c6-89e8-44552daafd21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:12:41.688015 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068cfbe1-5ef8-49c6-89e8-44552daafd21 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:41.688115 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068cfbe1-5ef8-49c6-89e8-44552daafd21 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:41.688552 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068cfbe1-5ef8-49c6-89e8-44552daafd21 None admin] PATH_INFO: `/v3/projects/5f95307582374302a3632bd00efa5a75` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:41.697536 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068cfbe1-5ef8-49c6-89e8-44552daafd21 None admin] RBAC: Authorizing `identity:get_project(project_id=5f95307582374302a3632bd00efa5a75)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:12:41.699316 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068cfbe1-5ef8-49c6-89e8-44552daafd21 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:12:41.701319 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 49/93] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Sep 19 10:12:41 2022] GET /identity/v3/projects/5f95307582374302a3632bd00efa5a75 => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:12:41.713290 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068cfbe1-5ef8-49c6-89e8-44552daafd21 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:12:41.758756 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f99538-ddea-4030-8110-4c3ac95d34e3 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:12:41.830971 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208ac2d5-ec91-42b2-b4b1-31225ed1f58f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:12:41.832275 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208ac2d5-ec91-42b2-b4b1-31225ed1f58f None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:41.832813 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208ac2d5-ec91-42b2-b4b1-31225ed1f58f None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:41.833334 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208ac2d5-ec91-42b2-b4b1-31225ed1f58f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:41.887160 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068cfbe1-5ef8-49c6-89e8-44552daafd21 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:12:41.918950 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:12:41.937194 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af75f306-b85f-431f-a5a6-296651e6b57b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:12:41.937966 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af75f306-b85f-431f-a5a6-296651e6b57b None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:41.938982 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af75f306-b85f-431f-a5a6-296651e6b57b None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:41.940224 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af75f306-b85f-431f-a5a6-296651e6b57b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:41.941063 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af75f306-b85f-431f-a5a6-296651e6b57b None admin] RBAC: Adding query filter params (role.id=43fe0942f9c9486ca3e7c83be55eb915, scope.project.id=5f95307582374302a3632bd00efa5a75, user.id=7a5ad9296c73487a8b276f2728c73013) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:12:41.942123 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af75f306-b85f-431f-a5a6-296651e6b57b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:12:41.949441 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af75f306-b85f-431f-a5a6-296651e6b57b None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:12:41.958192 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 50/94] 10.222.0.66 () {56 vars in 1374 bytes} [Mon Sep 19 10:12:41 2022] GET /identity/v3/role_assignments?user.id=7a5ad9296c73487a8b276f2728c73013&scope.project.id=5f95307582374302a3632bd00efa5a75&role.id=43fe0942f9c9486ca3e7c83be55eb915 => generated 259 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:12:41.982357 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208ac2d5-ec91-42b2-b4b1-31225ed1f58f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:12:41.984014 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208ac2d5-ec91-42b2-b4b1-31225ed1f58f None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:12:41.993087 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:12:42.140129 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 45/95] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Sep 19 10:12:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 607 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 10:12:42.145887 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af75f306-b85f-431f-a5a6-296651e6b57b None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:12:42.296856 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af75f306-b85f-431f-a5a6-296651e6b57b None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:12:42.344055 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88eee811-c513-4f09-af45-9d434e872291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:12:42.344791 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eee811-c513-4f09-af45-9d434e872291 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:42.345077 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eee811-c513-4f09-af45-9d434e872291 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:42.345347 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eee811-c513-4f09-af45-9d434e872291 None admin] PATH_INFO: `/v3/projects/8cb958a55d4b43ebb23e163e94c3891b` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:42.346654 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88eee811-c513-4f09-af45-9d434e872291 None admin] RBAC: Authorizing `identity:get_project(project_id=8cb958a55d4b43ebb23e163e94c3891b)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:12:42.348176 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88eee811-c513-4f09-af45-9d434e872291 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:12:42.350838 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 51/96] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Sep 19 10:12:42 2022] GET /identity/v3/projects/8cb958a55d4b43ebb23e163e94c3891b => generated 312 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:12:42.356632 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208ac2d5-ec91-42b2-b4b1-31225ed1f58f None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:12:42.506537 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208ac2d5-ec91-42b2-b4b1-31225ed1f58f None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:12:42.520434 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:12:42.567865 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5352d08-76b0-422d-84f5-ac22559a3431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:12:42.569157 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5352d08-76b0-422d-84f5-ac22559a3431 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:42.569610 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5352d08-76b0-422d-84f5-ac22559a3431 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:42.570095 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5352d08-76b0-422d-84f5-ac22559a3431 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:42.571498 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5352d08-76b0-422d-84f5-ac22559a3431 None admin] RBAC: Adding query filter params (role.id=cd5b42ed3b754b58817a62bbe74651b4, scope.project.id=8cb958a55d4b43ebb23e163e94c3891b, user.id=7a5ad9296c73487a8b276f2728c73013) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:12:42.572041 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5352d08-76b0-422d-84f5-ac22559a3431 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:12:42.574749 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5352d08-76b0-422d-84f5-ac22559a3431 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:12:42.585732 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 46/97] 10.222.0.66 () {56 vars in 1374 bytes} [Mon Sep 19 10:12:42 2022] GET /identity/v3/role_assignments?user.id=7a5ad9296c73487a8b276f2728c73013&scope.project.id=8cb958a55d4b43ebb23e163e94c3891b&role.id=cd5b42ed3b754b58817a62bbe74651b4 => generated 259 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:12:43.850807 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f43fd8-9f3f-4179-8ca9-66fb1bc8506d None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:43.851338 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f43fd8-9f3f-4179-8ca9-66fb1bc8506d None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:43.851413 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f43fd8-9f3f-4179-8ca9-66fb1bc8506d None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:43.852747 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 52/98] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:12:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:12:43.858305 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f08a1d-d03e-4453-a9e5-773148abd163 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:43.858845 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f08a1d-d03e-4453-a9e5-773148abd163 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:43.859029 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f08a1d-d03e-4453-a9e5-773148abd163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:43.884540 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccc2646-b0b6-40b8-8df8-d28695d200cb None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:43.884838 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccc2646-b0b6-40b8-8df8-d28695d200cb None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:43.885100 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccc2646-b0b6-40b8-8df8-d28695d200cb None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:43.886447 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 53/99] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:12:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 10:12:43.900302 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-21f08a1d-d03e-4453-a9e5-773148abd163 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:12:43.901526 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-21f08a1d-d03e-4453-a9e5-773148abd163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:12:43.918650 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582343c5-1343-4e16-9c8d-6803ff394d81 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:43.918948 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582343c5-1343-4e16-9c8d-6803ff394d81 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:43.919217 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582343c5-1343-4e16-9c8d-6803ff394d81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:43.958102 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-582343c5-1343-4e16-9c8d-6803ff394d81 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:12:43.959260 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-582343c5-1343-4e16-9c8d-6803ff394d81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:12:44.059311 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 47/100] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:12:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 10:12:44.076567 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:12:44.092754 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 54/101] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:12:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 10:12:44.310217 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f88e94-6b4a-4cbb-a011-ecbb3dac1fca None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:44.310587 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f88e94-6b4a-4cbb-a011-ecbb3dac1fca None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:44.310781 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f88e94-6b4a-4cbb-a011-ecbb3dac1fca None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:44.312155 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 48/102] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:12:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:12:44.321815 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085c8052-33f7-4805-83a4-cb01c08147b7 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:44.322220 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085c8052-33f7-4805-83a4-cb01c08147b7 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:44.322509 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085c8052-33f7-4805-83a4-cb01c08147b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:44.347465 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-085c8052-33f7-4805-83a4-cb01c08147b7 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:12:44.348719 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-085c8052-33f7-4805-83a4-cb01c08147b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:12:44.426375 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 55/103] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:12:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 10:12:44.629472 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f88e94-6b4a-4cbb-a011-ecbb3dac1fca None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:12:44.641936 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085c8052-33f7-4805-83a4-cb01c08147b7 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:12:44.795983 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:12:44.802702 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f88e94-6b4a-4cbb-a011-ecbb3dac1fca None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:12:44.816501 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085c8052-33f7-4805-83a4-cb01c08147b7 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:12:44.839275 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:12:44.855257 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f016c917-5f98-4608-b5cf-36df3fa2a60e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:12:44.855897 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f016c917-5f98-4608-b5cf-36df3fa2a60e None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:44.856205 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f016c917-5f98-4608-b5cf-36df3fa2a60e None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:44.856703 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f016c917-5f98-4608-b5cf-36df3fa2a60e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:44.864254 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4857e3d-d8cb-42e8-b26f-3d70c159789d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:12:44.865491 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4857e3d-d8cb-42e8-b26f-3d70c159789d None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:44.866577 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4857e3d-d8cb-42e8-b26f-3d70c159789d None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:44.867066 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4857e3d-d8cb-42e8-b26f-3d70c159789d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:44.868440 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4857e3d-d8cb-42e8-b26f-3d70c159789d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:12:44.869013 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f016c917-5f98-4608-b5cf-36df3fa2a60e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 10:12:44.870316 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4857e3d-d8cb-42e8-b26f-3d70c159789d None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:12:44.872111 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 49/104] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 19 10:12:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:12:44.873091 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4857e3d-d8cb-42e8-b26f-3d70c159789d None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:12:44.877937 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-f016c917-5f98-4608-b5cf-36df3fa2a60e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 19 10:12:44.877937 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:12:44.877937 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:12:44.877937 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:12:44.877937 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:12:44.877937 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:12:44.877937 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:12:44.877937 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:12:44.877937 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:12:44.877937 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:12:44.877937 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:12:44.877937 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:12:44.877937 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 10:12:44.877937 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 10:12:44.877937 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 10:12:44.877937 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 10:12:44.879844 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 10:12:44.879844 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 10:12:44.879844 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 10:12:44.879844 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 10:12:44.879844 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:12:44.879844 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:12:44.879844 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:12:44.879844 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:12:44.879844 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:12:44.879844 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:12:44.879844 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:12:44.879844 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 19 10:12:44.879844 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:12:44.879844 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:12:44.879844 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:12:44.879844 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:12:44.881014 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:12:44.881014 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:12:44.881014 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:12:44.881014 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:12:44.881014 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 10:12:44.881014 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 10:12:44.881014 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 10:12:44.881014 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 10:12:44.881014 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 10:12:44.881014 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 10:12:44.881014 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 19 10:12:44.881014 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 19 10:12:44.881014 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 56/105] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Sep 19 10:12:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:12:44.885700 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f016c917-5f98-4608-b5cf-36df3fa2a60e None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:12:45.015927 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f016c917-5f98-4608-b5cf-36df3fa2a60e None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:12:45.051453 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9668bc6e-c0f8-4a40-8297-20a937a2e4fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:12:45.052368 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9668bc6e-c0f8-4a40-8297-20a937a2e4fa None admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:45.052659 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9668bc6e-c0f8-4a40-8297-20a937a2e4fa None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:45.052940 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9668bc6e-c0f8-4a40-8297-20a937a2e4fa None admin] PATH_INFO: `/v3/projects` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:45.053627 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9668bc6e-c0f8-4a40-8297-20a937a2e4fa None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:12:45.053744 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4857e3d-d8cb-42e8-b26f-3d70c159789d None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:12:45.055202 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9668bc6e-c0f8-4a40-8297-20a937a2e4fa None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:12:45.088689 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 57/106] 10.222.0.66 () {60 vars in 1141 bytes} [Mon Sep 19 10:12:44 2022] POST /identity/v3/projects => generated 302 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:12:45.089686 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9668bc6e-c0f8-4a40-8297-20a937a2e4fa None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:12:45.091097 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180765c5-1e94-43c6-8f8c-5653d62fb33e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:12:45.092016 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180765c5-1e94-43c6-8f8c-5653d62fb33e None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:45.092555 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180765c5-1e94-43c6-8f8c-5653d62fb33e None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:45.093048 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180765c5-1e94-43c6-8f8c-5653d62fb33e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:45.107265 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180765c5-1e94-43c6-8f8c-5653d62fb33e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 10:12:45.113284 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-180765c5-1e94-43c6-8f8c-5653d62fb33e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 19 10:12:45.113284 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:12:45.113284 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:12:45.113284 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:12:45.113284 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:12:45.113284 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:12:45.113284 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:12:45.113284 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:12:45.113284 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:12:45.113284 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:12:45.113284 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:12:45.113284 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:12:45.113284 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 10:12:45.113284 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 10:12:45.113284 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 10:12:45.113284 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 10:12:45.114216 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 10:12:45.114216 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 10:12:45.114216 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 10:12:45.114216 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 10:12:45.114216 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:12:45.114216 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:12:45.114216 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:12:45.114216 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:12:45.114216 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:12:45.114216 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:12:45.114216 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:12:45.114216 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Sep 19 10:12:45.114216 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:12:45.114216 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:12:45.114216 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:12:45.114216 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:12:45.114957 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:12:45.114957 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:12:45.114957 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:12:45.114957 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:12:45.114957 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 10:12:45.114957 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 10:12:45.114957 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 10:12:45.114957 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 10:12:45.114957 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 10:12:45.114957 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 10:12:45.114957 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 19 10:12:45.114957 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Sep 19 10:12:45.117997 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 50/107] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Sep 19 10:12:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:12:45.120700 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4bc1a4-db5e-4ffa-bbee-351754fe3f4c None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:45.121263 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4bc1a4-db5e-4ffa-bbee-351754fe3f4c None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:45.125809 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4bc1a4-db5e-4ffa-bbee-351754fe3f4c None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:45.127606 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 51/108] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:12:45 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:12:45.128670 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:12:45.130216 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4bc1a4-db5e-4ffa-bbee-351754fe3f4c None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:12:45.203712 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:12:45.219649 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9668bc6e-c0f8-4a40-8297-20a937a2e4fa None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:12:45.261594 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a7d166-fbf3-4262-b82c-3a0d910160a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:12:45.262598 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a7d166-fbf3-4262-b82c-3a0d910160a7 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:45.263171 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a7d166-fbf3-4262-b82c-3a0d910160a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:45.263655 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a7d166-fbf3-4262-b82c-3a0d910160a7 None admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:45.264665 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a7d166-fbf3-4262-b82c-3a0d910160a7 None admin] RBAC: Adding query filter params (name=member) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:12:45.265194 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a7d166-fbf3-4262-b82c-3a0d910160a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:12:45.266953 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a7d166-fbf3-4262-b82c-3a0d910160a7 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:12:45.279152 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 58/109] 10.222.0.66 () {56 vars in 1101 bytes} [Mon Sep 19 10:12:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:12:45.280885 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea1f244-b01d-4a98-8b53-41a1a84112b1 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:45.281398 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea1f244-b01d-4a98-8b53-41a1a84112b1 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:45.282080 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea1f244-b01d-4a98-8b53-41a1a84112b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:45.306352 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-dea1f244-b01d-4a98-8b53-41a1a84112b1 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:12:45.307902 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-dea1f244-b01d-4a98-8b53-41a1a84112b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:12:45.350656 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4bc1a4-db5e-4ffa-bbee-351754fe3f4c None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:12:45.394162 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cda2e8c-8378-4b8f-a155-d1e1bad1a5ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:12:45.394708 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cda2e8c-8378-4b8f-a155-d1e1bad1a5ed None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:45.394995 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cda2e8c-8378-4b8f-a155-d1e1bad1a5ed None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:45.395266 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cda2e8c-8378-4b8f-a155-d1e1bad1a5ed None admin] PATH_INFO: `/v3/roles` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:45.396339 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cda2e8c-8378-4b8f-a155-d1e1bad1a5ed None admin] RBAC: Adding query filter params (name=reader) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:12:45.396339 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cda2e8c-8378-4b8f-a155-d1e1bad1a5ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:12:45.398549 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cda2e8c-8378-4b8f-a155-d1e1bad1a5ed None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:12:45.410266 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 59/111] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:12:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 10:12:45.411483 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea1f244-b01d-4a98-8b53-41a1a84112b1 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:12:45.413460 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 52/111] 10.222.0.66 () {56 vars in 1101 bytes} [Mon Sep 19 10:12:45 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:12:45.414860 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2859e043-8b1c-471f-8b28-c6ffb7817d5d None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:45.415250 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2859e043-8b1c-471f-8b28-c6ffb7817d5d None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:45.415582 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2859e043-8b1c-471f-8b28-c6ffb7817d5d None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:45.421162 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 53/112] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:12:45 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:12:45.422082 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2859e043-8b1c-471f-8b28-c6ffb7817d5d None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:12:45.445859 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:12:45.552319 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:12:45.557259 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea1f244-b01d-4a98-8b53-41a1a84112b1 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:12:45.566573 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2859e043-8b1c-471f-8b28-c6ffb7817d5d None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:12:45.599003 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ab6ce8-aa60-4f1d-b7e3-e23f14ec83b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:12:45.599663 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ab6ce8-aa60-4f1d-b7e3-e23f14ec83b9 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:45.599946 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ab6ce8-aa60-4f1d-b7e3-e23f14ec83b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:45.600760 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ab6ce8-aa60-4f1d-b7e3-e23f14ec83b9 None admin] PATH_INFO: `/v3/users/7a5ad9296c73487a8b276f2728c73013` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:45.604847 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ab6ce8-aa60-4f1d-b7e3-e23f14ec83b9 None admin] RBAC: Authorizing `identity:get_user(user_id=7a5ad9296c73487a8b276f2728c73013)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:12:45.606319 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ab6ce8-aa60-4f1d-b7e3-e23f14ec83b9 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:12:45.607934 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 60/113] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Sep 19 10:12:45 2022] GET /identity/v3/users/7a5ad9296c73487a8b276f2728c73013 => generated 275 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:12:45.608253 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a05dd85-e6c1-4731-bcfd-d7b964a6f715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:12:45.609184 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a05dd85-e6c1-4731-bcfd-d7b964a6f715 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:45.609667 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a05dd85-e6c1-4731-bcfd-d7b964a6f715 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:45.610170 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a05dd85-e6c1-4731-bcfd-d7b964a6f715 None admin] PATH_INFO: `/v3/users/ce838fe092b3400b9e04f51d6a47b7a1` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:45.612542 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5ef419-a17a-4056-a24e-1e5279db17b1 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:45.612855 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5ef419-a17a-4056-a24e-1e5279db17b1 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:45.613238 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5ef419-a17a-4056-a24e-1e5279db17b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:45.627912 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a05dd85-e6c1-4731-bcfd-d7b964a6f715 None admin] RBAC: Authorizing `identity:get_user(user_id=ce838fe092b3400b9e04f51d6a47b7a1)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:12:45.629855 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a05dd85-e6c1-4731-bcfd-d7b964a6f715 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:12:45.632118 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 54/114] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Sep 19 10:12:45 2022] GET /identity/v3/users/ce838fe092b3400b9e04f51d6a47b7a1 => generated 289 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:12:45.633160 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a05dd85-e6c1-4731-bcfd-d7b964a6f715 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:12:45.649272 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-9e5ef419-a17a-4056-a24e-1e5279db17b1 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:12:45.650412 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-9e5ef419-a17a-4056-a24e-1e5279db17b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:12:45.758625 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 61/115] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:12:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 10:12:45.759399 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5ef419-a17a-4056-a24e-1e5279db17b1 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:12:45.780609 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a05dd85-e6c1-4731-bcfd-d7b964a6f715 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:12:45.812637 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:12:45.854823 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7b90e9-1394-42ed-8841-ff96defe9e25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:12:45.855913 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7b90e9-1394-42ed-8841-ff96defe9e25 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:45.856446 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7b90e9-1394-42ed-8841-ff96defe9e25 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:45.857119 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7b90e9-1394-42ed-8841-ff96defe9e25 None admin] PATH_INFO: `/v3/projects/5f95307582374302a3632bd00efa5a75` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:45.858474 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7b90e9-1394-42ed-8841-ff96defe9e25 None admin] RBAC: Authorizing `identity:get_project(project_id=5f95307582374302a3632bd00efa5a75)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:12:45.860181 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7b90e9-1394-42ed-8841-ff96defe9e25 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:12:45.862185 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 55/116] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Sep 19 10:12:45 2022] GET /identity/v3/projects/5f95307582374302a3632bd00efa5a75 => generated 298 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:12:45.863561 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9e6cd9-c154-42ea-9ef6-9ca674b2a6c3 None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:45.863957 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9e6cd9-c154-42ea-9ef6-9ca674b2a6c3 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:45.864303 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9e6cd9-c154-42ea-9ef6-9ca674b2a6c3 None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:45.868187 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 56/117] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:12:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:12:45.872183 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c144f5-5cc6-45ec-a995-4fc59b48716b None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:45.872542 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c144f5-5cc6-45ec-a995-4fc59b48716b None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:45.872835 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c144f5-5cc6-45ec-a995-4fc59b48716b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:45.905353 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-83c144f5-5cc6-45ec-a995-4fc59b48716b None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:12:45.906479 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-83c144f5-5cc6-45ec-a995-4fc59b48716b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:12:45.921102 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:12:45.946146 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5ef419-a17a-4056-a24e-1e5279db17b1 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:12:45.984885 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c667bdd1-5bbd-4708-bac0-efe5f94e931f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:12:45.985611 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c667bdd1-5bbd-4708-bac0-efe5f94e931f None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:45.985895 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c667bdd1-5bbd-4708-bac0-efe5f94e931f None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:45.986169 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c667bdd1-5bbd-4708-bac0-efe5f94e931f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:45.995296 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 57/118] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:12:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 10:12:45.996523 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c144f5-5cc6-45ec-a995-4fc59b48716b None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:12:46.086298 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c667bdd1-5bbd-4708-bac0-efe5f94e931f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:12:46.088021 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c667bdd1-5bbd-4708-bac0-efe5f94e931f None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:12:46.126885 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:12:46.157452 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c144f5-5cc6-45ec-a995-4fc59b48716b None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:12:46.193128 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1f52a7-06ee-4f55-b877-02722c4a857a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:12:46.194303 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1f52a7-06ee-4f55-b877-02722c4a857a None admin] REQUEST_METHOD: `PUT` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:46.194588 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1f52a7-06ee-4f55-b877-02722c4a857a None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:46.194868 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1f52a7-06ee-4f55-b877-02722c4a857a None admin] PATH_INFO: `/v3/projects/5f95307582374302a3632bd00efa5a75/users/7a5ad9296c73487a8b276f2728c73013/roles/cd5b42ed3b754b58817a62bbe74651b4` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:46.197590 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1f52a7-06ee-4f55-b877-02722c4a857a None admin] RBAC: Authorizing `identity:create_grant(project_id=5f95307582374302a3632bd00efa5a75, user_id=7a5ad9296c73487a8b276f2728c73013, role_id=cd5b42ed3b754b58817a62bbe74651b4)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:12:46.198290 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1f52a7-06ee-4f55-b877-02722c4a857a None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:12:46.215841 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 58/119] 10.222.0.66 () {58 vars in 1439 bytes} [Mon Sep 19 10:12:45 2022] PUT /identity/v3/projects/5f95307582374302a3632bd00efa5a75/users/7a5ad9296c73487a8b276f2728c73013/roles/cd5b42ed3b754b58817a62bbe74651b4 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:12:46.216940 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1f52a7-06ee-4f55-b877-02722c4a857a None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:12:46.227926 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:12:46.234711 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 62/120] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Sep 19 10:12:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 10:12:46.235947 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c667bdd1-5bbd-4708-bac0-efe5f94e931f None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:12:46.347205 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1f52a7-06ee-4f55-b877-02722c4a857a None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:12:46.365277 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c667bdd1-5bbd-4708-bac0-efe5f94e931f None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:12:46.389191 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640882b7-a6ad-4f3c-8df1-06834ca2a0d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:12:46.389845 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640882b7-a6ad-4f3c-8df1-06834ca2a0d5 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:46.390124 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640882b7-a6ad-4f3c-8df1-06834ca2a0d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:46.390395 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640882b7-a6ad-4f3c-8df1-06834ca2a0d5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:46.399837 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:12:46.404943 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640882b7-a6ad-4f3c-8df1-06834ca2a0d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 10:12:46.412098 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-640882b7-a6ad-4f3c-8df1-06834ca2a0d5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 10:12:46.412098 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:12:46.412098 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:12:46.412098 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:12:46.412098 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:12:46.412098 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:12:46.412098 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:12:46.412098 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:12:46.412098 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:12:46.412098 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:12:46.412098 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:12:46.412098 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:12:46.412098 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 10:12:46.412098 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 10:12:46.412098 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 10:12:46.412098 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 10:12:46.413048 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 10:12:46.413048 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 10:12:46.413048 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 10:12:46.413048 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 10:12:46.413048 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:12:46.413048 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:12:46.413048 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:12:46.413048 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:12:46.413048 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:12:46.413048 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:12:46.413048 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:12:46.413048 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Sep 19 10:12:46.413048 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:12:46.413048 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:12:46.413048 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:12:46.413048 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:12:46.414275 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:12:46.414275 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:12:46.414275 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:12:46.414275 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:12:46.414275 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 10:12:46.414275 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 10:12:46.414275 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 10:12:46.414275 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 10:12:46.414275 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 10:12:46.414275 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 10:12:46.414275 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 10:12:46.414275 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Sep 19 10:12:46.418685 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 59/121] 10.222.0.66 () {56 vars in 1114 bytes} [Mon Sep 19 10:12:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:12:46.419436 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1aa55b-16d1-46dc-9287-4f19c61b5821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:12:46.419677 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640882b7-a6ad-4f3c-8df1-06834ca2a0d5 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:12:46.420564 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1aa55b-16d1-46dc-9287-4f19c61b5821 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:46.421075 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1aa55b-16d1-46dc-9287-4f19c61b5821 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:46.421549 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1aa55b-16d1-46dc-9287-4f19c61b5821 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:46.437943 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1aa55b-16d1-46dc-9287-4f19c61b5821 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 10:12:46.444830 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-3c1aa55b-16d1-46dc-9287-4f19c61b5821 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 10:12:46.444830 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:12:46.444830 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:12:46.444830 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:12:46.444830 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:12:46.444830 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:12:46.444830 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:12:46.444830 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:12:46.444830 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:12:46.444830 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:12:46.444830 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:12:46.444830 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:12:46.444830 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 10:12:46.444830 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 10:12:46.444830 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 10:12:46.444830 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 10:12:46.445710 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 10:12:46.445710 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 10:12:46.445710 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 10:12:46.445710 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 10:12:46.445710 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:12:46.445710 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:12:46.445710 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:12:46.445710 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:12:46.445710 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:12:46.445710 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:12:46.445710 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:12:46.445710 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 19 10:12:46.445710 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:12:46.445710 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:12:46.445710 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:12:46.445710 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:12:46.446465 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:12:46.446465 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:12:46.446465 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:12:46.446465 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:12:46.446465 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 10:12:46.446465 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 10:12:46.446465 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 10:12:46.446465 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 10:12:46.446465 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 10:12:46.446465 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 10:12:46.446465 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 10:12:46.446465 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 19 10:12:46.449151 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 63/122] 10.222.0.66 () {56 vars in 1096 bytes} [Mon Sep 19 10:12:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:12:46.455216 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1aa55b-16d1-46dc-9287-4f19c61b5821 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:12:46.516859 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:12:46.557395 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640882b7-a6ad-4f3c-8df1-06834ca2a0d5 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:12:46.574857 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1aa55b-16d1-46dc-9287-4f19c61b5821 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:12:46.594217 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbd59e9-7954-48b3-b61a-f0569b9f6aae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:12:46.595096 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbd59e9-7954-48b3-b61a-f0569b9f6aae None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:46.595470 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbd59e9-7954-48b3-b61a-f0569b9f6aae None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:46.595839 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbd59e9-7954-48b3-b61a-f0569b9f6aae None admin] PATH_INFO: `/v3/projects/5f95307582374302a3632bd00efa5a75` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:46.597125 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbd59e9-7954-48b3-b61a-f0569b9f6aae None admin] RBAC: Authorizing `identity:get_project(project_id=5f95307582374302a3632bd00efa5a75)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:12:46.598928 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbd59e9-7954-48b3-b61a-f0569b9f6aae None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:12:46.600818 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 60/123] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Sep 19 10:12:46 2022] GET /identity/v3/projects/5f95307582374302a3632bd00efa5a75 => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:12:46.601778 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbd59e9-7954-48b3-b61a-f0569b9f6aae None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:12:46.614096 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be66f5d6-0b4a-48f3-a0c1-0f8665f57115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:12:46.615014 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be66f5d6-0b4a-48f3-a0c1-0f8665f57115 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:46.615463 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be66f5d6-0b4a-48f3-a0c1-0f8665f57115 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:46.616540 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be66f5d6-0b4a-48f3-a0c1-0f8665f57115 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:46.628388 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be66f5d6-0b4a-48f3-a0c1-0f8665f57115 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 10:12:46.635054 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-be66f5d6-0b4a-48f3-a0c1-0f8665f57115 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 19 10:12:46.635054 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:12:46.635054 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:12:46.635054 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:12:46.635054 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:12:46.635054 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:12:46.635054 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:12:46.635054 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:12:46.635054 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:12:46.635054 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:12:46.635054 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:12:46.635054 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:12:46.635054 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 10:12:46.635054 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 10:12:46.635054 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 10:12:46.635054 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 10:12:46.635928 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 10:12:46.635928 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 10:12:46.635928 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 10:12:46.635928 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 10:12:46.635928 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:12:46.635928 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:12:46.635928 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:12:46.635928 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:12:46.635928 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:12:46.635928 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:12:46.635928 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:12:46.635928 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 19 10:12:46.635928 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:12:46.635928 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:12:46.635928 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:12:46.635928 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:12:46.636780 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:12:46.636780 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:12:46.636780 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:12:46.636780 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:12:46.636780 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 10:12:46.636780 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 10:12:46.636780 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 10:12:46.636780 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 10:12:46.636780 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 10:12:46.636780 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 10:12:46.636780 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 19 10:12:46.636780 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 19 10:12:46.638858 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 64/124] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Sep 19 10:12:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:12:46.639932 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be66f5d6-0b4a-48f3-a0c1-0f8665f57115 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:12:46.699454 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:12:46.720120 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbd59e9-7954-48b3-b61a-f0569b9f6aae None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:12:46.758307 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bbf5f9-8d34-43a0-b8f8-c31cca30d195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:12:46.759433 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bbf5f9-8d34-43a0-b8f8-c31cca30d195 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:46.759797 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bbf5f9-8d34-43a0-b8f8-c31cca30d195 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:46.760143 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bbf5f9-8d34-43a0-b8f8-c31cca30d195 None admin] PATH_INFO: `/v3/roles` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:46.761183 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bbf5f9-8d34-43a0-b8f8-c31cca30d195 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:12:46.761559 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bbf5f9-8d34-43a0-b8f8-c31cca30d195 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:12:46.763090 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be66f5d6-0b4a-48f3-a0c1-0f8665f57115 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:12:46.763207 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bbf5f9-8d34-43a0-b8f8-c31cca30d195 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:12:46.764743 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:12:46.776264 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 61/125] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Sep 19 10:12:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:12:46.781000 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bbf5f9-8d34-43a0-b8f8-c31cca30d195 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:12:46.813002 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfce682-7a3c-4a59-a2ea-bf5bae2fa0d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:12:46.814030 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfce682-7a3c-4a59-a2ea-bf5bae2fa0d2 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:46.814646 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfce682-7a3c-4a59-a2ea-bf5bae2fa0d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:46.815126 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfce682-7a3c-4a59-a2ea-bf5bae2fa0d2 None admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:46.815969 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfce682-7a3c-4a59-a2ea-bf5bae2fa0d2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:12:46.816476 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfce682-7a3c-4a59-a2ea-bf5bae2fa0d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:12:46.818633 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfce682-7a3c-4a59-a2ea-bf5bae2fa0d2 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:12:46.830054 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 65/126] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Sep 19 10:12:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:12:46.831382 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfce682-7a3c-4a59-a2ea-bf5bae2fa0d2 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:12:46.923414 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bbf5f9-8d34-43a0-b8f8-c31cca30d195 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:12:46.956842 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfce682-7a3c-4a59-a2ea-bf5bae2fa0d2 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:12:46.961029 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:12:46.971367 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b8eb89-b144-42f5-af68-3c4cbd9f6813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:12:46.972442 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b8eb89-b144-42f5-af68-3c4cbd9f6813 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:46.972731 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b8eb89-b144-42f5-af68-3c4cbd9f6813 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:46.973010 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b8eb89-b144-42f5-af68-3c4cbd9f6813 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:46.974017 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b8eb89-b144-42f5-af68-3c4cbd9f6813 None admin] RBAC: Adding query filter params (role.id=6c2e7a94daa04d7695a6fa91e5cca692, scope.project.id=5f95307582374302a3632bd00efa5a75, user.id=ce838fe092b3400b9e04f51d6a47b7a1) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:12:46.974337 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b8eb89-b144-42f5-af68-3c4cbd9f6813 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:12:46.976584 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b8eb89-b144-42f5-af68-3c4cbd9f6813 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:12:46.984003 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 62/127] 10.222.0.66 () {56 vars in 1374 bytes} [Mon Sep 19 10:12:46 2022] GET /identity/v3/role_assignments?user.id=ce838fe092b3400b9e04f51d6a47b7a1&scope.project.id=5f95307582374302a3632bd00efa5a75&role.id=6c2e7a94daa04d7695a6fa91e5cca692 => generated 259 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:12:46.988773 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b8eb89-b144-42f5-af68-3c4cbd9f6813 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:12:47.023757 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06c3ad4-2983-4a6b-884a-8c5d1be7b8f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:12:47.025882 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06c3ad4-2983-4a6b-884a-8c5d1be7b8f8 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:47.028645 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06c3ad4-2983-4a6b-884a-8c5d1be7b8f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:47.029185 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06c3ad4-2983-4a6b-884a-8c5d1be7b8f8 None admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:47.030113 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06c3ad4-2983-4a6b-884a-8c5d1be7b8f8 None admin] RBAC: Adding query filter params (name=member) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:12:47.031649 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06c3ad4-2983-4a6b-884a-8c5d1be7b8f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:12:47.033356 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06c3ad4-2983-4a6b-884a-8c5d1be7b8f8 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:12:47.051101 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 66/128] 10.222.0.66 () {56 vars in 1101 bytes} [Mon Sep 19 10:12:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:12:47.056224 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06c3ad4-2983-4a6b-884a-8c5d1be7b8f8 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:12:47.116781 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:12:47.205748 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b8eb89-b144-42f5-af68-3c4cbd9f6813 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:12:47.247729 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bc8276-a39e-43a1-bfa3-57ff226a0ca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:12:47.248879 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bc8276-a39e-43a1-bfa3-57ff226a0ca8 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:47.249378 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bc8276-a39e-43a1-bfa3-57ff226a0ca8 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:47.249855 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bc8276-a39e-43a1-bfa3-57ff226a0ca8 None admin] PATH_INFO: `/v3/users/7a5ad9296c73487a8b276f2728c73013` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:47.251553 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bc8276-a39e-43a1-bfa3-57ff226a0ca8 None admin] RBAC: Authorizing `identity:get_user(user_id=7a5ad9296c73487a8b276f2728c73013)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:12:47.253477 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bc8276-a39e-43a1-bfa3-57ff226a0ca8 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:12:47.255451 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06c3ad4-2983-4a6b-884a-8c5d1be7b8f8 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:12:47.255782 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 63/129] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Sep 19 10:12:46 2022] GET /identity/v3/users/7a5ad9296c73487a8b276f2728c73013 => generated 275 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:12:47.263679 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bc8276-a39e-43a1-bfa3-57ff226a0ca8 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:12:47.299052 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f149a1-38e3-4346-a367-72837719f128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:12:47.299698 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f149a1-38e3-4346-a367-72837719f128 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:47.299980 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f149a1-38e3-4346-a367-72837719f128 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:47.300298 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f149a1-38e3-4346-a367-72837719f128 None admin] PATH_INFO: `/v3/users/a561b673cfae437daade9297a694cc7c` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:47.301443 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f149a1-38e3-4346-a367-72837719f128 None admin] RBAC: Authorizing `identity:get_user(user_id=a561b673cfae437daade9297a694cc7c)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:12:47.303012 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f149a1-38e3-4346-a367-72837719f128 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:12:47.305148 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 67/130] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Sep 19 10:12:47 2022] GET /identity/v3/users/a561b673cfae437daade9297a694cc7c => generated 247 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:12:47.309566 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f149a1-38e3-4346-a367-72837719f128 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:12:47.373709 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:12:47.421224 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f149a1-38e3-4346-a367-72837719f128 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:12:47.448225 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bc8276-a39e-43a1-bfa3-57ff226a0ca8 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:12:47.495137 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73674206-fd3c-40b5-b6da-74e099851644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:12:47.495790 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73674206-fd3c-40b5-b6da-74e099851644 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:47.496071 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73674206-fd3c-40b5-b6da-74e099851644 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:47.496377 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73674206-fd3c-40b5-b6da-74e099851644 None admin] PATH_INFO: `/v3/projects/5f95307582374302a3632bd00efa5a75` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:47.497646 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73674206-fd3c-40b5-b6da-74e099851644 None admin] RBAC: Authorizing `identity:get_project(project_id=5f95307582374302a3632bd00efa5a75)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:12:47.499176 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73674206-fd3c-40b5-b6da-74e099851644 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:12:47.500782 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 68/131] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Sep 19 10:12:47 2022] GET /identity/v3/projects/5f95307582374302a3632bd00efa5a75 => generated 298 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:12:47.501553 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73674206-fd3c-40b5-b6da-74e099851644 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:12:47.511639 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:12:47.529803 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94f4056-cbeb-4c91-9838-336b191ca8d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:12:47.530750 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94f4056-cbeb-4c91-9838-336b191ca8d7 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:47.531036 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94f4056-cbeb-4c91-9838-336b191ca8d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:47.531314 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94f4056-cbeb-4c91-9838-336b191ca8d7 None admin] PATH_INFO: `/v3/users/7a5ad9296c73487a8b276f2728c73013` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:47.532765 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94f4056-cbeb-4c91-9838-336b191ca8d7 None admin] RBAC: Authorizing `identity:get_user(user_id=7a5ad9296c73487a8b276f2728c73013)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:12:47.535005 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94f4056-cbeb-4c91-9838-336b191ca8d7 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:12:47.543769 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 64/132] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Sep 19 10:12:47 2022] GET /identity/v3/users/7a5ad9296c73487a8b276f2728c73013 => generated 275 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:12:47.544641 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94f4056-cbeb-4c91-9838-336b191ca8d7 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:12:47.643040 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73674206-fd3c-40b5-b6da-74e099851644 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:12:47.644517 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:12:47.691905 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe94fffe-68b2-4a46-9ebd-a456a0db8f5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:12:47.692621 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe94fffe-68b2-4a46-9ebd-a456a0db8f5d None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:47.692908 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe94fffe-68b2-4a46-9ebd-a456a0db8f5d None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:47.693184 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe94fffe-68b2-4a46-9ebd-a456a0db8f5d None admin] PATH_INFO: `/v3/projects/5f95307582374302a3632bd00efa5a75` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:47.705129 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe94fffe-68b2-4a46-9ebd-a456a0db8f5d None admin] RBAC: Authorizing `identity:get_project(project_id=5f95307582374302a3632bd00efa5a75)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:12:47.706972 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe94fffe-68b2-4a46-9ebd-a456a0db8f5d None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:12:47.709003 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 69/133] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Sep 19 10:12:47 2022] GET /identity/v3/projects/5f95307582374302a3632bd00efa5a75 => generated 298 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:12:47.710175 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe94fffe-68b2-4a46-9ebd-a456a0db8f5d None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:12:47.755161 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94f4056-cbeb-4c91-9838-336b191ca8d7 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:12:47.802384 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1aad5f-ec7e-4371-8844-2a2ad58a21d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:12:47.803108 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1aad5f-ec7e-4371-8844-2a2ad58a21d8 None admin] REQUEST_METHOD: `PUT` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:47.803915 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1aad5f-ec7e-4371-8844-2a2ad58a21d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:47.804210 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1aad5f-ec7e-4371-8844-2a2ad58a21d8 None admin] PATH_INFO: `/v3/projects/5f95307582374302a3632bd00efa5a75/users/7a5ad9296c73487a8b276f2728c73013/roles/43fe0942f9c9486ca3e7c83be55eb915` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:47.808600 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1aad5f-ec7e-4371-8844-2a2ad58a21d8 None admin] RBAC: Authorizing `identity:create_grant(project_id=5f95307582374302a3632bd00efa5a75, user_id=7a5ad9296c73487a8b276f2728c73013, role_id=43fe0942f9c9486ca3e7c83be55eb915)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:12:47.810085 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1aad5f-ec7e-4371-8844-2a2ad58a21d8 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:12:47.840428 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 65/134] 10.222.0.66 () {58 vars in 1439 bytes} [Mon Sep 19 10:12:47 2022] PUT /identity/v3/projects/5f95307582374302a3632bd00efa5a75/users/7a5ad9296c73487a8b276f2728c73013/roles/43fe0942f9c9486ca3e7c83be55eb915 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:12:47.841372 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1aad5f-ec7e-4371-8844-2a2ad58a21d8 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:12:47.861845 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe94fffe-68b2-4a46-9ebd-a456a0db8f5d None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:12:47.927269 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:12:47.929883 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144d04d1-2619-4fc2-b060-e9ea285d6b2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:12:47.930662 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144d04d1-2619-4fc2-b060-e9ea285d6b2d None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:47.931045 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144d04d1-2619-4fc2-b060-e9ea285d6b2d None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:47.931326 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144d04d1-2619-4fc2-b060-e9ea285d6b2d None admin] PATH_INFO: `/v3/projects/8cb958a55d4b43ebb23e163e94c3891b` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:47.933746 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144d04d1-2619-4fc2-b060-e9ea285d6b2d None admin] RBAC: Authorizing `identity:get_project(project_id=8cb958a55d4b43ebb23e163e94c3891b)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:12:47.937606 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144d04d1-2619-4fc2-b060-e9ea285d6b2d None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:12:47.940902 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 70/135] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Sep 19 10:12:47 2022] GET /identity/v3/projects/8cb958a55d4b43ebb23e163e94c3891b => generated 312 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:12:47.943687 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee46b358-e01d-425c-ab8f-7f52a14088bf None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:47.945345 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee46b358-e01d-425c-ab8f-7f52a14088bf None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:47.945637 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee46b358-e01d-425c-ab8f-7f52a14088bf None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:47.946985 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 71/136] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:12:47 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:12:47.953839 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82125c9-a57d-4af1-8758-80a7d24075d4 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:47.954212 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82125c9-a57d-4af1-8758-80a7d24075d4 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:47.954496 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82125c9-a57d-4af1-8758-80a7d24075d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:47.988217 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-f82125c9-a57d-4af1-8758-80a7d24075d4 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:12:47.991593 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-f82125c9-a57d-4af1-8758-80a7d24075d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:12:48.020268 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1aad5f-ec7e-4371-8844-2a2ad58a21d8 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:12:48.062950 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:12:48.094599 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb8c6c7-0f50-4113-a4a5-9ea932f7778c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:12:48.095349 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb8c6c7-0f50-4113-a4a5-9ea932f7778c None admin] REQUEST_METHOD: `PUT` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:48.095639 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb8c6c7-0f50-4113-a4a5-9ea932f7778c None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:48.095923 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb8c6c7-0f50-4113-a4a5-9ea932f7778c None admin] PATH_INFO: `/v3/projects/5f95307582374302a3632bd00efa5a75/users/a561b673cfae437daade9297a694cc7c/roles/5c8b89fae4fa45bd944cbeaf442136e1` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:48.097939 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb8c6c7-0f50-4113-a4a5-9ea932f7778c None admin] RBAC: Authorizing `identity:create_grant(project_id=5f95307582374302a3632bd00efa5a75, user_id=a561b673cfae437daade9297a694cc7c, role_id=5c8b89fae4fa45bd944cbeaf442136e1)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:12:48.099427 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb8c6c7-0f50-4113-a4a5-9ea932f7778c None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:12:48.118678 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 66/137] 10.222.0.66 () {58 vars in 1439 bytes} [Mon Sep 19 10:12:47 2022] PUT /identity/v3/projects/5f95307582374302a3632bd00efa5a75/users/a561b673cfae437daade9297a694cc7c/roles/5c8b89fae4fa45bd944cbeaf442136e1 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:12:48.119597 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb8c6c7-0f50-4113-a4a5-9ea932f7778c None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:12:48.119771 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 72/138] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:12:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 10:12:48.249814 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb8c6c7-0f50-4113-a4a5-9ea932f7778c None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:12:48.268943 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:12:48.291274 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4455206b-b0c2-45b7-b002-1a115f17fabf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:12:48.292001 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4455206b-b0c2-45b7-b002-1a115f17fabf None admin] REQUEST_METHOD: `PUT` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:48.292313 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4455206b-b0c2-45b7-b002-1a115f17fabf None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:48.292599 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4455206b-b0c2-45b7-b002-1a115f17fabf None admin] PATH_INFO: `/v3/projects/8cb958a55d4b43ebb23e163e94c3891b/users/7a5ad9296c73487a8b276f2728c73013/roles/cd5b42ed3b754b58817a62bbe74651b4` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:48.294801 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4455206b-b0c2-45b7-b002-1a115f17fabf None admin] RBAC: Authorizing `identity:create_grant(project_id=8cb958a55d4b43ebb23e163e94c3891b, user_id=7a5ad9296c73487a8b276f2728c73013, role_id=cd5b42ed3b754b58817a62bbe74651b4)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:12:48.296297 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4455206b-b0c2-45b7-b002-1a115f17fabf None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:12:48.310968 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 67/139] 10.222.0.66 () {58 vars in 1439 bytes} [Mon Sep 19 10:12:48 2022] PUT /identity/v3/projects/8cb958a55d4b43ebb23e163e94c3891b/users/7a5ad9296c73487a8b276f2728c73013/roles/cd5b42ed3b754b58817a62bbe74651b4 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:12:48.658999 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82125c9-a57d-4af1-8758-80a7d24075d4 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:12:48.782930 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82125c9-a57d-4af1-8758-80a7d24075d4 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:12:48.823986 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e90a9c7-8d7d-421b-9bb3-e6e4a1c8b4a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:12:48.824681 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e90a9c7-8d7d-421b-9bb3-e6e4a1c8b4a9 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:48.824960 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e90a9c7-8d7d-421b-9bb3-e6e4a1c8b4a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:48.825236 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e90a9c7-8d7d-421b-9bb3-e6e4a1c8b4a9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:48.826350 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e90a9c7-8d7d-421b-9bb3-e6e4a1c8b4a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:12:48.827801 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e90a9c7-8d7d-421b-9bb3-e6e4a1c8b4a9 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:12:48.829699 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 73/140] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 19 10:12:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:12:48.837345 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4455206b-b0c2-45b7-b002-1a115f17fabf None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:12:48.948851 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4455206b-b0c2-45b7-b002-1a115f17fabf None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:12:48.997882 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af11c704-700e-4818-bc62-2c03bf0fe5f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:12:48.998509 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af11c704-700e-4818-bc62-2c03bf0fe5f4 None admin] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:48.998794 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af11c704-700e-4818-bc62-2c03bf0fe5f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:48.999074 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af11c704-700e-4818-bc62-2c03bf0fe5f4 None admin] PATH_INFO: `/v3/users` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:48.999739 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af11c704-700e-4818-bc62-2c03bf0fe5f4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:12:49.001241 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af11c704-700e-4818-bc62-2c03bf0fe5f4 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:12:49.037418 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 68/141] 10.222.0.66 () {60 vars in 1132 bytes} [Mon Sep 19 10:12:48 2022] POST /identity/v3/users => generated 283 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:12:49.127313 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d12f734-fc4b-4bca-bfd7-dd06cb63135e None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:49.127846 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d12f734-fc4b-4bca-bfd7-dd06cb63135e None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:49.127927 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d12f734-fc4b-4bca-bfd7-dd06cb63135e None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:49.129417 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 74/142] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:12:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:12:49.140390 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d6378f-0a75-47c2-957e-6ed538cb9383 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:49.140815 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d6378f-0a75-47c2-957e-6ed538cb9383 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:49.140938 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d6378f-0a75-47c2-957e-6ed538cb9383 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:49.167208 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-f7d6378f-0a75-47c2-957e-6ed538cb9383 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:12:49.168846 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-f7d6378f-0a75-47c2-957e-6ed538cb9383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:12:49.202143 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:12:49.251260 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 69/143] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:12:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 10:12:49.536033 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d12f734-fc4b-4bca-bfd7-dd06cb63135e None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:12:49.574815 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:12:49.661882 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d12f734-fc4b-4bca-bfd7-dd06cb63135e None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:12:49.713000 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf4149a-b1b6-4b19-8827-98fb000e4ae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:12:49.713653 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf4149a-b1b6-4b19-8827-98fb000e4ae5 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:49.713937 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf4149a-b1b6-4b19-8827-98fb000e4ae5 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:49.714209 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf4149a-b1b6-4b19-8827-98fb000e4ae5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:49.732576 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf4149a-b1b6-4b19-8827-98fb000e4ae5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 10:12:49.737511 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-baf4149a-b1b6-4b19-8827-98fb000e4ae5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 19 10:12:49.737511 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:12:49.737511 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:12:49.737511 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:12:49.737511 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:12:49.737511 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:12:49.737511 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:12:49.737511 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:12:49.737511 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:12:49.737511 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:12:49.737511 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:12:49.737511 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:12:49.737511 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 10:12:49.737511 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 10:12:49.737511 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 10:12:49.737511 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 10:12:49.738380 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 10:12:49.738380 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 10:12:49.738380 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 10:12:49.738380 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 10:12:49.738380 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:12:49.738380 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:12:49.738380 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:12:49.738380 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:12:49.738380 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:12:49.738380 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:12:49.738380 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:12:49.738380 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 19 10:12:49.738380 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:12:49.738380 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:12:49.738380 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:12:49.738380 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:12:49.739247 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:12:49.739247 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:12:49.739247 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:12:49.739247 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:12:49.739247 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 10:12:49.739247 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 10:12:49.739247 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 10:12:49.739247 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 10:12:49.739247 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 10:12:49.739247 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 10:12:49.739247 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 19 10:12:49.739247 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 19 10:12:49.739247 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 75/144] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Sep 19 10:12:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:12:49.745124 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d6378f-0a75-47c2-957e-6ed538cb9383 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:12:49.866690 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d6378f-0a75-47c2-957e-6ed538cb9383 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:12:49.908750 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e19146-015f-4597-b3b6-bc48bf0164fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:12:49.909399 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e19146-015f-4597-b3b6-bc48bf0164fe None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:49.909683 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e19146-015f-4597-b3b6-bc48bf0164fe None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:49.909974 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e19146-015f-4597-b3b6-bc48bf0164fe None admin] PATH_INFO: `/v3/roles` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:49.910742 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e19146-015f-4597-b3b6-bc48bf0164fe None admin] RBAC: Adding query filter params (name=member) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:12:49.911050 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e19146-015f-4597-b3b6-bc48bf0164fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:12:49.915310 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e19146-015f-4597-b3b6-bc48bf0164fe None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:12:49.925146 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 70/145] 10.222.0.66 () {56 vars in 1101 bytes} [Mon Sep 19 10:12:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:12:49.933365 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf4149a-b1b6-4b19-8827-98fb000e4ae5 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:12:50.040346 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:12:50.048053 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf4149a-b1b6-4b19-8827-98fb000e4ae5 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:12:50.064300 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59516373-2043-4aac-92f1-42abd7fade01 None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:50.064814 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59516373-2043-4aac-92f1-42abd7fade01 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:50.064895 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59516373-2043-4aac-92f1-42abd7fade01 None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:50.066181 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 71/146] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:12:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 10:12:50.071651 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807775b0-0381-4315-8577-5288b51c5236 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:50.071991 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807775b0-0381-4315-8577-5288b51c5236 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:50.072293 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807775b0-0381-4315-8577-5288b51c5236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:50.101417 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-807775b0-0381-4315-8577-5288b51c5236 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:12:50.104767 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-807775b0-0381-4315-8577-5288b51c5236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:12:50.115698 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3713cca1-1d37-409a-bf60-5d003ef7a576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:12:50.116497 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3713cca1-1d37-409a-bf60-5d003ef7a576 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:50.116803 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3713cca1-1d37-409a-bf60-5d003ef7a576 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:50.117015 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3713cca1-1d37-409a-bf60-5d003ef7a576 None admin] PATH_INFO: `/v3/users/7a5ad9296c73487a8b276f2728c73013` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:50.118300 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3713cca1-1d37-409a-bf60-5d003ef7a576 None admin] RBAC: Authorizing `identity:get_user(user_id=7a5ad9296c73487a8b276f2728c73013)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:12:50.119904 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3713cca1-1d37-409a-bf60-5d003ef7a576 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:12:50.126199 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 76/147] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Sep 19 10:12:49 2022] GET /identity/v3/users/7a5ad9296c73487a8b276f2728c73013 => generated 275 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:12:50.128278 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3713cca1-1d37-409a-bf60-5d003ef7a576 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:12:50.140733 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:12:50.269634 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 72/148] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:12:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 10:12:50.280179 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3713cca1-1d37-409a-bf60-5d003ef7a576 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:12:50.325139 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cdee75-cd28-48b0-a48c-93d9ef024548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:12:50.325763 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cdee75-cd28-48b0-a48c-93d9ef024548 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:50.326098 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cdee75-cd28-48b0-a48c-93d9ef024548 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:50.326376 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cdee75-cd28-48b0-a48c-93d9ef024548 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:50.362100 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:12:50.406308 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cdee75-cd28-48b0-a48c-93d9ef024548 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:12:50.407753 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cdee75-cd28-48b0-a48c-93d9ef024548 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:12:50.522575 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 77/149] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Sep 19 10:12:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 10:12:50.529292 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807775b0-0381-4315-8577-5288b51c5236 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:12:50.695615 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807775b0-0381-4315-8577-5288b51c5236 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:12:50.714687 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cdee75-cd28-48b0-a48c-93d9ef024548 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:12:50.737816 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef1494b-ab15-4d66-a493-6e043f9f828d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:12:50.738771 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef1494b-ab15-4d66-a493-6e043f9f828d None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:50.739256 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef1494b-ab15-4d66-a493-6e043f9f828d None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:50.739707 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef1494b-ab15-4d66-a493-6e043f9f828d None admin] PATH_INFO: `/v3/projects/5f95307582374302a3632bd00efa5a75` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:50.742159 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef1494b-ab15-4d66-a493-6e043f9f828d None admin] RBAC: Authorizing `identity:get_project(project_id=5f95307582374302a3632bd00efa5a75)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:12:50.743809 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef1494b-ab15-4d66-a493-6e043f9f828d None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:12:50.745664 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 73/150] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Sep 19 10:12:50 2022] GET /identity/v3/projects/5f95307582374302a3632bd00efa5a75 => generated 298 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:12:50.751566 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef1494b-ab15-4d66-a493-6e043f9f828d None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:12:50.798321 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:12:50.828512 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:12:50.889227 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cdee75-cd28-48b0-a48c-93d9ef024548 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:12:50.939074 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef1494b-ab15-4d66-a493-6e043f9f828d None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:12:50.948049 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4983ad-fe44-4bab-85bd-c5d42b2292a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:12:50.952202 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4983ad-fe44-4bab-85bd-c5d42b2292a7 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:50.952202 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4983ad-fe44-4bab-85bd-c5d42b2292a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:50.952202 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4983ad-fe44-4bab-85bd-c5d42b2292a7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:50.964685 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4983ad-fe44-4bab-85bd-c5d42b2292a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 10:12:50.974938 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-ba4983ad-fe44-4bab-85bd-c5d42b2292a7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 19 10:12:50.974938 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:12:50.974938 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:12:50.974938 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:12:50.974938 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:12:50.974938 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:12:50.974938 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:12:50.974938 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:12:50.974938 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:12:50.974938 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:12:50.974938 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:12:50.974938 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:12:50.974938 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 10:12:50.974938 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 10:12:50.974938 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 10:12:50.974938 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 10:12:50.976408 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 10:12:50.976408 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 10:12:50.976408 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 10:12:50.976408 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 10:12:50.976408 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:12:50.976408 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:12:50.976408 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:12:50.976408 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:12:50.976408 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:12:50.976408 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:12:50.976408 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:12:50.976408 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 19 10:12:50.976408 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:12:50.976408 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:12:50.976408 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:12:50.976408 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:12:50.977165 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:12:50.977165 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:12:50.977165 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:12:50.977165 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:12:50.977165 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 10:12:50.977165 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 10:12:50.977165 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 10:12:50.977165 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 10:12:50.977165 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 10:12:50.977165 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 10:12:50.977165 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 19 10:12:50.977165 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 19 10:12:50.977165 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 78/151] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Sep 19 10:12:50 2022] GET /identity/v3/roles/reader => generated 84 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:12:50.982467 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4983ad-fe44-4bab-85bd-c5d42b2292a7 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:12:50.997884 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa60363b-062c-44b8-9948-8fb5534e410c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:12:50.998511 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa60363b-062c-44b8-9948-8fb5534e410c None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:50.998789 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa60363b-062c-44b8-9948-8fb5534e410c None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:50.999060 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa60363b-062c-44b8-9948-8fb5534e410c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:50.999794 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa60363b-062c-44b8-9948-8fb5534e410c None admin] RBAC: Adding query filter params (role.id=cd5b42ed3b754b58817a62bbe74651b4, scope.project.id=5f95307582374302a3632bd00efa5a75, user.id=7a5ad9296c73487a8b276f2728c73013) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:12:51.000098 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa60363b-062c-44b8-9948-8fb5534e410c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:12:51.001583 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa60363b-062c-44b8-9948-8fb5534e410c None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:12:51.013380 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 74/152] 10.222.0.66 () {56 vars in 1374 bytes} [Mon Sep 19 10:12:50 2022] GET /identity/v3/role_assignments?user.id=7a5ad9296c73487a8b276f2728c73013&scope.project.id=5f95307582374302a3632bd00efa5a75&role.id=cd5b42ed3b754b58817a62bbe74651b4 => generated 608 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 10:12:51.153001 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4983ad-fe44-4bab-85bd-c5d42b2292a7 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:12:51.180888 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:12:51.191988 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464cf881-a958-461c-af4e-6b87fce8191a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:12:51.192555 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464cf881-a958-461c-af4e-6b87fce8191a None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:51.192834 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464cf881-a958-461c-af4e-6b87fce8191a None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:51.193108 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464cf881-a958-461c-af4e-6b87fce8191a None admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:51.193812 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464cf881-a958-461c-af4e-6b87fce8191a None admin] RBAC: Adding query filter params (name=reader) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:12:51.194114 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464cf881-a958-461c-af4e-6b87fce8191a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:12:51.195521 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464cf881-a958-461c-af4e-6b87fce8191a None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:12:51.204855 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 79/153] 10.222.0.66 () {56 vars in 1101 bytes} [Mon Sep 19 10:12:50 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 10:12:51.211229 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa60363b-062c-44b8-9948-8fb5534e410c None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:12:51.315343 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:12:51.331747 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa60363b-062c-44b8-9948-8fb5534e410c None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:12:51.373187 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de39f4c-d635-46ee-8589-b99e392ba798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:12:51.373909 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de39f4c-d635-46ee-8589-b99e392ba798 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:51.374199 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de39f4c-d635-46ee-8589-b99e392ba798 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:51.374550 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de39f4c-d635-46ee-8589-b99e392ba798 None admin] PATH_INFO: `/v3/users/ce838fe092b3400b9e04f51d6a47b7a1` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:51.375914 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de39f4c-d635-46ee-8589-b99e392ba798 None admin] RBAC: Authorizing `identity:get_user(user_id=ce838fe092b3400b9e04f51d6a47b7a1)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:12:51.377421 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de39f4c-d635-46ee-8589-b99e392ba798 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:12:51.379216 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 75/154] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Sep 19 10:12:51 2022] GET /identity/v3/users/ce838fe092b3400b9e04f51d6a47b7a1 => generated 289 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:12:51.385399 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464cf881-a958-461c-af4e-6b87fce8191a None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:12:51.503513 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464cf881-a958-461c-af4e-6b87fce8191a None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:12:51.539651 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d3de54-5291-43b3-bcf2-99c00fa90efd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:12:51.540392 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d3de54-5291-43b3-bcf2-99c00fa90efd None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:51.540675 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d3de54-5291-43b3-bcf2-99c00fa90efd None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:51.540950 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d3de54-5291-43b3-bcf2-99c00fa90efd None admin] PATH_INFO: `/v3/projects/5f95307582374302a3632bd00efa5a75` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:51.542104 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d3de54-5291-43b3-bcf2-99c00fa90efd None admin] RBAC: Authorizing `identity:get_project(project_id=5f95307582374302a3632bd00efa5a75)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:12:51.543845 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d3de54-5291-43b3-bcf2-99c00fa90efd None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:12:51.545543 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 80/155] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Sep 19 10:12:51 2022] GET /identity/v3/projects/5f95307582374302a3632bd00efa5a75 => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:12:51.551536 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de39f4c-d635-46ee-8589-b99e392ba798 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:12:51.656830 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0f20f8-45b9-4e80-b941-21587c8951af None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:51.657190 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0f20f8-45b9-4e80-b941-21587c8951af None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:51.657366 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0f20f8-45b9-4e80-b941-21587c8951af None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:51.658861 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 81/156] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:12:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 10:12:51.669174 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052ea963-3a0f-4ae1-a8cc-62ea033a7f7a None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:51.669785 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052ea963-3a0f-4ae1-a8cc-62ea033a7f7a None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:51.670280 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052ea963-3a0f-4ae1-a8cc-62ea033a7f7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:51.705243 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-052ea963-3a0f-4ae1-a8cc-62ea033a7f7a None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:12:51.705438 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de39f4c-d635-46ee-8589-b99e392ba798 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:12:51.707012 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-052ea963-3a0f-4ae1-a8cc-62ea033a7f7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:12:51.784676 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85313026-10cd-46b5-8a45-3016df1d2f69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:12:51.785428 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85313026-10cd-46b5-8a45-3016df1d2f69 None admin] REQUEST_METHOD: `PUT` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:51.785714 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85313026-10cd-46b5-8a45-3016df1d2f69 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:51.785994 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85313026-10cd-46b5-8a45-3016df1d2f69 None admin] PATH_INFO: `/v3/projects/5f95307582374302a3632bd00efa5a75/users/ce838fe092b3400b9e04f51d6a47b7a1/roles/6c2e7a94daa04d7695a6fa91e5cca692` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:51.791017 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85313026-10cd-46b5-8a45-3016df1d2f69 None admin] RBAC: Authorizing `identity:create_grant(project_id=5f95307582374302a3632bd00efa5a75, user_id=ce838fe092b3400b9e04f51d6a47b7a1, role_id=6c2e7a94daa04d7695a6fa91e5cca692)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:12:51.792761 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85313026-10cd-46b5-8a45-3016df1d2f69 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:12:51.799307 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:12:51.819710 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 76/157] 10.222.0.66 () {58 vars in 1439 bytes} [Mon Sep 19 10:12:51 2022] PUT /identity/v3/projects/5f95307582374302a3632bd00efa5a75/users/ce838fe092b3400b9e04f51d6a47b7a1/roles/6c2e7a94daa04d7695a6fa91e5cca692 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:12:51.830476 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 82/158] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:12:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 10:12:52.011615 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec84c20-976d-4122-98a7-ed53b0aed275 None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:52.011991 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec84c20-976d-4122-98a7-ed53b0aed275 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:52.012196 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec84c20-976d-4122-98a7-ed53b0aed275 None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:52.013549 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 77/159] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:12:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:12:52.030206 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45051df5-dda4-4e11-9656-0adadb748b52 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:52.030823 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45051df5-dda4-4e11-9656-0adadb748b52 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:52.031299 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45051df5-dda4-4e11-9656-0adadb748b52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:52.059440 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-45051df5-dda4-4e11-9656-0adadb748b52 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:12:52.061057 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-45051df5-dda4-4e11-9656-0adadb748b52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:12:52.149967 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 83/160] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:12:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 10:12:52.321652 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec84c20-976d-4122-98a7-ed53b0aed275 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:12:52.338125 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:12:52.353083 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b0e2ab-6175-450d-9d28-ad5c281cff93 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:52.354054 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b0e2ab-6175-450d-9d28-ad5c281cff93 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:52.354593 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b0e2ab-6175-450d-9d28-ad5c281cff93 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:52.356304 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 84/161] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:12:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:12:52.362081 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4e8cfb-2873-420a-b03c-4abadfef1b9e None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:52.362616 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4e8cfb-2873-420a-b03c-4abadfef1b9e None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:52.363090 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4e8cfb-2873-420a-b03c-4abadfef1b9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:52.393424 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-8b4e8cfb-2873-420a-b03c-4abadfef1b9e None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:12:52.395077 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-8b4e8cfb-2873-420a-b03c-4abadfef1b9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:12:52.485809 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec84c20-976d-4122-98a7-ed53b0aed275 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:12:52.516108 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 85/162] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:12:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 10:12:52.517477 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4e8cfb-2873-420a-b03c-4abadfef1b9e None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:12:52.587327 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:12:52.601760 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd312b2-4df8-4061-a15c-1256b2dd8e64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:12:52.602429 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd312b2-4df8-4061-a15c-1256b2dd8e64 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:52.602712 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd312b2-4df8-4061-a15c-1256b2dd8e64 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:52.602983 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd312b2-4df8-4061-a15c-1256b2dd8e64 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:52.648823 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd312b2-4df8-4061-a15c-1256b2dd8e64 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 10:12:52.656189 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-6fd312b2-4df8-4061-a15c-1256b2dd8e64 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 10:12:52.656189 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:12:52.656189 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:12:52.656189 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:12:52.656189 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:12:52.656189 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:12:52.656189 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:12:52.656189 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:12:52.656189 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:12:52.656189 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:12:52.656189 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:12:52.656189 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:12:52.656189 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 10:12:52.656189 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 10:12:52.656189 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 10:12:52.656189 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 10:12:52.657058 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 10:12:52.657058 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 10:12:52.657058 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 10:12:52.657058 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 10:12:52.657058 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:12:52.657058 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:12:52.657058 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:12:52.657058 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:12:52.657058 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:12:52.657058 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:12:52.657058 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:12:52.657058 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Sep 19 10:12:52.657058 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:12:52.657058 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:12:52.657058 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:12:52.657058 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:12:52.657827 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:12:52.657827 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:12:52.657827 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:12:52.657827 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:12:52.657827 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 10:12:52.657827 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 10:12:52.657827 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 10:12:52.657827 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 10:12:52.657827 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 10:12:52.657827 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 10:12:52.657827 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 10:12:52.657827 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Sep 19 10:12:52.657827 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 78/163] 10.222.0.66 () {56 vars in 1114 bytes} [Mon Sep 19 10:12:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:12:52.664187 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd312b2-4df8-4061-a15c-1256b2dd8e64 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:12:52.675952 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4e8cfb-2873-420a-b03c-4abadfef1b9e None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:12:52.728893 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7781850d-83dc-4480-a1ca-8ec9f62972b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:12:52.729723 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7781850d-83dc-4480-a1ca-8ec9f62972b4 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:52.730013 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7781850d-83dc-4480-a1ca-8ec9f62972b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:52.730299 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7781850d-83dc-4480-a1ca-8ec9f62972b4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:52.745594 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7781850d-83dc-4480-a1ca-8ec9f62972b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 10:12:52.750650 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-7781850d-83dc-4480-a1ca-8ec9f62972b4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 10:12:52.750650 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:12:52.750650 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:12:52.750650 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:12:52.750650 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:12:52.750650 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:12:52.750650 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:12:52.750650 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:12:52.750650 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:12:52.750650 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:12:52.750650 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:12:52.750650 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:12:52.750650 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 10:12:52.750650 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 10:12:52.750650 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 10:12:52.750650 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 10:12:52.751538 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 10:12:52.751538 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 10:12:52.751538 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 10:12:52.751538 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 10:12:52.751538 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:12:52.751538 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:12:52.751538 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:12:52.751538 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:12:52.751538 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:12:52.751538 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:12:52.751538 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:12:52.751538 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 19 10:12:52.751538 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:12:52.751538 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:12:52.751538 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:12:52.751538 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:12:52.752339 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:12:52.752339 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:12:52.752339 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:12:52.752339 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:12:52.752339 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 10:12:52.752339 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 10:12:52.752339 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 10:12:52.752339 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 10:12:52.752339 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 10:12:52.752339 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 10:12:52.752339 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 10:12:52.752339 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 19 10:12:52.752339 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 86/164] 10.222.0.66 () {56 vars in 1096 bytes} [Mon Sep 19 10:12:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:12:52.759001 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7781850d-83dc-4480-a1ca-8ec9f62972b4 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:12:52.903571 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:12:52.943347 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7781850d-83dc-4480-a1ca-8ec9f62972b4 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:12:52.964583 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:12:52.976442 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd312b2-4df8-4061-a15c-1256b2dd8e64 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:12:53.027557 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f3eda4-3a25-4657-9b03-608c6d3dc667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:12:53.028190 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f3eda4-3a25-4657-9b03-608c6d3dc667 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:53.028485 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f3eda4-3a25-4657-9b03-608c6d3dc667 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:53.028755 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f3eda4-3a25-4657-9b03-608c6d3dc667 None admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:53.029426 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f3eda4-3a25-4657-9b03-608c6d3dc667 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:12:53.029727 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f3eda4-3a25-4657-9b03-608c6d3dc667 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:12:53.031141 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f3eda4-3a25-4657-9b03-608c6d3dc667 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:12:53.051765 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 87/165] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Sep 19 10:12:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 10:12:53.052662 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f3eda4-3a25-4657-9b03-608c6d3dc667 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:12:53.062139 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5c53c0-81ed-4624-bab2-f2f978b916af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:12:53.062802 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5c53c0-81ed-4624-bab2-f2f978b916af None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:53.063091 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5c53c0-81ed-4624-bab2-f2f978b916af None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:53.063371 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5c53c0-81ed-4624-bab2-f2f978b916af None admin] PATH_INFO: `/v3/roles` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:53.064059 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5c53c0-81ed-4624-bab2-f2f978b916af None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:12:53.064408 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5c53c0-81ed-4624-bab2-f2f978b916af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:12:53.065815 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5c53c0-81ed-4624-bab2-f2f978b916af None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:12:53.081305 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 79/166] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Sep 19 10:12:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 421 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:12:53.082166 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5c53c0-81ed-4624-bab2-f2f978b916af None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:12:53.186711 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f3eda4-3a25-4657-9b03-608c6d3dc667 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:12:53.222272 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05470c74-74d9-461f-bdee-5d16b0fbf59e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:12:53.222912 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05470c74-74d9-461f-bdee-5d16b0fbf59e None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:53.223197 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05470c74-74d9-461f-bdee-5d16b0fbf59e None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:53.223480 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05470c74-74d9-461f-bdee-5d16b0fbf59e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:53.234955 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05470c74-74d9-461f-bdee-5d16b0fbf59e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 10:12:53.244187 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-05470c74-74d9-461f-bdee-5d16b0fbf59e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 19 10:12:53.244187 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:12:53.244187 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:12:53.244187 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:12:53.244187 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:12:53.244187 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:12:53.244187 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:12:53.244187 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:12:53.244187 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:12:53.244187 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:12:53.244187 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:12:53.244187 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:12:53.244187 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 10:12:53.244187 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 10:12:53.244187 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 10:12:53.244187 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 10:12:53.245088 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 10:12:53.245088 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 10:12:53.245088 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 10:12:53.245088 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 10:12:53.245088 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:12:53.245088 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:12:53.245088 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:12:53.245088 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:12:53.245088 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:12:53.245088 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:12:53.245088 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:12:53.245088 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 19 10:12:53.245088 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:12:53.245088 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:12:53.245088 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:12:53.245088 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:12:53.245920 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:12:53.245920 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:12:53.245920 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:12:53.245920 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:12:53.245920 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 10:12:53.245920 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 10:12:53.245920 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 10:12:53.245920 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 10:12:53.245920 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 10:12:53.245920 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 10:12:53.245920 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 19 10:12:53.245920 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 19 10:12:53.245920 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 88/167] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Sep 19 10:12:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:12:53.245920 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05470c74-74d9-461f-bdee-5d16b0fbf59e None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:12:53.314200 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:12:53.374968 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5c53c0-81ed-4624-bab2-f2f978b916af None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:12:53.388636 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05470c74-74d9-461f-bdee-5d16b0fbf59e None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:12:53.424739 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8653d83-cb59-43dd-b13f-00f279cfdc17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:12:53.425618 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8653d83-cb59-43dd-b13f-00f279cfdc17 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:53.426189 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8653d83-cb59-43dd-b13f-00f279cfdc17 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:53.426612 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8653d83-cb59-43dd-b13f-00f279cfdc17 None admin] PATH_INFO: `/v3/users/7a5ad9296c73487a8b276f2728c73013` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:53.428477 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8653d83-cb59-43dd-b13f-00f279cfdc17 None admin] RBAC: Authorizing `identity:get_user(user_id=7a5ad9296c73487a8b276f2728c73013)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:12:53.430527 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8653d83-cb59-43dd-b13f-00f279cfdc17 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:12:53.432303 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 89/168] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Sep 19 10:12:53 2022] GET /identity/v3/users/7a5ad9296c73487a8b276f2728c73013 => generated 275 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:12:53.433637 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8653d83-cb59-43dd-b13f-00f279cfdc17 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:12:53.558990 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d33e9aa-df0e-443c-b5bb-d2ec380845ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:12:53.559704 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d33e9aa-df0e-443c-b5bb-d2ec380845ee None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:53.559996 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d33e9aa-df0e-443c-b5bb-d2ec380845ee None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:53.560310 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d33e9aa-df0e-443c-b5bb-d2ec380845ee None admin] PATH_INFO: `/v3/users/a561b673cfae437daade9297a694cc7c` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:53.576784 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d33e9aa-df0e-443c-b5bb-d2ec380845ee None admin] RBAC: Authorizing `identity:get_user(user_id=a561b673cfae437daade9297a694cc7c)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:12:53.576784 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d33e9aa-df0e-443c-b5bb-d2ec380845ee None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:12:53.576784 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 80/169] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Sep 19 10:12:53 2022] GET /identity/v3/users/a561b673cfae437daade9297a694cc7c => generated 247 bytes in 490 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:12:53.576784 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d33e9aa-df0e-443c-b5bb-d2ec380845ee None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:12:53.587239 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:12:53.592711 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:12:53.595086 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8653d83-cb59-43dd-b13f-00f279cfdc17 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:12:53.680902 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a99174-3a13-425a-9b5b-360b35daf86c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:12:53.681837 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a99174-3a13-425a-9b5b-360b35daf86c None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:53.682313 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a99174-3a13-425a-9b5b-360b35daf86c None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:53.682750 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a99174-3a13-425a-9b5b-360b35daf86c None admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:53.683599 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a99174-3a13-425a-9b5b-360b35daf86c None admin] RBAC: Adding query filter params (name=member) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:12:53.684065 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a99174-3a13-425a-9b5b-360b35daf86c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:12:53.685648 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a99174-3a13-425a-9b5b-360b35daf86c None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:12:53.700541 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 90/170] 10.222.0.66 () {56 vars in 1101 bytes} [Mon Sep 19 10:12:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:12:53.701825 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a99174-3a13-425a-9b5b-360b35daf86c None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:12:53.839142 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d33e9aa-df0e-443c-b5bb-d2ec380845ee None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:12:53.913519 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c7e4e5-8802-4c8f-bf71-4aab00f6a311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:12:53.914154 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c7e4e5-8802-4c8f-bf71-4aab00f6a311 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:53.914433 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c7e4e5-8802-4c8f-bf71-4aab00f6a311 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:53.914700 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c7e4e5-8802-4c8f-bf71-4aab00f6a311 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:53.924442 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a99174-3a13-425a-9b5b-360b35daf86c None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:12:54.017471 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45086e1-a193-489f-8055-c3fc65177ec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:12:54.018489 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45086e1-a193-489f-8055-c3fc65177ec8 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:54.018997 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45086e1-a193-489f-8055-c3fc65177ec8 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:54.019482 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45086e1-a193-489f-8055-c3fc65177ec8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:54.072194 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:12:54.082573 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c7e4e5-8802-4c8f-bf71-4aab00f6a311 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:12:54.084063 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c7e4e5-8802-4c8f-bf71-4aab00f6a311 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:12:54.091475 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:12:54.150737 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45086e1-a193-489f-8055-c3fc65177ec8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:12:54.152600 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45086e1-a193-489f-8055-c3fc65177ec8 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:12:54.260881 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 91/171] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Sep 19 10:12:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 560 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 10:12:54.262154 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45086e1-a193-489f-8055-c3fc65177ec8 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:12:54.321762 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:12:54.328140 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 81/172] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Sep 19 10:12:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 755 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 10:12:54.333089 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c7e4e5-8802-4c8f-bf71-4aab00f6a311 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:12:54.402195 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45086e1-a193-489f-8055-c3fc65177ec8 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:12:54.469961 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b12267-7694-42dd-b355-734ee477d99d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:12:54.470611 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b12267-7694-42dd-b355-734ee477d99d None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:54.470893 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b12267-7694-42dd-b355-734ee477d99d None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:54.471178 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b12267-7694-42dd-b355-734ee477d99d None admin] PATH_INFO: `/v3/users/7a5ad9296c73487a8b276f2728c73013` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:54.473326 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b12267-7694-42dd-b355-734ee477d99d None admin] RBAC: Authorizing `identity:get_user(user_id=7a5ad9296c73487a8b276f2728c73013)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:12:54.475363 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b12267-7694-42dd-b355-734ee477d99d None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:12:54.478770 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 92/173] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Sep 19 10:12:54 2022] GET /identity/v3/users/7a5ad9296c73487a8b276f2728c73013 => generated 275 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:12:54.479582 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b12267-7694-42dd-b355-734ee477d99d None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:12:54.529631 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c7e4e5-8802-4c8f-bf71-4aab00f6a311 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:12:54.533127 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:12:54.572619 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a7065f-467a-4a5d-9452-8acef0085242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:12:54.573499 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a7065f-467a-4a5d-9452-8acef0085242 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:54.573968 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a7065f-467a-4a5d-9452-8acef0085242 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:54.574242 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a7065f-467a-4a5d-9452-8acef0085242 None admin] PATH_INFO: `/v3/projects/5f95307582374302a3632bd00efa5a75` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:54.575369 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a7065f-467a-4a5d-9452-8acef0085242 None admin] RBAC: Authorizing `identity:get_project(project_id=5f95307582374302a3632bd00efa5a75)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:12:54.577008 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a7065f-467a-4a5d-9452-8acef0085242 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:12:54.578783 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 82/174] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Sep 19 10:12:54 2022] GET /identity/v3/projects/5f95307582374302a3632bd00efa5a75 => generated 298 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:12:54.580140 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9565e2c9-b3d2-48f0-9bb7-ac2a979a394f None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:54.580633 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9565e2c9-b3d2-48f0-9bb7-ac2a979a394f None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:54.581049 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9565e2c9-b3d2-48f0-9bb7-ac2a979a394f None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:54.582389 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 83/175] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:12:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:12:54.583208 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9565e2c9-b3d2-48f0-9bb7-ac2a979a394f None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:12:54.613436 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b12267-7694-42dd-b355-734ee477d99d None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:12:54.638768 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:12:54.650945 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4d1baa-bd2e-4089-b4af-f3bb6ad45045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:12:54.651482 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4d1baa-bd2e-4089-b4af-f3bb6ad45045 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:54.651763 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4d1baa-bd2e-4089-b4af-f3bb6ad45045 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:54.652041 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4d1baa-bd2e-4089-b4af-f3bb6ad45045 None admin] PATH_INFO: `/v3/projects/5f95307582374302a3632bd00efa5a75` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:54.653256 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4d1baa-bd2e-4089-b4af-f3bb6ad45045 None admin] RBAC: Authorizing `identity:get_project(project_id=5f95307582374302a3632bd00efa5a75)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:12:54.654652 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4d1baa-bd2e-4089-b4af-f3bb6ad45045 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:12:54.656311 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 93/176] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Sep 19 10:12:54 2022] GET /identity/v3/projects/5f95307582374302a3632bd00efa5a75 => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:12:54.657513 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2d75ab-d171-4127-8dcc-83391dfe14aa None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:54.657842 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2d75ab-d171-4127-8dcc-83391dfe14aa None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:54.658074 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2d75ab-d171-4127-8dcc-83391dfe14aa None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:54.659349 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 94/177] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:12:54 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:12:54.665463 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f0edcb-8cff-41e8-829f-9cacd3d0afc3 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:54.665463 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f0edcb-8cff-41e8-829f-9cacd3d0afc3 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:54.665463 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f0edcb-8cff-41e8-829f-9cacd3d0afc3 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:54.665463 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 95/178] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:12:54 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:12:54.665463 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f0edcb-8cff-41e8-829f-9cacd3d0afc3 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:12:54.708561 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9565e2c9-b3d2-48f0-9bb7-ac2a979a394f None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:12:54.743593 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4e6fce-5a01-4c97-be10-6e8eca321cba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:12:54.744273 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4e6fce-5a01-4c97-be10-6e8eca321cba None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:54.744512 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4e6fce-5a01-4c97-be10-6e8eca321cba None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:54.744785 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4e6fce-5a01-4c97-be10-6e8eca321cba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:54.774889 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f0edcb-8cff-41e8-829f-9cacd3d0afc3 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:12:54.790794 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:12:54.814566 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f697f54-bd2f-4320-8970-f4cba0269407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:12:54.815181 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f697f54-bd2f-4320-8970-f4cba0269407 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:54.815462 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f697f54-bd2f-4320-8970-f4cba0269407 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:54.815736 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f697f54-bd2f-4320-8970-f4cba0269407 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:54.816498 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f697f54-bd2f-4320-8970-f4cba0269407 None admin] RBAC: Adding query filter params (role.id=5c8b89fae4fa45bd944cbeaf442136e1, scope.project.id=5f95307582374302a3632bd00efa5a75, user.id=a561b673cfae437daade9297a694cc7c) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:12:54.816808 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f697f54-bd2f-4320-8970-f4cba0269407 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:12:54.818263 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f697f54-bd2f-4320-8970-f4cba0269407 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:12:54.819954 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4e6fce-5a01-4c97-be10-6e8eca321cba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:12:54.821535 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4e6fce-5a01-4c97-be10-6e8eca321cba None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:12:54.825060 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 96/179] 10.222.0.66 () {56 vars in 1374 bytes} [Mon Sep 19 10:12:54 2022] GET /identity/v3/role_assignments?user.id=a561b673cfae437daade9297a694cc7c&scope.project.id=5f95307582374302a3632bd00efa5a75&role.id=5c8b89fae4fa45bd944cbeaf442136e1 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:12:54.826271 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf0c25a-6439-4875-86f7-e976cacbfc8b None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:54.826557 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf0c25a-6439-4875-86f7-e976cacbfc8b None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:54.826859 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf0c25a-6439-4875-86f7-e976cacbfc8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:54.855049 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-eaf0c25a-6439-4875-86f7-e976cacbfc8b None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:12:54.856654 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-eaf0c25a-6439-4875-86f7-e976cacbfc8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:12:54.937873 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:12:54.966093 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 97/180] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:12:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 10:12:54.967374 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf0c25a-6439-4875-86f7-e976cacbfc8b None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:12:54.980242 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 84/181] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Sep 19 10:12:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 10:12:54.982023 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1efe61-c8ed-4427-9557-8489f19f4711 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:54.982023 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1efe61-c8ed-4427-9557-8489f19f4711 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:54.982214 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1efe61-c8ed-4427-9557-8489f19f4711 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:55.024281 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-af1efe61-c8ed-4427-9557-8489f19f4711 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:12:55.025481 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-af1efe61-c8ed-4427-9557-8489f19f4711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:12:55.098276 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf0c25a-6439-4875-86f7-e976cacbfc8b None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:12:55.126286 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 85/182] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:12:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 10:12:55.128253 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f113a8-4da1-42b8-97e3-ccb7d35db2f8 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:55.128837 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f113a8-4da1-42b8-97e3-ccb7d35db2f8 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:55.129194 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f113a8-4da1-42b8-97e3-ccb7d35db2f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:55.139699 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:12:55.143822 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606235f1-420b-4723-ad59-581843f9824b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:12:55.144474 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606235f1-420b-4723-ad59-581843f9824b None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:55.144752 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606235f1-420b-4723-ad59-581843f9824b None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:55.145023 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606235f1-420b-4723-ad59-581843f9824b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:55.145754 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606235f1-420b-4723-ad59-581843f9824b None admin] RBAC: Adding query filter params (role.id=43fe0942f9c9486ca3e7c83be55eb915, scope.project.id=5f95307582374302a3632bd00efa5a75, user.id=7a5ad9296c73487a8b276f2728c73013) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:12:55.146056 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606235f1-420b-4723-ad59-581843f9824b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:12:55.148130 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606235f1-420b-4723-ad59-581843f9824b None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:12:55.155184 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-85f113a8-4da1-42b8-97e3-ccb7d35db2f8 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:12:55.155605 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 98/183] 10.222.0.66 () {56 vars in 1374 bytes} [Mon Sep 19 10:12:54 2022] GET /identity/v3/role_assignments?user.id=7a5ad9296c73487a8b276f2728c73013&scope.project.id=5f95307582374302a3632bd00efa5a75&role.id=43fe0942f9c9486ca3e7c83be55eb915 => generated 608 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:12:55.156423 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-85f113a8-4da1-42b8-97e3-ccb7d35db2f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:12:55.160633 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606235f1-420b-4723-ad59-581843f9824b None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:12:55.275435 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:12:55.298882 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 86/184] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:12:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 10:12:55.368564 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606235f1-420b-4723-ad59-581843f9824b None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:12:55.377977 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f113a8-4da1-42b8-97e3-ccb7d35db2f8 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:12:55.449876 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93796159-7256-4216-a8d5-57eadaf8d88b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:12:55.450611 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93796159-7256-4216-a8d5-57eadaf8d88b None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:55.450808 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93796159-7256-4216-a8d5-57eadaf8d88b None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:55.451076 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93796159-7256-4216-a8d5-57eadaf8d88b None admin] PATH_INFO: `/v3/projects/8cb958a55d4b43ebb23e163e94c3891b` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:55.456940 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93796159-7256-4216-a8d5-57eadaf8d88b None admin] RBAC: Authorizing `identity:get_project(project_id=8cb958a55d4b43ebb23e163e94c3891b)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:12:55.458417 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93796159-7256-4216-a8d5-57eadaf8d88b None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:12:55.461422 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 99/185] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Sep 19 10:12:55 2022] GET /identity/v3/projects/8cb958a55d4b43ebb23e163e94c3891b => generated 312 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:12:55.468063 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93796159-7256-4216-a8d5-57eadaf8d88b None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:12:55.528417 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f113a8-4da1-42b8-97e3-ccb7d35db2f8 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:12:55.568113 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:12:55.574463 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929b7a37-72f1-49e9-96f9-6eb938a441e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:12:55.575483 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929b7a37-72f1-49e9-96f9-6eb938a441e4 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:55.575483 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929b7a37-72f1-49e9-96f9-6eb938a441e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:55.575684 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929b7a37-72f1-49e9-96f9-6eb938a441e4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:55.576895 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929b7a37-72f1-49e9-96f9-6eb938a441e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:12:55.578448 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929b7a37-72f1-49e9-96f9-6eb938a441e4 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:12:55.580084 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 87/186] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 19 10:12:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 10:12:55.582560 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17422d3-5f0d-4f13-b974-945f7c4c94fa None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:55.582986 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17422d3-5f0d-4f13-b974-945f7c4c94fa None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:55.583147 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17422d3-5f0d-4f13-b974-945f7c4c94fa None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:55.585322 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 88/187] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:12:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:12:55.586431 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17422d3-5f0d-4f13-b974-945f7c4c94fa None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:12:55.608621 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93796159-7256-4216-a8d5-57eadaf8d88b None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:12:55.629616 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:12:55.650450 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4766d772-7cbb-4360-abaa-edf2e570668c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:12:55.651343 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4766d772-7cbb-4360-abaa-edf2e570668c None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:55.651771 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4766d772-7cbb-4360-abaa-edf2e570668c None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:55.652276 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4766d772-7cbb-4360-abaa-edf2e570668c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:55.653416 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4766d772-7cbb-4360-abaa-edf2e570668c None admin] RBAC: Adding query filter params (role.id=cd5b42ed3b754b58817a62bbe74651b4, scope.project.id=8cb958a55d4b43ebb23e163e94c3891b, user.id=7a5ad9296c73487a8b276f2728c73013) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:12:55.653908 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4766d772-7cbb-4360-abaa-edf2e570668c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:12:55.655540 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4766d772-7cbb-4360-abaa-edf2e570668c None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:12:55.663281 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 100/188] 10.222.0.66 () {56 vars in 1374 bytes} [Mon Sep 19 10:12:55 2022] GET /identity/v3/role_assignments?user.id=7a5ad9296c73487a8b276f2728c73013&scope.project.id=8cb958a55d4b43ebb23e163e94c3891b&role.id=cd5b42ed3b754b58817a62bbe74651b4 => generated 608 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:12:55.664460 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4766d772-7cbb-4360-abaa-edf2e570668c None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:12:55.716024 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17422d3-5f0d-4f13-b974-945f7c4c94fa None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:12:55.755640 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f64152-495f-4d26-8922-3386cfb08dd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:12:55.756361 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f64152-495f-4d26-8922-3386cfb08dd4 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:55.756654 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f64152-495f-4d26-8922-3386cfb08dd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:55.756933 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f64152-495f-4d26-8922-3386cfb08dd4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:55.768677 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f64152-495f-4d26-8922-3386cfb08dd4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 10:12:55.774370 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-63f64152-495f-4d26-8922-3386cfb08dd4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 10:12:55.774370 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:12:55.774370 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:12:55.774370 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:12:55.774370 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:12:55.774370 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:12:55.774370 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:12:55.774370 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:12:55.774370 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:12:55.774370 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:12:55.774370 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:12:55.774370 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:12:55.774370 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 10:12:55.774370 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 10:12:55.774370 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 10:12:55.774370 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 10:12:55.775483 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 10:12:55.775483 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 10:12:55.775483 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 10:12:55.775483 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 10:12:55.775483 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:12:55.775483 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:12:55.775483 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:12:55.775483 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:12:55.775483 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:12:55.775483 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:12:55.775483 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:12:55.775483 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Sep 19 10:12:55.775483 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:12:55.775483 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:12:55.775483 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:12:55.775483 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:12:55.781322 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:12:55.781322 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:12:55.781322 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:12:55.781322 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:12:55.781322 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 10:12:55.781322 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 10:12:55.781322 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 10:12:55.781322 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 10:12:55.781322 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 10:12:55.781322 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 10:12:55.781322 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 10:12:55.781322 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Sep 19 10:12:55.781322 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 89/189] 10.222.0.66 () {56 vars in 1114 bytes} [Mon Sep 19 10:12:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:12:55.781322 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaea541b-59bb-44df-8225-79352ff81ac8 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:55.782124 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaea541b-59bb-44df-8225-79352ff81ac8 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:55.782124 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaea541b-59bb-44df-8225-79352ff81ac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:55.796237 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4766d772-7cbb-4360-abaa-edf2e570668c None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:12:55.799949 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-eaea541b-59bb-44df-8225-79352ff81ac8 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:12:55.801032 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-eaea541b-59bb-44df-8225-79352ff81ac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:12:55.841744 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cdbd8f-528f-4e7b-a7c5-8a831e86f194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:12:55.842383 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cdbd8f-528f-4e7b-a7c5-8a831e86f194 None admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:55.842668 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cdbd8f-528f-4e7b-a7c5-8a831e86f194 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:55.842944 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cdbd8f-528f-4e7b-a7c5-8a831e86f194 None admin] PATH_INFO: `/v3/users` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:55.843626 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cdbd8f-528f-4e7b-a7c5-8a831e86f194 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:12:55.845899 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cdbd8f-528f-4e7b-a7c5-8a831e86f194 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:12:55.878334 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 101/190] 10.222.0.66 () {60 vars in 1132 bytes} [Mon Sep 19 10:12:55 2022] POST /identity/v3/users => generated 297 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:12:55.879219 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cdbd8f-528f-4e7b-a7c5-8a831e86f194 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:12:55.883917 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:12:55.912196 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 90/191] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:12:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 10:12:55.920488 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaea541b-59bb-44df-8225-79352ff81ac8 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:12:55.956699 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:12:56.044471 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cdbd8f-528f-4e7b-a7c5-8a831e86f194 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:12:56.066876 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaea541b-59bb-44df-8225-79352ff81ac8 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:12:56.083725 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b567db-012e-4f85-982c-3c5c758657b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:12:56.085080 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b567db-012e-4f85-982c-3c5c758657b3 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:56.085362 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b567db-012e-4f85-982c-3c5c758657b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:56.085635 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b567db-012e-4f85-982c-3c5c758657b3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:56.097150 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b567db-012e-4f85-982c-3c5c758657b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 10:12:56.102187 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-61b567db-012e-4f85-982c-3c5c758657b3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 10:12:56.102187 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:12:56.102187 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:12:56.102187 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:12:56.102187 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:12:56.102187 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:12:56.102187 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:12:56.102187 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:12:56.102187 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:12:56.102187 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:12:56.102187 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:12:56.102187 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:12:56.102187 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 10:12:56.102187 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 10:12:56.102187 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 10:12:56.102187 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 10:12:56.103227 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 10:12:56.103227 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 10:12:56.103227 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 10:12:56.103227 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 10:12:56.103227 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:12:56.103227 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:12:56.103227 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:12:56.103227 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:12:56.103227 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:12:56.103227 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:12:56.103227 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:12:56.103227 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 19 10:12:56.103227 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:12:56.103227 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:12:56.103227 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:12:56.103227 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:12:56.104253 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:12:56.104253 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:12:56.104253 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:12:56.104253 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:12:56.104253 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 10:12:56.104253 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 10:12:56.104253 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 10:12:56.104253 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 10:12:56.104253 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 10:12:56.104253 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 10:12:56.104253 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 10:12:56.104253 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 19 10:12:56.104253 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 102/192] 10.222.0.66 () {56 vars in 1096 bytes} [Mon Sep 19 10:12:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:12:56.108935 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b567db-012e-4f85-982c-3c5c758657b3 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:12:56.112358 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cd5441-e52d-4c12-bb1f-7a2321a3b78f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:12:56.113174 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cd5441-e52d-4c12-bb1f-7a2321a3b78f None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:56.113703 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cd5441-e52d-4c12-bb1f-7a2321a3b78f None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:56.113975 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cd5441-e52d-4c12-bb1f-7a2321a3b78f None admin] PATH_INFO: `/v3/roles` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:56.114944 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cd5441-e52d-4c12-bb1f-7a2321a3b78f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:12:56.115244 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cd5441-e52d-4c12-bb1f-7a2321a3b78f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:12:56.116704 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cd5441-e52d-4c12-bb1f-7a2321a3b78f None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:12:56.125883 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 91/193] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Sep 19 10:12:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:12:56.133413 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cd5441-e52d-4c12-bb1f-7a2321a3b78f None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:12:56.203297 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:12:56.241527 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:12:56.246906 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b567db-012e-4f85-982c-3c5c758657b3 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:12:56.262063 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cd5441-e52d-4c12-bb1f-7a2321a3b78f None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:12:56.297309 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fe006d-fafb-43d0-8498-0746ae9abf2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:12:56.298216 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fe006d-fafb-43d0-8498-0746ae9abf2d None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:56.298643 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fe006d-fafb-43d0-8498-0746ae9abf2d None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:56.299086 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fe006d-fafb-43d0-8498-0746ae9abf2d None admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:56.299903 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fe006d-fafb-43d0-8498-0746ae9abf2d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:12:56.300372 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fe006d-fafb-43d0-8498-0746ae9abf2d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:12:56.301929 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fe006d-fafb-43d0-8498-0746ae9abf2d None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:12:56.306919 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71f46df-c85f-4250-947c-aba3138b655c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:12:56.307656 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71f46df-c85f-4250-947c-aba3138b655c None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:56.308012 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71f46df-c85f-4250-947c-aba3138b655c None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:56.308461 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71f46df-c85f-4250-947c-aba3138b655c None admin] PATH_INFO: `/v3/users/678deb3a6fa04810b3003e9fabad2b25` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:56.312748 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 103/194] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Sep 19 10:12:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:12:56.313754 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fe006d-fafb-43d0-8498-0746ae9abf2d None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:12:56.323663 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71f46df-c85f-4250-947c-aba3138b655c None admin] RBAC: Authorizing `identity:get_user(user_id=678deb3a6fa04810b3003e9fabad2b25)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:12:56.325203 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71f46df-c85f-4250-947c-aba3138b655c None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:12:56.327044 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 92/195] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Sep 19 10:12:56 2022] GET /identity/v3/users/678deb3a6fa04810b3003e9fabad2b25 => generated 283 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 10:12:56.327744 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71f46df-c85f-4250-947c-aba3138b655c None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:12:56.450350 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fe006d-fafb-43d0-8498-0746ae9abf2d None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:12:56.450867 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71f46df-c85f-4250-947c-aba3138b655c None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:12:56.465943 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:12:56.496492 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c514f989-334c-4aaf-adbb-44b49d1adae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:12:56.497458 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5d6292-1278-4ccd-97bd-c5528dd52735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:12:56.497820 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c514f989-334c-4aaf-adbb-44b49d1adae3 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:56.498107 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5d6292-1278-4ccd-97bd-c5528dd52735 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:56.498392 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5d6292-1278-4ccd-97bd-c5528dd52735 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:56.498666 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5d6292-1278-4ccd-97bd-c5528dd52735 None admin] PATH_INFO: `/v3/users/678deb3a6fa04810b3003e9fabad2b25` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:56.498970 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c514f989-334c-4aaf-adbb-44b49d1adae3 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:56.499511 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c514f989-334c-4aaf-adbb-44b49d1adae3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:56.499799 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5d6292-1278-4ccd-97bd-c5528dd52735 None admin] RBAC: Authorizing `identity:get_user(user_id=678deb3a6fa04810b3003e9fabad2b25)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:12:56.501385 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5d6292-1278-4ccd-97bd-c5528dd52735 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:12:56.503711 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 93/196] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Sep 19 10:12:56 2022] GET /identity/v3/users/678deb3a6fa04810b3003e9fabad2b25 => generated 283 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:12:56.504520 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5d6292-1278-4ccd-97bd-c5528dd52735 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:12:56.513797 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c514f989-334c-4aaf-adbb-44b49d1adae3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 10:12:56.521382 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-c514f989-334c-4aaf-adbb-44b49d1adae3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 19 10:12:56.521382 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:12:56.521382 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:12:56.521382 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:12:56.521382 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:12:56.521382 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:12:56.521382 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:12:56.521382 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:12:56.521382 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:12:56.521382 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:12:56.521382 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:12:56.521382 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:12:56.521382 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 10:12:56.521382 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 10:12:56.521382 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 10:12:56.521382 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 10:12:56.522272 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 10:12:56.522272 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 10:12:56.522272 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 10:12:56.522272 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 10:12:56.522272 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:12:56.522272 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:12:56.522272 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:12:56.522272 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:12:56.522272 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:12:56.522272 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:12:56.522272 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:12:56.522272 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 19 10:12:56.522272 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:12:56.522272 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:12:56.522272 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:12:56.522272 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:12:56.523065 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:12:56.523065 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:12:56.523065 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:12:56.523065 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:12:56.523065 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 10:12:56.523065 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 10:12:56.523065 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 10:12:56.523065 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 10:12:56.523065 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 10:12:56.523065 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 10:12:56.523065 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 19 10:12:56.523065 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 19 10:12:56.525708 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 104/197] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Sep 19 10:12:56 2022] GET /identity/v3/roles/reader => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:12:56.530985 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c514f989-334c-4aaf-adbb-44b49d1adae3 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:12:56.560678 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:12:56.641861 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5d6292-1278-4ccd-97bd-c5528dd52735 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:12:56.671338 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c514f989-334c-4aaf-adbb-44b49d1adae3 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:12:56.683846 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c380d485-b5c6-438b-90e8-d49df4b8f9d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:12:56.684496 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c380d485-b5c6-438b-90e8-d49df4b8f9d7 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:56.687815 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c380d485-b5c6-438b-90e8-d49df4b8f9d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:56.688120 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c380d485-b5c6-438b-90e8-d49df4b8f9d7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:56.720528 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4fd4a4-a025-49e5-8e22-1f31ddd43894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:12:56.721158 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4fd4a4-a025-49e5-8e22-1f31ddd43894 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:56.721444 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4fd4a4-a025-49e5-8e22-1f31ddd43894 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:56.721723 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4fd4a4-a025-49e5-8e22-1f31ddd43894 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:56.739002 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:12:56.764113 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c380d485-b5c6-438b-90e8-d49df4b8f9d7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:12:56.765682 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c380d485-b5c6-438b-90e8-d49df4b8f9d7 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:12:56.808917 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4fd4a4-a025-49e5-8e22-1f31ddd43894 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:12:56.810790 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4fd4a4-a025-49e5-8e22-1f31ddd43894 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:12:56.836938 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:12:56.872233 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 94/198] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Sep 19 10:12:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 10:12:56.873154 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c380d485-b5c6-438b-90e8-d49df4b8f9d7 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:12:56.956090 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 105/199] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Sep 19 10:12:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 10:12:56.957494 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4fd4a4-a025-49e5-8e22-1f31ddd43894 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:12:56.982199 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:12:57.017318 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c380d485-b5c6-438b-90e8-d49df4b8f9d7 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:12:57.054925 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cb7682-d433-473d-a596-34134cf9f625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:12:57.055536 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cb7682-d433-473d-a596-34134cf9f625 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:57.055814 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cb7682-d433-473d-a596-34134cf9f625 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:57.056085 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cb7682-d433-473d-a596-34134cf9f625 None admin] PATH_INFO: `/v3/roles` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:57.056792 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cb7682-d433-473d-a596-34134cf9f625 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:12:57.057092 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cb7682-d433-473d-a596-34134cf9f625 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:12:57.058527 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cb7682-d433-473d-a596-34134cf9f625 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:12:57.072574 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 95/200] 10.222.0.66 () {56 vars in 1101 bytes} [Mon Sep 19 10:12:56 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:12:57.072574 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cb7682-d433-473d-a596-34134cf9f625 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:12:57.095406 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4fd4a4-a025-49e5-8e22-1f31ddd43894 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:12:57.126274 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:12:57.145296 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4dcadd-8cac-4526-818e-a89f0ff12ea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:12:57.146527 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4dcadd-8cac-4526-818e-a89f0ff12ea0 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:57.147587 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4dcadd-8cac-4526-818e-a89f0ff12ea0 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:57.148662 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4dcadd-8cac-4526-818e-a89f0ff12ea0 None admin] PATH_INFO: `/v3/projects/42b2443f228149a79b5bc408193a96bb` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:57.150303 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4dcadd-8cac-4526-818e-a89f0ff12ea0 None admin] RBAC: Authorizing `identity:get_project(project_id=42b2443f228149a79b5bc408193a96bb)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:12:57.152194 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4dcadd-8cac-4526-818e-a89f0ff12ea0 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:12:57.154018 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 106/201] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Sep 19 10:12:56 2022] GET /identity/v3/projects/42b2443f228149a79b5bc408193a96bb => generated 302 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:12:57.154956 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4dcadd-8cac-4526-818e-a89f0ff12ea0 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:12:57.190479 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cb7682-d433-473d-a596-34134cf9f625 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:12:57.240076 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e182876-6b7b-4820-9dff-d52528d201e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:12:57.241097 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e182876-6b7b-4820-9dff-d52528d201e9 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:57.241583 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e182876-6b7b-4820-9dff-d52528d201e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:57.242056 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e182876-6b7b-4820-9dff-d52528d201e9 None admin] PATH_INFO: `/v3/projects/42b2443f228149a79b5bc408193a96bb` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:57.243974 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e182876-6b7b-4820-9dff-d52528d201e9 None admin] RBAC: Authorizing `identity:get_project(project_id=42b2443f228149a79b5bc408193a96bb)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:12:57.246172 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e182876-6b7b-4820-9dff-d52528d201e9 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:12:57.249068 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 96/202] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Sep 19 10:12:57 2022] GET /identity/v3/projects/42b2443f228149a79b5bc408193a96bb => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:12:57.250429 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e182876-6b7b-4820-9dff-d52528d201e9 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:12:57.266458 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:12:57.277772 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4dcadd-8cac-4526-818e-a89f0ff12ea0 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:12:57.330461 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767eba48-b490-453f-8d26-3254a115f7fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:12:57.331020 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767eba48-b490-453f-8d26-3254a115f7fb None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:57.331295 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767eba48-b490-453f-8d26-3254a115f7fb None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:57.331568 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767eba48-b490-453f-8d26-3254a115f7fb None admin] PATH_INFO: `/v3/users/ce838fe092b3400b9e04f51d6a47b7a1` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:57.332854 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767eba48-b490-453f-8d26-3254a115f7fb None admin] RBAC: Authorizing `identity:get_user(user_id=ce838fe092b3400b9e04f51d6a47b7a1)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:12:57.338416 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767eba48-b490-453f-8d26-3254a115f7fb None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:12:57.347375 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 107/203] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Sep 19 10:12:57 2022] GET /identity/v3/users/ce838fe092b3400b9e04f51d6a47b7a1 => generated 289 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:12:57.348540 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767eba48-b490-453f-8d26-3254a115f7fb None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:12:57.376975 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e182876-6b7b-4820-9dff-d52528d201e9 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:12:57.419694 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:12:57.427404 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56085928-236f-47d1-8597-7a175cf9fd24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:12:57.428372 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56085928-236f-47d1-8597-7a175cf9fd24 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:57.428855 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56085928-236f-47d1-8597-7a175cf9fd24 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:57.429448 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56085928-236f-47d1-8597-7a175cf9fd24 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:57.430332 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56085928-236f-47d1-8597-7a175cf9fd24 None admin] RBAC: Adding query filter params (role.id=43fe0942f9c9486ca3e7c83be55eb915, scope.project.id=42b2443f228149a79b5bc408193a96bb, user.id=678deb3a6fa04810b3003e9fabad2b25) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:12:57.431269 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56085928-236f-47d1-8597-7a175cf9fd24 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:12:57.433169 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56085928-236f-47d1-8597-7a175cf9fd24 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:12:57.440644 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 97/204] 10.222.0.66 () {56 vars in 1374 bytes} [Mon Sep 19 10:12:57 2022] GET /identity/v3/role_assignments?user.id=678deb3a6fa04810b3003e9fabad2b25&scope.project.id=42b2443f228149a79b5bc408193a96bb&role.id=43fe0942f9c9486ca3e7c83be55eb915 => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:12:57.441632 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56085928-236f-47d1-8597-7a175cf9fd24 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:12:57.510838 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767eba48-b490-453f-8d26-3254a115f7fb None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:12:57.530656 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:12:57.569444 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56085928-236f-47d1-8597-7a175cf9fd24 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:12:57.611774 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691219f0-6620-4bd4-81da-228acd2ec1b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:12:57.612753 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691219f0-6620-4bd4-81da-228acd2ec1b0 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:57.613118 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f4f1c5-a094-4613-bda5-cb9224c0e1b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:12:57.613373 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691219f0-6620-4bd4-81da-228acd2ec1b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:57.613794 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691219f0-6620-4bd4-81da-228acd2ec1b0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:57.614019 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f4f1c5-a094-4613-bda5-cb9224c0e1b4 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:57.614394 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f4f1c5-a094-4613-bda5-cb9224c0e1b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:57.614784 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f4f1c5-a094-4613-bda5-cb9224c0e1b4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:57.615676 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f4f1c5-a094-4613-bda5-cb9224c0e1b4 None admin] RBAC: Adding query filter params (role.id=5c8b89fae4fa45bd944cbeaf442136e1, scope.project.id=42b2443f228149a79b5bc408193a96bb, user.id=678deb3a6fa04810b3003e9fabad2b25) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:12:57.616103 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f4f1c5-a094-4613-bda5-cb9224c0e1b4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:12:57.617691 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f4f1c5-a094-4613-bda5-cb9224c0e1b4 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:12:57.633482 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 108/205] 10.222.0.66 () {56 vars in 1374 bytes} [Mon Sep 19 10:12:57 2022] GET /identity/v3/role_assignments?user.id=678deb3a6fa04810b3003e9fabad2b25&scope.project.id=42b2443f228149a79b5bc408193a96bb&role.id=5c8b89fae4fa45bd944cbeaf442136e1 => generated 259 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:12:57.700734 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691219f0-6620-4bd4-81da-228acd2ec1b0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:12:57.702236 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691219f0-6620-4bd4-81da-228acd2ec1b0 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:12:57.780532 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:12:57.827072 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 98/206] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Sep 19 10:12:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 10:12:57.832928 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f4f1c5-a094-4613-bda5-cb9224c0e1b4 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:12:57.993109 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f4f1c5-a094-4613-bda5-cb9224c0e1b4 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:12:58.025646 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:12:58.047769 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7f5033-f892-494d-8b46-95553e8103a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:12:58.048513 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7f5033-f892-494d-8b46-95553e8103a4 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:58.048796 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7f5033-f892-494d-8b46-95553e8103a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:58.049071 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7f5033-f892-494d-8b46-95553e8103a4 None admin] PATH_INFO: `/v3/projects/5f95307582374302a3632bd00efa5a75` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:58.050241 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7f5033-f892-494d-8b46-95553e8103a4 None admin] RBAC: Authorizing `identity:get_project(project_id=5f95307582374302a3632bd00efa5a75)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:12:58.051709 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7f5033-f892-494d-8b46-95553e8103a4 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:12:58.054384 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 109/207] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Sep 19 10:12:57 2022] GET /identity/v3/projects/5f95307582374302a3632bd00efa5a75 => generated 298 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:12:58.060054 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691219f0-6620-4bd4-81da-228acd2ec1b0 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:12:58.190133 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691219f0-6620-4bd4-81da-228acd2ec1b0 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:12:58.237559 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102b37f8-0fa2-4ed3-aafe-544022ecfe2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:12:58.238186 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102b37f8-0fa2-4ed3-aafe-544022ecfe2f None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:58.238470 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102b37f8-0fa2-4ed3-aafe-544022ecfe2f None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:58.238751 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102b37f8-0fa2-4ed3-aafe-544022ecfe2f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:58.239482 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102b37f8-0fa2-4ed3-aafe-544022ecfe2f None admin] RBAC: Adding query filter params (role.id=6c2e7a94daa04d7695a6fa91e5cca692, scope.project.id=5f95307582374302a3632bd00efa5a75, user.id=ce838fe092b3400b9e04f51d6a47b7a1) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:12:58.239848 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102b37f8-0fa2-4ed3-aafe-544022ecfe2f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:12:58.241381 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102b37f8-0fa2-4ed3-aafe-544022ecfe2f None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:12:58.253042 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 99/208] 10.222.0.66 () {56 vars in 1374 bytes} [Mon Sep 19 10:12:58 2022] GET /identity/v3/role_assignments?user.id=ce838fe092b3400b9e04f51d6a47b7a1&scope.project.id=5f95307582374302a3632bd00efa5a75&role.id=6c2e7a94daa04d7695a6fa91e5cca692 => generated 608 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:12:58.513531 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4c2fef-1123-4fdd-8707-37a358ea8127 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:58.514517 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4c2fef-1123-4fdd-8707-37a358ea8127 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:58.514995 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4c2fef-1123-4fdd-8707-37a358ea8127 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:58.516560 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 110/209] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:12:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:12:58.522284 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fdb72a-5ef3-4263-8a7d-6d41ccb23413 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:58.522575 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fdb72a-5ef3-4263-8a7d-6d41ccb23413 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:58.522893 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fdb72a-5ef3-4263-8a7d-6d41ccb23413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:58.546173 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-71fdb72a-5ef3-4263-8a7d-6d41ccb23413 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:12:58.547389 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-71fdb72a-5ef3-4263-8a7d-6d41ccb23413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:12:58.583394 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:12:58.629994 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 100/210] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:12:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 10:12:58.754097 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfb57a0-837e-49e8-9072-e426c0ca210f None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:58.754726 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfb57a0-837e-49e8-9072-e426c0ca210f None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:58.755193 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfb57a0-837e-49e8-9072-e426c0ca210f None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:58.757109 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 111/211] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:12:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:12:58.762223 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347a4a43-cbc4-44a5-9b40-288a7115f219 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:58.762678 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347a4a43-cbc4-44a5-9b40-288a7115f219 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:58.762769 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347a4a43-cbc4-44a5-9b40-288a7115f219 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:58.782131 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-347a4a43-cbc4-44a5-9b40-288a7115f219 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:12:58.783335 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-347a4a43-cbc4-44a5-9b40-288a7115f219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:12:58.858694 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 101/212] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:12:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 10:12:58.954920 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfb57a0-837e-49e8-9072-e426c0ca210f None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:12:59.064448 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfb57a0-837e-49e8-9072-e426c0ca210f None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:12:59.098242 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8753c1-14a3-4510-bde3-e97c4800719e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:12:59.099231 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8753c1-14a3-4510-bde3-e97c4800719e None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:59.100251 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8753c1-14a3-4510-bde3-e97c4800719e None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:59.100743 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8753c1-14a3-4510-bde3-e97c4800719e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:59.111467 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8753c1-14a3-4510-bde3-e97c4800719e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 10:12:59.117765 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-df8753c1-14a3-4510-bde3-e97c4800719e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 19 10:12:59.117765 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:12:59.117765 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:12:59.117765 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:12:59.117765 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:12:59.117765 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:12:59.117765 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:12:59.117765 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:12:59.117765 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:12:59.117765 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:12:59.117765 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:12:59.117765 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:12:59.117765 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 10:12:59.117765 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 10:12:59.117765 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 10:12:59.117765 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 10:12:59.118661 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 10:12:59.118661 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 10:12:59.118661 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 10:12:59.118661 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 10:12:59.118661 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:12:59.118661 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:12:59.118661 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:12:59.118661 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:12:59.118661 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:12:59.118661 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:12:59.118661 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:12:59.118661 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 19 10:12:59.118661 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:12:59.118661 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:12:59.118661 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:12:59.118661 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:12:59.119427 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:12:59.119427 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:12:59.119427 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:12:59.119427 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:12:59.119427 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 10:12:59.119427 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 10:12:59.119427 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 10:12:59.119427 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 10:12:59.119427 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 10:12:59.119427 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 10:12:59.119427 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 19 10:12:59.119427 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 19 10:12:59.121680 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 112/213] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Sep 19 10:12:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:12:59.129255 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347a4a43-cbc4-44a5-9b40-288a7115f219 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:12:59.142396 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8753c1-14a3-4510-bde3-e97c4800719e None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:12:59.199225 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:12:59.249562 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:12:59.257454 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347a4a43-cbc4-44a5-9b40-288a7115f219 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:12:59.259219 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8753c1-14a3-4510-bde3-e97c4800719e None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:12:59.295817 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01c37df-455f-49e3-b523-594cec5a2bc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:12:59.296484 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01c37df-455f-49e3-b523-594cec5a2bc0 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:59.296761 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01c37df-455f-49e3-b523-594cec5a2bc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:59.297036 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01c37df-455f-49e3-b523-594cec5a2bc0 None admin] PATH_INFO: `/v3/roles` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:59.297698 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01c37df-455f-49e3-b523-594cec5a2bc0 None admin] RBAC: Adding query filter params (name=member) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:12:59.298002 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01c37df-455f-49e3-b523-594cec5a2bc0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:12:59.299613 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01c37df-455f-49e3-b523-594cec5a2bc0 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:12:59.305355 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748f0d36-3fc6-4e45-aee5-b9f1adbaa3d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:12:59.306709 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748f0d36-3fc6-4e45-aee5-b9f1adbaa3d5 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:59.307418 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748f0d36-3fc6-4e45-aee5-b9f1adbaa3d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:59.307862 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748f0d36-3fc6-4e45-aee5-b9f1adbaa3d5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:59.309181 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748f0d36-3fc6-4e45-aee5-b9f1adbaa3d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:12:59.314203 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 102/214] 10.222.0.66 () {56 vars in 1101 bytes} [Mon Sep 19 10:12:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:12:59.314329 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748f0d36-3fc6-4e45-aee5-b9f1adbaa3d5 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:12:59.315112 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 113/215] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 19 10:12:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 10:12:59.315828 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01c37df-455f-49e3-b523-594cec5a2bc0 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:12:59.322063 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748f0d36-3fc6-4e45-aee5-b9f1adbaa3d5 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:12:59.431332 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01c37df-455f-49e3-b523-594cec5a2bc0 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:12:59.443449 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748f0d36-3fc6-4e45-aee5-b9f1adbaa3d5 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:12:59.464078 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:12:59.470677 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a0ce18-b6fb-4960-aeba-d9bd63bb7134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:12:59.471371 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a0ce18-b6fb-4960-aeba-d9bd63bb7134 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:59.471722 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a0ce18-b6fb-4960-aeba-d9bd63bb7134 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:59.472070 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a0ce18-b6fb-4960-aeba-d9bd63bb7134 None admin] PATH_INFO: `/v3/users/9360b53adb4948f897840f4ee7d0144c` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:59.486256 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5696bb0-9e5e-426c-8125-ce3eb1a3862b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:12:59.487111 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a0ce18-b6fb-4960-aeba-d9bd63bb7134 None admin] RBAC: Authorizing `identity:get_user(user_id=9360b53adb4948f897840f4ee7d0144c)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:12:59.487273 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5696bb0-9e5e-426c-8125-ce3eb1a3862b None admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:59.487730 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5696bb0-9e5e-426c-8125-ce3eb1a3862b None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:59.488140 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5696bb0-9e5e-426c-8125-ce3eb1a3862b None admin] PATH_INFO: `/v3/users` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:59.488983 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a0ce18-b6fb-4960-aeba-d9bd63bb7134 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:12:59.489114 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5696bb0-9e5e-426c-8125-ce3eb1a3862b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:12:59.491213 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5696bb0-9e5e-426c-8125-ce3eb1a3862b None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:12:59.491595 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 103/216] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Sep 19 10:12:59 2022] GET /identity/v3/users/9360b53adb4948f897840f4ee7d0144c => generated 297 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:12:59.496926 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a0ce18-b6fb-4960-aeba-d9bd63bb7134 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:12:59.519809 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:12:59.522699 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 114/217] 10.222.0.66 () {60 vars in 1132 bytes} [Mon Sep 19 10:12:59 2022] POST /identity/v3/users => generated 297 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:12:59.625390 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a0ce18-b6fb-4960-aeba-d9bd63bb7134 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:12:59.663981 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254ae54a-dc14-4659-96bf-d1263ecb7927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:12:59.664933 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254ae54a-dc14-4659-96bf-d1263ecb7927 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:59.665378 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254ae54a-dc14-4659-96bf-d1263ecb7927 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:59.665794 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254ae54a-dc14-4659-96bf-d1263ecb7927 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:59.743474 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254ae54a-dc14-4659-96bf-d1263ecb7927 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:12:59.744983 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254ae54a-dc14-4659-96bf-d1263ecb7927 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:12:59.763137 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:12:59.857080 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 104/218] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Sep 19 10:12:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 19 10:12:59.862481 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5696bb0-9e5e-426c-8125-ce3eb1a3862b None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:12:59.944795 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e51e72-3bbc-4493-b7e5-12331e2feb21 None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:59.945026 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e51e72-3bbc-4493-b7e5-12331e2feb21 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:59.945291 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e51e72-3bbc-4493-b7e5-12331e2feb21 None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:59.946887 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 105/219] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:12:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 10:12:59.952796 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ad150b-679e-49ea-890f-4d41b4fe4aec None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:12:59.953120 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ad150b-679e-49ea-890f-4d41b4fe4aec None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:12:59.953351 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ad150b-679e-49ea-890f-4d41b4fe4aec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:12:59.978335 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-e8ad150b-679e-49ea-890f-4d41b4fe4aec None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:12:59.979582 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-e8ad150b-679e-49ea-890f-4d41b4fe4aec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:12:59.989511 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5696bb0-9e5e-426c-8125-ce3eb1a3862b None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:00.041750 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b67d8d9-301d-46ac-8a6c-5b73c0bc064b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:00.042440 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b67d8d9-301d-46ac-8a6c-5b73c0bc064b None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:00.042724 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b67d8d9-301d-46ac-8a6c-5b73c0bc064b None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:00.043010 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b67d8d9-301d-46ac-8a6c-5b73c0bc064b None admin] PATH_INFO: `/v3/projects/42b2443f228149a79b5bc408193a96bb` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:00.044980 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b67d8d9-301d-46ac-8a6c-5b73c0bc064b None admin] RBAC: Authorizing `identity:get_project(project_id=42b2443f228149a79b5bc408193a96bb)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:00.046858 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b67d8d9-301d-46ac-8a6c-5b73c0bc064b None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:00.049379 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 115/220] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Sep 19 10:12:59 2022] GET /identity/v3/projects/42b2443f228149a79b5bc408193a96bb => generated 302 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 10:13:00.055641 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b67d8d9-301d-46ac-8a6c-5b73c0bc064b None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:00.077698 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 106/221] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:12:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 10:13:00.105895 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:00.123312 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13a0a5e-cd19-4c97-a85c-58cf250576e7 None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:00.123597 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13a0a5e-cd19-4c97-a85c-58cf250576e7 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:00.123867 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13a0a5e-cd19-4c97-a85c-58cf250576e7 None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:00.125257 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 107/222] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:13:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 10:13:00.131916 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb77ae5-0e17-4d8b-ab73-fd2179ed6d24 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:00.132236 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb77ae5-0e17-4d8b-ab73-fd2179ed6d24 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:00.132691 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb77ae5-0e17-4d8b-ab73-fd2179ed6d24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:00.156318 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-5eb77ae5-0e17-4d8b-ab73-fd2179ed6d24 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:13:00.157739 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-5eb77ae5-0e17-4d8b-ab73-fd2179ed6d24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:13:00.195841 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b67d8d9-301d-46ac-8a6c-5b73c0bc064b None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:00.245683 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:00.251145 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f313a3-04d9-491f-9ded-ac9e7d956623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:00.251777 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f313a3-04d9-491f-9ded-ac9e7d956623 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:00.252032 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f313a3-04d9-491f-9ded-ac9e7d956623 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:00.252405 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f313a3-04d9-491f-9ded-ac9e7d956623 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:00.254710 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f313a3-04d9-491f-9ded-ac9e7d956623 None admin] RBAC: Adding query filter params (role.id=cd5b42ed3b754b58817a62bbe74651b4, scope.project.id=42b2443f228149a79b5bc408193a96bb, user.id=9360b53adb4948f897840f4ee7d0144c) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:13:00.255031 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f313a3-04d9-491f-9ded-ac9e7d956623 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:00.257935 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f313a3-04d9-491f-9ded-ac9e7d956623 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:00.266651 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 116/223] 10.222.0.66 () {56 vars in 1374 bytes} [Mon Sep 19 10:13:00 2022] GET /identity/v3/role_assignments?user.id=9360b53adb4948f897840f4ee7d0144c&scope.project.id=42b2443f228149a79b5bc408193a96bb&role.id=cd5b42ed3b754b58817a62bbe74651b4 => generated 259 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:13:00.292481 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 108/224] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:13:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 10:13:00.405485 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f313a3-04d9-491f-9ded-ac9e7d956623 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:00.523883 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f313a3-04d9-491f-9ded-ac9e7d956623 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:00.531246 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:00.560762 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796d4246-b293-4ca0-b856-efd6f1962b80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:00.561456 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796d4246-b293-4ca0-b856-efd6f1962b80 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:00.561743 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796d4246-b293-4ca0-b856-efd6f1962b80 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:00.562020 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796d4246-b293-4ca0-b856-efd6f1962b80 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:00.572737 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796d4246-b293-4ca0-b856-efd6f1962b80 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 10:13:00.578151 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-796d4246-b293-4ca0-b856-efd6f1962b80 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 10:13:00.578151 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:13:00.578151 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:13:00.578151 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:13:00.578151 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:13:00.578151 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:13:00.578151 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:13:00.578151 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:13:00.578151 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:13:00.578151 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:13:00.578151 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:13:00.578151 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:13:00.578151 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 10:13:00.578151 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 10:13:00.578151 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 10:13:00.578151 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 10:13:00.579005 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 10:13:00.579005 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 10:13:00.579005 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 10:13:00.579005 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 10:13:00.579005 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:13:00.579005 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:13:00.579005 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:13:00.579005 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:13:00.579005 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:13:00.579005 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:13:00.579005 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:13:00.579005 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 19 10:13:00.579005 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:13:00.579005 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:13:00.579005 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:13:00.579005 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:13:00.579797 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:13:00.579797 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:13:00.579797 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:13:00.579797 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:13:00.579797 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 10:13:00.579797 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 10:13:00.579797 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 10:13:00.579797 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 10:13:00.579797 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 10:13:00.579797 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 10:13:00.579797 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 10:13:00.579797 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 19 10:13:00.579797 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 117/225] 10.222.0.66 () {56 vars in 1114 bytes} [Mon Sep 19 10:13:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:13:00.586548 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb77ae5-0e17-4d8b-ab73-fd2179ed6d24 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:00.751282 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb77ae5-0e17-4d8b-ab73-fd2179ed6d24 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:00.800873 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796d4246-b293-4ca0-b856-efd6f1962b80 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:00.809836 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dd5f73-d141-4eb1-8969-130c759fc048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:00.811122 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dd5f73-d141-4eb1-8969-130c759fc048 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:00.811596 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dd5f73-d141-4eb1-8969-130c759fc048 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:00.812080 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dd5f73-d141-4eb1-8969-130c759fc048 None admin] PATH_INFO: `/v3/roles` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:00.812968 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dd5f73-d141-4eb1-8969-130c759fc048 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:13:00.813470 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dd5f73-d141-4eb1-8969-130c759fc048 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:00.815090 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dd5f73-d141-4eb1-8969-130c759fc048 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:00.827471 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 109/226] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Sep 19 10:13:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:13:00.841726 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dd5f73-d141-4eb1-8969-130c759fc048 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:00.911044 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:00.916215 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796d4246-b293-4ca0-b856-efd6f1962b80 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:00.947587 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eb5b31-5edd-47e6-bdfc-738c347da9c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:00.948326 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eb5b31-5edd-47e6-bdfc-738c347da9c2 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:00.948620 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eb5b31-5edd-47e6-bdfc-738c347da9c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:00.948898 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eb5b31-5edd-47e6-bdfc-738c347da9c2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:00.960439 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93eb5b31-5edd-47e6-bdfc-738c347da9c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 10:13:00.965844 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-93eb5b31-5edd-47e6-bdfc-738c347da9c2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 10:13:00.965844 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:13:00.965844 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:13:00.965844 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:13:00.965844 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:13:00.965844 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:13:00.965844 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:13:00.965844 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:13:00.965844 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:13:00.965844 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:13:00.965844 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:13:00.965844 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:13:00.965844 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 10:13:00.965844 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 10:13:00.965844 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 10:13:00.965844 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 10:13:00.966712 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 10:13:00.966712 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 10:13:00.966712 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 10:13:00.966712 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 10:13:00.966712 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:13:00.966712 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:13:00.966712 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:13:00.966712 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:13:00.966712 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:13:00.966712 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:13:00.966712 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:13:00.966712 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 19 10:13:00.966712 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:13:00.966712 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:13:00.966712 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:13:00.966712 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:13:00.967506 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:13:00.967506 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:13:00.967506 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:13:00.967506 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:13:00.967506 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 10:13:00.967506 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 10:13:00.967506 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 10:13:00.967506 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 10:13:00.967506 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 10:13:00.967506 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 10:13:00.967506 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 10:13:00.967506 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 19 10:13:00.967506 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 118/227] 10.222.0.66 () {56 vars in 1096 bytes} [Mon Sep 19 10:13:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 10:13:00.972780 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eb5b31-5edd-47e6-bdfc-738c347da9c2 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:01.012607 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:01.056732 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dd5f73-d141-4eb1-8969-130c759fc048 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:01.089147 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eb5b31-5edd-47e6-bdfc-738c347da9c2 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:01.105400 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a14e3e6-697b-4339-b112-6d9bd4b8ab32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:01.106060 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a14e3e6-697b-4339-b112-6d9bd4b8ab32 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:01.106339 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a14e3e6-697b-4339-b112-6d9bd4b8ab32 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:01.106614 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a14e3e6-697b-4339-b112-6d9bd4b8ab32 None admin] PATH_INFO: `/v3/users/678deb3a6fa04810b3003e9fabad2b25` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:01.107763 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a14e3e6-697b-4339-b112-6d9bd4b8ab32 None admin] RBAC: Authorizing `identity:get_user(user_id=678deb3a6fa04810b3003e9fabad2b25)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:01.109264 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a14e3e6-697b-4339-b112-6d9bd4b8ab32 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:01.110880 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 110/228] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Sep 19 10:13:00 2022] GET /identity/v3/users/678deb3a6fa04810b3003e9fabad2b25 => generated 283 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 10:13:01.121148 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a14e3e6-697b-4339-b112-6d9bd4b8ab32 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:01.130742 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a527ab6-e586-499f-acd5-b9f156483dba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:01.131923 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a527ab6-e586-499f-acd5-b9f156483dba None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:01.132233 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a527ab6-e586-499f-acd5-b9f156483dba None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:01.132518 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a527ab6-e586-499f-acd5-b9f156483dba None admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:01.133467 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a527ab6-e586-499f-acd5-b9f156483dba None admin] RBAC: Adding query filter params (name=admin) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:13:01.133781 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a527ab6-e586-499f-acd5-b9f156483dba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:01.135229 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a527ab6-e586-499f-acd5-b9f156483dba None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:01.148024 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 119/229] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Sep 19 10:13:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:13:01.150611 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a527ab6-e586-499f-acd5-b9f156483dba None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:01.257877 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a527ab6-e586-499f-acd5-b9f156483dba None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:01.260536 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:01.296158 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d326be-de1d-4ab9-b34a-05de6cd1897f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:01.296839 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d326be-de1d-4ab9-b34a-05de6cd1897f None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:01.297124 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d326be-de1d-4ab9-b34a-05de6cd1897f None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:01.297400 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d326be-de1d-4ab9-b34a-05de6cd1897f None admin] PATH_INFO: `/v3/users/678deb3a6fa04810b3003e9fabad2b25` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:01.298554 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d326be-de1d-4ab9-b34a-05de6cd1897f None admin] RBAC: Authorizing `identity:get_user(user_id=678deb3a6fa04810b3003e9fabad2b25)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:01.300074 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d326be-de1d-4ab9-b34a-05de6cd1897f None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:01.301863 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 120/230] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Sep 19 10:13:01 2022] GET /identity/v3/users/678deb3a6fa04810b3003e9fabad2b25 => generated 283 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 10:13:01.307955 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d326be-de1d-4ab9-b34a-05de6cd1897f None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:01.314098 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a14e3e6-697b-4339-b112-6d9bd4b8ab32 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:01.332189 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:01.393666 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e8245f-28f2-43a9-ba31-4d055f2ef792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:01.394331 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e8245f-28f2-43a9-ba31-4d055f2ef792 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:01.394608 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e8245f-28f2-43a9-ba31-4d055f2ef792 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:01.394880 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e8245f-28f2-43a9-ba31-4d055f2ef792 None admin] PATH_INFO: `/v3/projects/42b2443f228149a79b5bc408193a96bb` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:01.400956 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e8245f-28f2-43a9-ba31-4d055f2ef792 None admin] RBAC: Authorizing `identity:get_project(project_id=42b2443f228149a79b5bc408193a96bb)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:01.402447 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e8245f-28f2-43a9-ba31-4d055f2ef792 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:01.404514 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 111/231] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Sep 19 10:13:01 2022] GET /identity/v3/projects/42b2443f228149a79b5bc408193a96bb => generated 302 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:13:01.421129 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e8245f-28f2-43a9-ba31-4d055f2ef792 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:01.429888 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d326be-de1d-4ab9-b34a-05de6cd1897f None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:01.465721 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f12f45b-8fa4-402e-81a9-c5c0b6909464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:01.466366 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f12f45b-8fa4-402e-81a9-c5c0b6909464 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:01.466649 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f12f45b-8fa4-402e-81a9-c5c0b6909464 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:01.466924 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f12f45b-8fa4-402e-81a9-c5c0b6909464 None admin] PATH_INFO: `/v3/projects/42b2443f228149a79b5bc408193a96bb` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:01.468070 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f12f45b-8fa4-402e-81a9-c5c0b6909464 None admin] RBAC: Authorizing `identity:get_project(project_id=42b2443f228149a79b5bc408193a96bb)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:01.469568 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f12f45b-8fa4-402e-81a9-c5c0b6909464 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:01.471545 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 121/232] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Sep 19 10:13:01 2022] GET /identity/v3/projects/42b2443f228149a79b5bc408193a96bb => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:13:01.477793 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f12f45b-8fa4-402e-81a9-c5c0b6909464 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:01.508537 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:01.585222 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f12f45b-8fa4-402e-81a9-c5c0b6909464 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:01.621338 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f85579-fc5a-4096-aa8d-52e1e0a45007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:01.622250 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f85579-fc5a-4096-aa8d-52e1e0a45007 None admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:01.622852 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f85579-fc5a-4096-aa8d-52e1e0a45007 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:01.623283 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f85579-fc5a-4096-aa8d-52e1e0a45007 None admin] PATH_INFO: `/v3/projects/42b2443f228149a79b5bc408193a96bb/users/678deb3a6fa04810b3003e9fabad2b25/roles/5c8b89fae4fa45bd944cbeaf442136e1` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:01.625419 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f85579-fc5a-4096-aa8d-52e1e0a45007 None admin] RBAC: Authorizing `identity:create_grant(project_id=42b2443f228149a79b5bc408193a96bb, user_id=678deb3a6fa04810b3003e9fabad2b25, role_id=5c8b89fae4fa45bd944cbeaf442136e1)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:01.627009 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f85579-fc5a-4096-aa8d-52e1e0a45007 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:01.632589 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e8245f-28f2-43a9-ba31-4d055f2ef792 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:01.658786 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 122/233] 10.222.0.66 () {58 vars in 1439 bytes} [Mon Sep 19 10:13:01 2022] PUT /identity/v3/projects/42b2443f228149a79b5bc408193a96bb/users/678deb3a6fa04810b3003e9fabad2b25/roles/5c8b89fae4fa45bd944cbeaf442136e1 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 10:13:01.692825 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d603cdb-c15f-4459-b9bc-170749057267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:01.694183 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d603cdb-c15f-4459-b9bc-170749057267 None admin] REQUEST_METHOD: `PUT` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:01.694468 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d603cdb-c15f-4459-b9bc-170749057267 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:01.694746 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d603cdb-c15f-4459-b9bc-170749057267 None admin] PATH_INFO: `/v3/projects/42b2443f228149a79b5bc408193a96bb/users/678deb3a6fa04810b3003e9fabad2b25/roles/43fe0942f9c9486ca3e7c83be55eb915` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:01.699489 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d603cdb-c15f-4459-b9bc-170749057267 None admin] RBAC: Authorizing `identity:create_grant(project_id=42b2443f228149a79b5bc408193a96bb, user_id=678deb3a6fa04810b3003e9fabad2b25, role_id=43fe0942f9c9486ca3e7c83be55eb915)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:01.701157 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d603cdb-c15f-4459-b9bc-170749057267 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:01.721713 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 112/234] 10.222.0.66 () {58 vars in 1439 bytes} [Mon Sep 19 10:13:01 2022] PUT /identity/v3/projects/42b2443f228149a79b5bc408193a96bb/users/678deb3a6fa04810b3003e9fabad2b25/roles/43fe0942f9c9486ca3e7c83be55eb915 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:13:02.600615 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d77a29-d183-41f4-a39e-dd4c7d75fb80 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:02.601664 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d77a29-d183-41f4-a39e-dd4c7d75fb80 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:02.602158 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d77a29-d183-41f4-a39e-dd4c7d75fb80 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:02.603820 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 123/235] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:13:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 10:13:02.612204 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a54180-6573-48f4-a43b-a9441f0f34b6 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:02.613099 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a54180-6573-48f4-a43b-a9441f0f34b6 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:02.613578 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a54180-6573-48f4-a43b-a9441f0f34b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:02.641222 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-20a54180-6573-48f4-a43b-a9441f0f34b6 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:13:02.642789 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-20a54180-6573-48f4-a43b-a9441f0f34b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:13:02.682685 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:02.744735 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 113/236] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:13:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 10:13:02.767258 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4cd3d0-81d2-4768-b0d6-ce21f32ef7ac None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:02.767866 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4cd3d0-81d2-4768-b0d6-ce21f32ef7ac None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:02.768371 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4cd3d0-81d2-4768-b0d6-ce21f32ef7ac None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:02.770134 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 124/237] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:13:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:13:02.775816 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5711fd9d-f574-4e22-9d54-1399afed0d9a None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:02.776098 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5711fd9d-f574-4e22-9d54-1399afed0d9a None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:02.776441 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5711fd9d-f574-4e22-9d54-1399afed0d9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:02.802770 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-5711fd9d-f574-4e22-9d54-1399afed0d9a None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:13:02.804879 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-5711fd9d-f574-4e22-9d54-1399afed0d9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:13:02.930047 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 114/238] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:13:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 10:13:03.282354 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4cd3d0-81d2-4768-b0d6-ce21f32ef7ac None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:03.381430 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5711fd9d-f574-4e22-9d54-1399afed0d9a None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:03.419480 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4cd3d0-81d2-4768-b0d6-ce21f32ef7ac None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:03.436381 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:03.470048 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879feb32-d25e-4700-927b-c60fe64b4294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:03.470960 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879feb32-d25e-4700-927b-c60fe64b4294 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:03.471400 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879feb32-d25e-4700-927b-c60fe64b4294 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:03.471821 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879feb32-d25e-4700-927b-c60fe64b4294 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:03.488449 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879feb32-d25e-4700-927b-c60fe64b4294 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 10:13:03.494214 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-879feb32-d25e-4700-927b-c60fe64b4294 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 19 10:13:03.494214 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:13:03.494214 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:13:03.494214 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:13:03.494214 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:13:03.494214 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:13:03.494214 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:13:03.494214 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:13:03.494214 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:13:03.494214 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:13:03.494214 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:13:03.494214 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:13:03.494214 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 10:13:03.494214 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 10:13:03.494214 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 10:13:03.494214 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 10:13:03.495132 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 10:13:03.495132 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 10:13:03.495132 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 10:13:03.495132 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 10:13:03.495132 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:13:03.495132 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:13:03.495132 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:13:03.495132 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:13:03.495132 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:13:03.495132 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:13:03.495132 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:13:03.495132 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 19 10:13:03.495132 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:13:03.495132 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:13:03.495132 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:13:03.495132 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:13:03.496526 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:13:03.496526 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:13:03.496526 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:13:03.496526 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:13:03.496526 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 10:13:03.496526 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 10:13:03.496526 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 10:13:03.496526 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 10:13:03.496526 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 10:13:03.496526 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 10:13:03.496526 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 19 10:13:03.496526 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 19 10:13:03.496526 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 125/239] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Sep 19 10:13:03 2022] GET /identity/v3/roles/reader => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:13:03.497180 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373203ae-9b9c-4a73-a46f-f3ca48627d0e None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:03.497180 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373203ae-9b9c-4a73-a46f-f3ca48627d0e None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:03.497485 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373203ae-9b9c-4a73-a46f-f3ca48627d0e None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:03.498670 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 126/240] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:13:03 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:13:03.501359 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373203ae-9b9c-4a73-a46f-f3ca48627d0e None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:03.547475 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:03.559460 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5711fd9d-f574-4e22-9d54-1399afed0d9a None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:03.602958 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d31f26-aa77-4ce3-9211-f221aac499d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:03.604192 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d31f26-aa77-4ce3-9211-f221aac499d4 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:03.604883 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d31f26-aa77-4ce3-9211-f221aac499d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:03.605299 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d31f26-aa77-4ce3-9211-f221aac499d4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:03.606697 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d31f26-aa77-4ce3-9211-f221aac499d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:03.608612 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d31f26-aa77-4ce3-9211-f221aac499d4 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:03.611060 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 115/241] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 19 10:13:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:13:03.612466 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ead6159-46ef-4e51-ac62-89d8645062d7 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:03.613374 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ead6159-46ef-4e51-ac62-89d8645062d7 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:03.613803 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ead6159-46ef-4e51-ac62-89d8645062d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:03.634208 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373203ae-9b9c-4a73-a46f-f3ca48627d0e None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:03.636808 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-0ead6159-46ef-4e51-ac62-89d8645062d7 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:13:03.638905 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-0ead6159-46ef-4e51-ac62-89d8645062d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:13:03.678763 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcecef2-7479-4dc4-9408-d409b3987efa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:03.680017 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcecef2-7479-4dc4-9408-d409b3987efa None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:03.680751 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcecef2-7479-4dc4-9408-d409b3987efa None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:03.681223 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcecef2-7479-4dc4-9408-d409b3987efa None admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:03.682070 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcecef2-7479-4dc4-9408-d409b3987efa None admin] RBAC: Adding query filter params (name=reader) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:13:03.682569 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcecef2-7479-4dc4-9408-d409b3987efa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:03.684155 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcecef2-7479-4dc4-9408-d409b3987efa None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:03.700446 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 127/242] 10.222.0.66 () {56 vars in 1101 bytes} [Mon Sep 19 10:13:03 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 10:13:03.701934 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcecef2-7479-4dc4-9408-d409b3987efa None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:03.705750 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:03.724024 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 116/243] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:13:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 10:13:03.729040 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ead6159-46ef-4e51-ac62-89d8645062d7 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:03.883177 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcecef2-7479-4dc4-9408-d409b3987efa None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:03.897314 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:03.916088 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ead6159-46ef-4e51-ac62-89d8645062d7 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:03.950673 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0faf8f-710e-433c-b35d-47ae13c36ff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:03.951287 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0faf8f-710e-433c-b35d-47ae13c36ff6 None admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:03.952970 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0faf8f-710e-433c-b35d-47ae13c36ff6 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:03.953245 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0faf8f-710e-433c-b35d-47ae13c36ff6 None admin] PATH_INFO: `/v3/users` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:03.953899 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0faf8f-710e-433c-b35d-47ae13c36ff6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:03.955424 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0faf8f-710e-433c-b35d-47ae13c36ff6 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:03.983372 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1107366-b8a7-4f84-b180-2862e0efad0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:03.984120 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1107366-b8a7-4f84-b180-2862e0efad0e None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:03.984420 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1107366-b8a7-4f84-b180-2862e0efad0e None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:03.984844 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1107366-b8a7-4f84-b180-2862e0efad0e None admin] PATH_INFO: `/v3/users/fad23c4571054ca8a153cf1811813d1b` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:04.003404 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 128/244] 10.222.0.66 () {60 vars in 1132 bytes} [Mon Sep 19 10:13:03 2022] POST /identity/v3/users => generated 293 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:13:04.017589 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1107366-b8a7-4f84-b180-2862e0efad0e None admin] RBAC: Authorizing `identity:get_user(user_id=fad23c4571054ca8a153cf1811813d1b)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:04.019194 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1107366-b8a7-4f84-b180-2862e0efad0e None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:04.021164 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 117/245] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Sep 19 10:13:03 2022] GET /identity/v3/users/fad23c4571054ca8a153cf1811813d1b => generated 297 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:13:04.027634 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0faf8f-710e-433c-b35d-47ae13c36ff6 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:04.049712 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1107366-b8a7-4f84-b180-2862e0efad0e None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:04.161464 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:04.211096 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0faf8f-710e-433c-b35d-47ae13c36ff6 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:04.216158 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1107366-b8a7-4f84-b180-2862e0efad0e None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:04.254080 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f5f6e5-3ddf-4d3c-b152-12b81a534a48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:04.255194 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f5f6e5-3ddf-4d3c-b152-12b81a534a48 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:04.255723 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f5f6e5-3ddf-4d3c-b152-12b81a534a48 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:04.256771 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f5f6e5-3ddf-4d3c-b152-12b81a534a48 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:04.260526 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1b2681-d9b2-47a1-bd76-7be8e18c80fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:04.262072 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1b2681-d9b2-47a1-bd76-7be8e18c80fd None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:04.262356 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1b2681-d9b2-47a1-bd76-7be8e18c80fd None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:04.262630 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1b2681-d9b2-47a1-bd76-7be8e18c80fd None admin] PATH_INFO: `/v3/roles/member` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:04.277446 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1b2681-d9b2-47a1-bd76-7be8e18c80fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 10:13:04.283882 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-dd1b2681-d9b2-47a1-bd76-7be8e18c80fd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 19 10:13:04.283882 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:13:04.283882 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:13:04.283882 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:13:04.283882 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:13:04.283882 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:13:04.283882 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:13:04.283882 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:13:04.283882 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:13:04.283882 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:13:04.283882 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:13:04.283882 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:13:04.283882 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 10:13:04.283882 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 10:13:04.283882 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 10:13:04.283882 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 10:13:04.284983 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 10:13:04.284983 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 10:13:04.284983 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 10:13:04.284983 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 10:13:04.284983 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:13:04.284983 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:13:04.284983 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:13:04.284983 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:13:04.284983 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:13:04.284983 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:13:04.284983 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:13:04.284983 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Sep 19 10:13:04.284983 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:13:04.284983 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:13:04.284983 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:13:04.284983 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:13:04.285777 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:13:04.285777 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:13:04.285777 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:13:04.285777 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:13:04.285777 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 10:13:04.285777 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 10:13:04.285777 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 10:13:04.285777 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 10:13:04.285777 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 10:13:04.285777 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 10:13:04.285777 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 19 10:13:04.285777 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Sep 19 10:13:04.285777 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 118/246] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Sep 19 10:13:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:13:04.292012 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1b2681-d9b2-47a1-bd76-7be8e18c80fd None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:04.311297 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:04.350551 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f5f6e5-3ddf-4d3c-b152-12b81a534a48 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:04.352581 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f5f6e5-3ddf-4d3c-b152-12b81a534a48 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:04.422065 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:04.430194 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1b2681-d9b2-47a1-bd76-7be8e18c80fd None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:04.473023 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 129/247] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Sep 19 10:13:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 10:13:04.479054 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f5f6e5-3ddf-4d3c-b152-12b81a534a48 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:04.480108 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07061b88-867d-4ee0-9d06-9ed27f75e607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:04.481094 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07061b88-867d-4ee0-9d06-9ed27f75e607 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:04.481567 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07061b88-867d-4ee0-9d06-9ed27f75e607 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:04.482108 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07061b88-867d-4ee0-9d06-9ed27f75e607 None admin] PATH_INFO: `/v3/roles` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:04.482985 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07061b88-867d-4ee0-9d06-9ed27f75e607 None admin] RBAC: Adding query filter params (name=member) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:13:04.483482 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07061b88-867d-4ee0-9d06-9ed27f75e607 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:04.485131 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07061b88-867d-4ee0-9d06-9ed27f75e607 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:04.499894 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 119/248] 10.222.0.66 () {56 vars in 1101 bytes} [Mon Sep 19 10:13:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 10:13:04.501860 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07061b88-867d-4ee0-9d06-9ed27f75e607 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:04.584785 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:04.600816 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f5f6e5-3ddf-4d3c-b152-12b81a534a48 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:04.622267 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07061b88-867d-4ee0-9d06-9ed27f75e607 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:04.641127 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdb0913-73c5-490f-ae43-0380464713a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:04.642354 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdb0913-73c5-490f-ae43-0380464713a1 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:04.642783 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdb0913-73c5-490f-ae43-0380464713a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:04.643213 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdb0913-73c5-490f-ae43-0380464713a1 None admin] PATH_INFO: `/v3/projects/42b2443f228149a79b5bc408193a96bb` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:04.644694 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdb0913-73c5-490f-ae43-0380464713a1 None admin] RBAC: Authorizing `identity:get_project(project_id=42b2443f228149a79b5bc408193a96bb)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:04.646995 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdb0913-73c5-490f-ae43-0380464713a1 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:04.649396 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 130/249] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Sep 19 10:13:04 2022] GET /identity/v3/projects/42b2443f228149a79b5bc408193a96bb => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:13:04.655473 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdb0913-73c5-490f-ae43-0380464713a1 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:04.660114 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56af5bcf-946f-457d-83c5-b4a83d41352c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:04.660329 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56af5bcf-946f-457d-83c5-b4a83d41352c None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:04.660598 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56af5bcf-946f-457d-83c5-b4a83d41352c None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:04.660939 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56af5bcf-946f-457d-83c5-b4a83d41352c None admin] PATH_INFO: `/v3/users/9360b53adb4948f897840f4ee7d0144c` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:04.662694 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56af5bcf-946f-457d-83c5-b4a83d41352c None admin] RBAC: Authorizing `identity:get_user(user_id=9360b53adb4948f897840f4ee7d0144c)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:04.664277 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56af5bcf-946f-457d-83c5-b4a83d41352c None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:04.675999 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 120/250] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Sep 19 10:13:04 2022] GET /identity/v3/users/9360b53adb4948f897840f4ee7d0144c => generated 297 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:13:04.677467 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56af5bcf-946f-457d-83c5-b4a83d41352c None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:04.689954 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:04.788925 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdb0913-73c5-490f-ae43-0380464713a1 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:04.813309 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56af5bcf-946f-457d-83c5-b4a83d41352c None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:04.836484 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004ab707-92a1-48e8-a911-1c130ed1187d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:04.837911 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004ab707-92a1-48e8-a911-1c130ed1187d None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:04.838616 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004ab707-92a1-48e8-a911-1c130ed1187d None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:04.839061 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004ab707-92a1-48e8-a911-1c130ed1187d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:04.839930 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004ab707-92a1-48e8-a911-1c130ed1187d None admin] RBAC: Adding query filter params (role.id=6c2e7a94daa04d7695a6fa91e5cca692, scope.project.id=42b2443f228149a79b5bc408193a96bb, user.id=fad23c4571054ca8a153cf1811813d1b) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:13:04.840440 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004ab707-92a1-48e8-a911-1c130ed1187d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:04.842041 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004ab707-92a1-48e8-a911-1c130ed1187d None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:04.848997 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 131/251] 10.222.0.66 () {56 vars in 1374 bytes} [Mon Sep 19 10:13:04 2022] GET /identity/v3/role_assignments?user.id=fad23c4571054ca8a153cf1811813d1b&scope.project.id=42b2443f228149a79b5bc408193a96bb&role.id=6c2e7a94daa04d7695a6fa91e5cca692 => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:13:04.850958 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0979c9a3-a253-4fc3-864b-8bfe6f790029 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:04.851392 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0979c9a3-a253-4fc3-864b-8bfe6f790029 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:04.856193 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0979c9a3-a253-4fc3-864b-8bfe6f790029 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:04.856371 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdad7b9-50f5-46d9-a707-d10eef3a8197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:04.856371 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdad7b9-50f5-46d9-a707-d10eef3a8197 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:04.856371 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdad7b9-50f5-46d9-a707-d10eef3a8197 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:04.856371 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdad7b9-50f5-46d9-a707-d10eef3a8197 None admin] PATH_INFO: `/v3/projects/42b2443f228149a79b5bc408193a96bb` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:04.856703 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdad7b9-50f5-46d9-a707-d10eef3a8197 None admin] RBAC: Authorizing `identity:get_project(project_id=42b2443f228149a79b5bc408193a96bb)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:04.857061 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdad7b9-50f5-46d9-a707-d10eef3a8197 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:04.858466 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 132/252] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:13:04 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:13:04.859417 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 121/253] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Sep 19 10:13:04 2022] GET /identity/v3/projects/42b2443f228149a79b5bc408193a96bb => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:13:04.860079 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c3d1f3-ddc4-4095-84b2-e332827071d8 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:04.860560 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c3d1f3-ddc4-4095-84b2-e332827071d8 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:04.861053 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c3d1f3-ddc4-4095-84b2-e332827071d8 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:04.862416 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 133/254] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:13:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:13:04.865112 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d20fb10-54c0-4e1e-858b-f32c4c924a47 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:04.865313 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d20fb10-54c0-4e1e-858b-f32c4c924a47 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:04.866066 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d20fb10-54c0-4e1e-858b-f32c4c924a47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:04.866612 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c3d1f3-ddc4-4095-84b2-e332827071d8 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:04.893849 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-8d20fb10-54c0-4e1e-858b-f32c4c924a47 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:13:04.895080 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-8d20fb10-54c0-4e1e-858b-f32c4c924a47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:13:04.898828 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:05.038836 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 122/255] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:13:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 10:13:05.039993 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcfdfb1-6d2e-479e-bc86-371493ee7c6a None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:05.040302 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcfdfb1-6d2e-479e-bc86-371493ee7c6a None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:05.040576 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcfdfb1-6d2e-479e-bc86-371493ee7c6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:05.053773 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:05.084126 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-ddcfdfb1-6d2e-479e-bc86-371493ee7c6a None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:13:05.086108 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-ddcfdfb1-6d2e-479e-bc86-371493ee7c6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:13:05.090158 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c3d1f3-ddc4-4095-84b2-e332827071d8 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:05.218156 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a2005f-9870-4344-805a-c95707811408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:05.219264 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a2005f-9870-4344-805a-c95707811408 None admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:05.219745 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a2005f-9870-4344-805a-c95707811408 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:05.220247 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a2005f-9870-4344-805a-c95707811408 None admin] PATH_INFO: `/v3/projects/42b2443f228149a79b5bc408193a96bb/users/9360b53adb4948f897840f4ee7d0144c/roles/cd5b42ed3b754b58817a62bbe74651b4` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:05.228589 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 123/256] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:13:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 10:13:05.231402 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a2005f-9870-4344-805a-c95707811408 None admin] RBAC: Authorizing `identity:create_grant(project_id=42b2443f228149a79b5bc408193a96bb, user_id=9360b53adb4948f897840f4ee7d0144c, role_id=cd5b42ed3b754b58817a62bbe74651b4)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:05.234139 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a2005f-9870-4344-805a-c95707811408 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:05.268525 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 134/257] 10.222.0.66 () {58 vars in 1439 bytes} [Mon Sep 19 10:13:04 2022] PUT /identity/v3/projects/42b2443f228149a79b5bc408193a96bb/users/9360b53adb4948f897840f4ee7d0144c/roles/cd5b42ed3b754b58817a62bbe74651b4 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:13:05.333103 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcfdfb1-6d2e-479e-bc86-371493ee7c6a None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:05.425055 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:05.468567 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcfdfb1-6d2e-479e-bc86-371493ee7c6a None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:05.506068 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae48118-ab8a-4800-a04c-4a2201de0e3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:05.506772 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae48118-ab8a-4800-a04c-4a2201de0e3b None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:05.507056 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae48118-ab8a-4800-a04c-4a2201de0e3b None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:05.507327 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae48118-ab8a-4800-a04c-4a2201de0e3b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:05.518973 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae48118-ab8a-4800-a04c-4a2201de0e3b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 10:13:05.524511 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-4ae48118-ab8a-4800-a04c-4a2201de0e3b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 10:13:05.524511 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:13:05.524511 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:13:05.524511 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:13:05.524511 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:13:05.524511 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:13:05.524511 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:13:05.524511 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:13:05.524511 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:13:05.524511 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:13:05.524511 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:13:05.524511 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:13:05.524511 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 10:13:05.524511 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 10:13:05.524511 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 10:13:05.524511 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 10:13:05.525421 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 10:13:05.525421 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 10:13:05.525421 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 10:13:05.525421 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 10:13:05.525421 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:13:05.525421 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:13:05.525421 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:13:05.525421 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:13:05.525421 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:13:05.525421 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:13:05.525421 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:13:05.525421 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Sep 19 10:13:05.525421 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:13:05.525421 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:13:05.525421 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:13:05.525421 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:13:05.526819 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:13:05.526819 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:13:05.526819 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:13:05.526819 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:13:05.526819 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 10:13:05.526819 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 10:13:05.526819 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 10:13:05.526819 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 10:13:05.526819 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 10:13:05.526819 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 10:13:05.526819 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 10:13:05.526819 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Sep 19 10:13:05.526819 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 124/258] 10.222.0.66 () {56 vars in 1114 bytes} [Mon Sep 19 10:13:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:13:05.533494 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a2005f-9870-4344-805a-c95707811408 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:05.702916 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a2005f-9870-4344-805a-c95707811408 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:05.725856 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae48118-ab8a-4800-a04c-4a2201de0e3b None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:05.775713 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a11be27-d307-4853-80b2-eb3d20e18cea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:05.776725 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a11be27-d307-4853-80b2-eb3d20e18cea None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:05.777206 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a11be27-d307-4853-80b2-eb3d20e18cea None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:05.777695 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a11be27-d307-4853-80b2-eb3d20e18cea None admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:05.778613 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a11be27-d307-4853-80b2-eb3d20e18cea None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:13:05.779136 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a11be27-d307-4853-80b2-eb3d20e18cea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:05.780770 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a11be27-d307-4853-80b2-eb3d20e18cea None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:05.800250 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 135/259] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Sep 19 10:13:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:13:05.807452 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a11be27-d307-4853-80b2-eb3d20e18cea None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:05.840512 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:05.873650 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae48118-ab8a-4800-a04c-4a2201de0e3b None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:05.926945 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:05.953583 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84ae6f8-30e8-4df7-8808-916db1591100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:05.954161 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84ae6f8-30e8-4df7-8808-916db1591100 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:05.954440 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84ae6f8-30e8-4df7-8808-916db1591100 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:05.954711 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84ae6f8-30e8-4df7-8808-916db1591100 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:05.973182 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84ae6f8-30e8-4df7-8808-916db1591100 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 10:13:05.978459 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-b84ae6f8-30e8-4df7-8808-916db1591100 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 10:13:05.978459 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:13:05.978459 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:13:05.978459 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:13:05.978459 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:13:05.978459 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:13:05.978459 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:13:05.978459 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:13:05.978459 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:13:05.978459 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:13:05.978459 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:13:05.978459 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:13:05.978459 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 10:13:05.978459 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 10:13:05.978459 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 10:13:05.978459 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 10:13:05.979444 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 10:13:05.979444 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 10:13:05.979444 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 10:13:05.979444 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 10:13:05.979444 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:13:05.979444 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:13:05.979444 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:13:05.979444 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:13:05.979444 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:13:05.979444 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:13:05.979444 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:13:05.979444 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Sep 19 10:13:05.979444 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:13:05.979444 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:13:05.979444 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:13:05.979444 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:13:05.980270 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:13:05.980270 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:13:05.980270 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:13:05.980270 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:13:05.980270 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 10:13:05.980270 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 10:13:05.980270 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 10:13:05.980270 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 10:13:05.980270 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 10:13:05.980270 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 10:13:05.980270 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 10:13:05.980270 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Sep 19 10:13:05.982662 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 125/260] 10.222.0.66 () {56 vars in 1096 bytes} [Mon Sep 19 10:13:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 10:13:05.987093 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a11be27-d307-4853-80b2-eb3d20e18cea None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:05.988309 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84ae6f8-30e8-4df7-8808-916db1591100 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:06.032199 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b564b1e8-90b1-4017-aea8-c62984cc271b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:06.032860 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b564b1e8-90b1-4017-aea8-c62984cc271b None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:06.033144 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b564b1e8-90b1-4017-aea8-c62984cc271b None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:06.033418 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b564b1e8-90b1-4017-aea8-c62984cc271b None admin] PATH_INFO: `/v3/users/678deb3a6fa04810b3003e9fabad2b25` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:06.037988 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b564b1e8-90b1-4017-aea8-c62984cc271b None admin] RBAC: Authorizing `identity:get_user(user_id=678deb3a6fa04810b3003e9fabad2b25)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:06.037988 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b564b1e8-90b1-4017-aea8-c62984cc271b None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:06.038324 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 136/261] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Sep 19 10:13:05 2022] GET /identity/v3/users/678deb3a6fa04810b3003e9fabad2b25 => generated 283 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 10:13:06.046845 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b564b1e8-90b1-4017-aea8-c62984cc271b None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:06.232280 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:06.239386 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b564b1e8-90b1-4017-aea8-c62984cc271b None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:06.276158 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf697bb-a6cf-467e-a69c-bfbd3544a4b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:06.277028 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84ae6f8-30e8-4df7-8808-916db1591100 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:06.277439 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf697bb-a6cf-467e-a69c-bfbd3544a4b9 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:06.278058 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf697bb-a6cf-467e-a69c-bfbd3544a4b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:06.278546 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf697bb-a6cf-467e-a69c-bfbd3544a4b9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:06.355338 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3582e84f-0ae8-4a3b-b9d3-deea6ee746d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:06.356348 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3582e84f-0ae8-4a3b-b9d3-deea6ee746d7 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:06.356852 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3582e84f-0ae8-4a3b-b9d3-deea6ee746d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:06.357323 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3582e84f-0ae8-4a3b-b9d3-deea6ee746d7 None admin] PATH_INFO: `/v3/roles` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:06.358207 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3582e84f-0ae8-4a3b-b9d3-deea6ee746d7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:13:06.358706 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3582e84f-0ae8-4a3b-b9d3-deea6ee746d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:06.360321 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3582e84f-0ae8-4a3b-b9d3-deea6ee746d7 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:06.377491 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 126/262] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Sep 19 10:13:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 390 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:13:06.383709 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3582e84f-0ae8-4a3b-b9d3-deea6ee746d7 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:06.414831 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf697bb-a6cf-467e-a69c-bfbd3544a4b9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:06.417434 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf697bb-a6cf-467e-a69c-bfbd3544a4b9 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:06.484618 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:06.540609 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:06.554997 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 137/263] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Sep 19 10:13:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 509 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 19 10:13:06.560510 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf697bb-a6cf-467e-a69c-bfbd3544a4b9 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:06.617755 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3582e84f-0ae8-4a3b-b9d3-deea6ee746d7 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:06.659603 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf697bb-a6cf-467e-a69c-bfbd3544a4b9 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:06.719495 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8c00de-8e7d-4d75-b491-11b1bc17ae45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:06.719791 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d7f81e-3b6f-4878-9067-c025ed7b2f92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:06.720269 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8c00de-8e7d-4d75-b491-11b1bc17ae45 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:06.720453 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8c00de-8e7d-4d75-b491-11b1bc17ae45 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:06.720728 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8c00de-8e7d-4d75-b491-11b1bc17ae45 None admin] PATH_INFO: `/v3/users/678deb3a6fa04810b3003e9fabad2b25` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:06.720834 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d7f81e-3b6f-4878-9067-c025ed7b2f92 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:06.721181 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d7f81e-3b6f-4878-9067-c025ed7b2f92 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:06.721552 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d7f81e-3b6f-4878-9067-c025ed7b2f92 None admin] PATH_INFO: `/v3/projects/42b2443f228149a79b5bc408193a96bb` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:06.721891 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8c00de-8e7d-4d75-b491-11b1bc17ae45 None admin] RBAC: Authorizing `identity:get_user(user_id=678deb3a6fa04810b3003e9fabad2b25)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:06.722879 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d7f81e-3b6f-4878-9067-c025ed7b2f92 None admin] RBAC: Authorizing `identity:get_project(project_id=42b2443f228149a79b5bc408193a96bb)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:06.723352 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8c00de-8e7d-4d75-b491-11b1bc17ae45 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:06.724545 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d7f81e-3b6f-4878-9067-c025ed7b2f92 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:06.725580 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 127/264] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Sep 19 10:13:06 2022] GET /identity/v3/users/678deb3a6fa04810b3003e9fabad2b25 => generated 283 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:13:06.727115 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 138/265] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Sep 19 10:13:06 2022] GET /identity/v3/projects/42b2443f228149a79b5bc408193a96bb => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:13:06.733189 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8c00de-8e7d-4d75-b491-11b1bc17ae45 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:06.734740 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d7f81e-3b6f-4878-9067-c025ed7b2f92 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:06.814289 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:06.894780 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d7f81e-3b6f-4878-9067-c025ed7b2f92 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:06.955727 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b088b8-7794-4d43-8fdb-e93c3451b8ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:06.956366 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b088b8-7794-4d43-8fdb-e93c3451b8ce None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:06.956646 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b088b8-7794-4d43-8fdb-e93c3451b8ce None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:06.956912 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b088b8-7794-4d43-8fdb-e93c3451b8ce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:06.957637 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b088b8-7794-4d43-8fdb-e93c3451b8ce None admin] RBAC: Adding query filter params (role.id=43fe0942f9c9486ca3e7c83be55eb915, scope.project.id=42b2443f228149a79b5bc408193a96bb, user.id=678deb3a6fa04810b3003e9fabad2b25) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:13:06.957938 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b088b8-7794-4d43-8fdb-e93c3451b8ce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:06.959925 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b088b8-7794-4d43-8fdb-e93c3451b8ce None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:06.976486 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 139/266] 10.222.0.66 () {56 vars in 1374 bytes} [Mon Sep 19 10:13:06 2022] GET /identity/v3/role_assignments?user.id=678deb3a6fa04810b3003e9fabad2b25&scope.project.id=42b2443f228149a79b5bc408193a96bb&role.id=43fe0942f9c9486ca3e7c83be55eb915 => generated 608 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:13:06.987504 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8c00de-8e7d-4d75-b491-11b1bc17ae45 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:07.016745 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:07.046080 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b927fb1-f9b7-4a95-b491-af7d0f30b36d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:07.046724 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b927fb1-f9b7-4a95-b491-af7d0f30b36d None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:07.047000 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b927fb1-f9b7-4a95-b491-af7d0f30b36d None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:07.047271 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b927fb1-f9b7-4a95-b491-af7d0f30b36d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:07.142267 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b927fb1-f9b7-4a95-b491-af7d0f30b36d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:07.143760 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b927fb1-f9b7-4a95-b491-af7d0f30b36d None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:07.272212 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 128/267] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Sep 19 10:13:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 538 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 10:13:07.278099 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b088b8-7794-4d43-8fdb-e93c3451b8ce None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:07.426383 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b088b8-7794-4d43-8fdb-e93c3451b8ce None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:07.441893 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:07.470035 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5680952-9e4b-40e9-947c-d43c979865a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:07.470685 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5680952-9e4b-40e9-947c-d43c979865a1 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:07.470967 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5680952-9e4b-40e9-947c-d43c979865a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:07.471249 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5680952-9e4b-40e9-947c-d43c979865a1 None admin] PATH_INFO: `/v3/projects/42b2443f228149a79b5bc408193a96bb` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:07.474167 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5680952-9e4b-40e9-947c-d43c979865a1 None admin] RBAC: Authorizing `identity:get_project(project_id=42b2443f228149a79b5bc408193a96bb)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:07.475872 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5680952-9e4b-40e9-947c-d43c979865a1 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:07.477640 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 140/268] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Sep 19 10:13:07 2022] GET /identity/v3/projects/42b2443f228149a79b5bc408193a96bb => generated 302 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:13:07.483780 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b927fb1-f9b7-4a95-b491-af7d0f30b36d None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:07.509775 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa00b38-cc6f-44b0-ba31-4402cf7982b1 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:07.510085 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa00b38-cc6f-44b0-ba31-4402cf7982b1 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:07.510337 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa00b38-cc6f-44b0-ba31-4402cf7982b1 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:07.511689 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 141/269] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:13:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:13:07.514545 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:07.521327 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01be82ff-5695-440a-b508-4223aea9ca52 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:07.521627 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01be82ff-5695-440a-b508-4223aea9ca52 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:07.521908 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01be82ff-5695-440a-b508-4223aea9ca52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:07.542207 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-01be82ff-5695-440a-b508-4223aea9ca52 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:13:07.543438 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-01be82ff-5695-440a-b508-4223aea9ca52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:13:07.657312 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 142/270] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:13:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 10:13:07.673764 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b927fb1-f9b7-4a95-b491-af7d0f30b36d None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:07.717362 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1890c35c-1382-4029-b99e-dad8cf469c13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:07.718272 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1890c35c-1382-4029-b99e-dad8cf469c13 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:07.718558 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1890c35c-1382-4029-b99e-dad8cf469c13 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:07.718832 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1890c35c-1382-4029-b99e-dad8cf469c13 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:07.719566 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1890c35c-1382-4029-b99e-dad8cf469c13 None admin] RBAC: Adding query filter params (role.id=5c8b89fae4fa45bd944cbeaf442136e1, scope.project.id=42b2443f228149a79b5bc408193a96bb, user.id=678deb3a6fa04810b3003e9fabad2b25) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:13:07.719875 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1890c35c-1382-4029-b99e-dad8cf469c13 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:07.721381 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1890c35c-1382-4029-b99e-dad8cf469c13 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:07.728135 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 129/271] 10.222.0.66 () {56 vars in 1374 bytes} [Mon Sep 19 10:13:07 2022] GET /identity/v3/role_assignments?user.id=678deb3a6fa04810b3003e9fabad2b25&scope.project.id=42b2443f228149a79b5bc408193a96bb&role.id=5c8b89fae4fa45bd944cbeaf442136e1 => generated 608 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:13:08.013133 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01be82ff-5695-440a-b508-4223aea9ca52 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:08.069272 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ae2d87-64c8-4dcd-840b-9056f46e1381 None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:08.069811 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ae2d87-64c8-4dcd-840b-9056f46e1381 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:08.069811 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ae2d87-64c8-4dcd-840b-9056f46e1381 None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:08.071398 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 130/272] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:13:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 10:13:08.081064 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec24483-a0cf-4724-8f57-c044f5f7dbad None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:08.081350 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec24483-a0cf-4724-8f57-c044f5f7dbad None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:08.081636 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec24483-a0cf-4724-8f57-c044f5f7dbad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:08.103203 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-0ec24483-a0cf-4724-8f57-c044f5f7dbad None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:13:08.104676 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-0ec24483-a0cf-4724-8f57-c044f5f7dbad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:13:08.136845 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01be82ff-5695-440a-b508-4223aea9ca52 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:08.153621 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:08.182441 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff7d267-562e-41bb-bc63-2c89c8f06784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:08.183407 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff7d267-562e-41bb-bc63-2c89c8f06784 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:08.183835 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff7d267-562e-41bb-bc63-2c89c8f06784 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:08.184288 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff7d267-562e-41bb-bc63-2c89c8f06784 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:08.192040 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 131/273] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:13:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 10:13:08.201588 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff7d267-562e-41bb-bc63-2c89c8f06784 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 10:13:08.207443 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-9ff7d267-562e-41bb-bc63-2c89c8f06784 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 19 10:13:08.207443 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:13:08.207443 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:13:08.207443 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:13:08.207443 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:13:08.207443 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:13:08.207443 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:13:08.207443 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:13:08.207443 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:13:08.207443 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:13:08.207443 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:13:08.207443 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:13:08.207443 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 10:13:08.207443 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 10:13:08.207443 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 10:13:08.207443 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 10:13:08.208352 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 10:13:08.208352 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 10:13:08.208352 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 10:13:08.208352 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 10:13:08.208352 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:13:08.208352 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:13:08.208352 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:13:08.208352 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:13:08.208352 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:13:08.208352 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:13:08.208352 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:13:08.208352 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 19 10:13:08.208352 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:13:08.208352 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:13:08.208352 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:13:08.208352 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:13:08.209228 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:13:08.209228 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:13:08.209228 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:13:08.209228 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:13:08.209228 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 10:13:08.209228 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 10:13:08.209228 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 10:13:08.209228 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 10:13:08.209228 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 10:13:08.209228 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 10:13:08.209228 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 19 10:13:08.209228 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 19 10:13:08.211986 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 143/274] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Sep 19 10:13:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:13:08.217456 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec24483-a0cf-4724-8f57-c044f5f7dbad None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:08.234559 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:08.305859 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e70e254-290b-42de-8eea-ec7031eafed5 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:08.306281 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e70e254-290b-42de-8eea-ec7031eafed5 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:08.306633 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e70e254-290b-42de-8eea-ec7031eafed5 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:08.308831 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 144/275] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:13:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:13:08.328218 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a7f193-a13c-40ab-b73e-2a5e41f63567 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:08.328588 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a7f193-a13c-40ab-b73e-2a5e41f63567 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:08.328937 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a7f193-a13c-40ab-b73e-2a5e41f63567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:08.336672 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec24483-a0cf-4724-8f57-c044f5f7dbad None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:08.348627 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-e2a7f193-a13c-40ab-b73e-2a5e41f63567 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:13:08.350666 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-e2a7f193-a13c-40ab-b73e-2a5e41f63567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:13:08.377870 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182808b2-6411-4f99-9771-3cca2aff2c9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:08.379324 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182808b2-6411-4f99-9771-3cca2aff2c9d None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:08.379758 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182808b2-6411-4f99-9771-3cca2aff2c9d None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:08.380477 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182808b2-6411-4f99-9771-3cca2aff2c9d None admin] PATH_INFO: `/v3/roles` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:08.381376 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182808b2-6411-4f99-9771-3cca2aff2c9d None admin] RBAC: Adding query filter params (name=member) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:13:08.382091 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182808b2-6411-4f99-9771-3cca2aff2c9d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:08.384567 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182808b2-6411-4f99-9771-3cca2aff2c9d None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:08.398997 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 132/276] 10.222.0.66 () {56 vars in 1101 bytes} [Mon Sep 19 10:13:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:13:08.404939 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182808b2-6411-4f99-9771-3cca2aff2c9d None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:08.429189 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 145/277] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:13:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 10:13:08.487000 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:08.512419 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182808b2-6411-4f99-9771-3cca2aff2c9d None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:08.520509 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a7f193-a13c-40ab-b73e-2a5e41f63567 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:08.558285 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753b173d-8d4e-45bb-9187-74c2b301937e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:08.559521 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753b173d-8d4e-45bb-9187-74c2b301937e None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:08.560025 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753b173d-8d4e-45bb-9187-74c2b301937e None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:08.560499 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753b173d-8d4e-45bb-9187-74c2b301937e None admin] PATH_INFO: `/v3/users/cf59020a5787493ab0461175ab88b6b1` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:08.582797 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753b173d-8d4e-45bb-9187-74c2b301937e None admin] RBAC: Authorizing `identity:get_user(user_id=cf59020a5787493ab0461175ab88b6b1)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:08.585159 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753b173d-8d4e-45bb-9187-74c2b301937e None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:08.587898 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 133/278] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Sep 19 10:13:08 2022] GET /identity/v3/users/cf59020a5787493ab0461175ab88b6b1 => generated 293 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 10:13:08.597884 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753b173d-8d4e-45bb-9187-74c2b301937e None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:08.641516 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a7f193-a13c-40ab-b73e-2a5e41f63567 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:08.643516 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:08.688321 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f369b8d-e692-4134-b484-0904c6f8772c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:08.689113 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f369b8d-e692-4134-b484-0904c6f8772c None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:08.689584 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f369b8d-e692-4134-b484-0904c6f8772c None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:08.690218 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f369b8d-e692-4134-b484-0904c6f8772c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:08.691125 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f369b8d-e692-4134-b484-0904c6f8772c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:08.692626 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f369b8d-e692-4134-b484-0904c6f8772c None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:08.694673 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 146/279] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 19 10:13:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 10:13:08.700368 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e02af9-20cc-4681-990d-75be4644fcfb None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:08.700490 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e02af9-20cc-4681-990d-75be4644fcfb None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:08.700741 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e02af9-20cc-4681-990d-75be4644fcfb None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:08.704347 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 147/280] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:13:08 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:13:08.704347 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e02af9-20cc-4681-990d-75be4644fcfb None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:08.714007 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753b173d-8d4e-45bb-9187-74c2b301937e None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:08.744646 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:08.750058 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb5f08c-ea1d-46aa-b1d1-e9147647ab57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:08.750991 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb5f08c-ea1d-46aa-b1d1-e9147647ab57 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:08.751273 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb5f08c-ea1d-46aa-b1d1-e9147647ab57 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:08.751546 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb5f08c-ea1d-46aa-b1d1-e9147647ab57 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:08.752304 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb5f08c-ea1d-46aa-b1d1-e9147647ab57 None admin] RBAC: Adding query filter params (role.id=cd5b42ed3b754b58817a62bbe74651b4, user.id=cf59020a5787493ab0461175ab88b6b1, scope.system=all) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:13:08.752616 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb5f08c-ea1d-46aa-b1d1-e9147647ab57 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:08.754082 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb5f08c-ea1d-46aa-b1d1-e9147647ab57 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:08.759148 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 134/281] 10.222.0.66 () {56 vars in 1308 bytes} [Mon Sep 19 10:13:08 2022] GET /identity/v3/role_assignments?user.id=cf59020a5787493ab0461175ab88b6b1&scope.system=all&role.id=cd5b42ed3b754b58817a62bbe74651b4 => generated 226 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:13:08.764630 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112d024f-3e73-49b5-821a-0079829c83a0 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:08.765003 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112d024f-3e73-49b5-821a-0079829c83a0 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:08.765279 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112d024f-3e73-49b5-821a-0079829c83a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:08.785193 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-112d024f-3e73-49b5-821a-0079829c83a0 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:13:08.786421 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-112d024f-3e73-49b5-821a-0079829c83a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:13:08.819102 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e02af9-20cc-4681-990d-75be4644fcfb None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:08.856616 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9579ebea-5768-41a5-80be-ec3b4613d020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:08.857304 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9579ebea-5768-41a5-80be-ec3b4613d020 None admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:08.857515 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9579ebea-5768-41a5-80be-ec3b4613d020 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:08.857780 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9579ebea-5768-41a5-80be-ec3b4613d020 None admin] PATH_INFO: `/v3/users` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:08.858442 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9579ebea-5768-41a5-80be-ec3b4613d020 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:08.859913 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9579ebea-5768-41a5-80be-ec3b4613d020 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:08.870412 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 135/282] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:13:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 10:13:08.871817 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112d024f-3e73-49b5-821a-0079829c83a0 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:08.896014 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 148/283] 10.222.0.66 () {60 vars in 1132 bytes} [Mon Sep 19 10:13:08 2022] POST /identity/v3/users => generated 293 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:13:09.022219 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112d024f-3e73-49b5-821a-0079829c83a0 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:09.052484 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:09.066240 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f58d5c0-67b1-41e5-b8f8-333a5b42cc1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:09.066900 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f58d5c0-67b1-41e5-b8f8-333a5b42cc1b None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:09.067183 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f58d5c0-67b1-41e5-b8f8-333a5b42cc1b None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:09.067458 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f58d5c0-67b1-41e5-b8f8-333a5b42cc1b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:09.082477 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f58d5c0-67b1-41e5-b8f8-333a5b42cc1b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 10:13:09.087539 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-0f58d5c0-67b1-41e5-b8f8-333a5b42cc1b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 19 10:13:09.087539 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:13:09.087539 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:13:09.087539 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:13:09.087539 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:13:09.087539 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:13:09.087539 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:13:09.087539 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:13:09.087539 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:13:09.087539 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:13:09.087539 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:13:09.087539 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:13:09.087539 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 10:13:09.087539 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 10:13:09.087539 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 10:13:09.087539 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 10:13:09.088534 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 10:13:09.088534 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 10:13:09.088534 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 10:13:09.088534 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 10:13:09.088534 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:13:09.088534 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:13:09.088534 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:13:09.088534 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:13:09.088534 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:13:09.088534 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:13:09.088534 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:13:09.088534 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Sep 19 10:13:09.088534 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:13:09.088534 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:13:09.088534 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:13:09.088534 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:13:09.089588 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:13:09.089588 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:13:09.089588 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:13:09.089588 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:13:09.089588 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 10:13:09.089588 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 10:13:09.089588 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 10:13:09.089588 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 10:13:09.089588 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 10:13:09.089588 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 10:13:09.089588 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 19 10:13:09.089588 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Sep 19 10:13:09.089588 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 136/284] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Sep 19 10:13:08 2022] GET /identity/v3/roles/reader => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:13:09.094717 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9579ebea-5768-41a5-80be-ec3b4613d020 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:09.130208 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:09.170553 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f58d5c0-67b1-41e5-b8f8-333a5b42cc1b None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:09.216861 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9579ebea-5768-41a5-80be-ec3b4613d020 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:09.259591 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f369094-8ed1-4b3b-bbe2-3d10146ea062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:09.260373 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f369094-8ed1-4b3b-bbe2-3d10146ea062 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:09.260654 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f369094-8ed1-4b3b-bbe2-3d10146ea062 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:09.261445 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f369094-8ed1-4b3b-bbe2-3d10146ea062 None admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:09.261705 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f369094-8ed1-4b3b-bbe2-3d10146ea062 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:13:09.262007 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f369094-8ed1-4b3b-bbe2-3d10146ea062 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:09.263399 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f369094-8ed1-4b3b-bbe2-3d10146ea062 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:09.275953 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 149/285] 10.222.0.66 () {56 vars in 1101 bytes} [Mon Sep 19 10:13:09 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:13:09.283206 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f369094-8ed1-4b3b-bbe2-3d10146ea062 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:09.301932 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f58d5c0-67b1-41e5-b8f8-333a5b42cc1b None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:09.344647 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c86f329-2d15-4f7b-b883-be51d972e5c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:09.345312 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c86f329-2d15-4f7b-b883-be51d972e5c5 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:09.345652 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c86f329-2d15-4f7b-b883-be51d972e5c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:09.346004 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c86f329-2d15-4f7b-b883-be51d972e5c5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:09.357782 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c86f329-2d15-4f7b-b883-be51d972e5c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 10:13:09.362843 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-7c86f329-2d15-4f7b-b883-be51d972e5c5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 19 10:13:09.362843 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:13:09.362843 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:13:09.362843 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:13:09.362843 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:13:09.362843 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:13:09.362843 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:13:09.362843 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:13:09.362843 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:13:09.362843 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:13:09.362843 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:13:09.362843 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:13:09.362843 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 10:13:09.362843 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 10:13:09.362843 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 10:13:09.362843 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 10:13:09.363749 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 10:13:09.363749 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 10:13:09.363749 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 10:13:09.363749 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 10:13:09.363749 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:13:09.363749 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:13:09.363749 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:13:09.363749 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:13:09.363749 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:13:09.363749 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:13:09.363749 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:13:09.363749 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Sep 19 10:13:09.363749 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:13:09.363749 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:13:09.363749 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:13:09.363749 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:13:09.364556 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:13:09.364556 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:13:09.364556 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:13:09.364556 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:13:09.364556 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 10:13:09.364556 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 10:13:09.364556 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 10:13:09.364556 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 10:13:09.364556 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 10:13:09.364556 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 10:13:09.364556 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 19 10:13:09.364556 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Sep 19 10:13:09.364556 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 137/286] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Sep 19 10:13:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 10:13:09.370079 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c86f329-2d15-4f7b-b883-be51d972e5c5 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:09.408615 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:09.427702 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:09.435223 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f369094-8ed1-4b3b-bbe2-3d10146ea062 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:09.480578 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24430d06-8c85-4342-85aa-76b55469c50d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:09.481865 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24430d06-8c85-4342-85aa-76b55469c50d None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:09.482208 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24430d06-8c85-4342-85aa-76b55469c50d None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:09.482496 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24430d06-8c85-4342-85aa-76b55469c50d None admin] PATH_INFO: `/v3/users/fad23c4571054ca8a153cf1811813d1b` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:09.483918 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24430d06-8c85-4342-85aa-76b55469c50d None admin] RBAC: Authorizing `identity:get_user(user_id=fad23c4571054ca8a153cf1811813d1b)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:09.486094 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24430d06-8c85-4342-85aa-76b55469c50d None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:09.488718 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 150/287] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Sep 19 10:13:09 2022] GET /identity/v3/users/fad23c4571054ca8a153cf1811813d1b => generated 297 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 10:13:09.495921 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24430d06-8c85-4342-85aa-76b55469c50d None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:09.498623 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c86f329-2d15-4f7b-b883-be51d972e5c5 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:09.533912 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f161e23b-da32-4f0a-81f6-e2727e151694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:09.534682 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f161e23b-da32-4f0a-81f6-e2727e151694 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:09.535107 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f161e23b-da32-4f0a-81f6-e2727e151694 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:09.535469 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f161e23b-da32-4f0a-81f6-e2727e151694 None admin] PATH_INFO: `/v3/roles` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:09.536348 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f161e23b-da32-4f0a-81f6-e2727e151694 None admin] RBAC: Adding query filter params (name=member) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:13:09.536742 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f161e23b-da32-4f0a-81f6-e2727e151694 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:09.538805 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f161e23b-da32-4f0a-81f6-e2727e151694 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:09.547981 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 138/288] 10.222.0.66 () {56 vars in 1101 bytes} [Mon Sep 19 10:13:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:13:09.554701 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f161e23b-da32-4f0a-81f6-e2727e151694 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:09.635603 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24430d06-8c85-4342-85aa-76b55469c50d None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:09.674788 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ee12ad-bebf-4db6-88c5-b9dfa1ed9bd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:09.675433 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ee12ad-bebf-4db6-88c5-b9dfa1ed9bd2 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:09.675714 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ee12ad-bebf-4db6-88c5-b9dfa1ed9bd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:09.675987 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ee12ad-bebf-4db6-88c5-b9dfa1ed9bd2 None admin] PATH_INFO: `/v3/projects/42b2443f228149a79b5bc408193a96bb` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:09.677754 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ee12ad-bebf-4db6-88c5-b9dfa1ed9bd2 None admin] RBAC: Authorizing `identity:get_project(project_id=42b2443f228149a79b5bc408193a96bb)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:09.679347 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ee12ad-bebf-4db6-88c5-b9dfa1ed9bd2 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:09.681467 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 151/289] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Sep 19 10:13:09 2022] GET /identity/v3/projects/42b2443f228149a79b5bc408193a96bb => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:13:09.688383 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ee12ad-bebf-4db6-88c5-b9dfa1ed9bd2 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:09.725247 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:09.750697 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f161e23b-da32-4f0a-81f6-e2727e151694 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:09.764514 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:09.808428 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc90ebdb-0677-4f3b-9989-812dfab681bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:09.809075 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc90ebdb-0677-4f3b-9989-812dfab681bd None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:09.809354 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc90ebdb-0677-4f3b-9989-812dfab681bd None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:09.809626 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc90ebdb-0677-4f3b-9989-812dfab681bd None admin] PATH_INFO: `/v3/users/9360b53adb4948f897840f4ee7d0144c` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:09.814723 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc90ebdb-0677-4f3b-9989-812dfab681bd None admin] RBAC: Authorizing `identity:get_user(user_id=9360b53adb4948f897840f4ee7d0144c)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:09.816245 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc90ebdb-0677-4f3b-9989-812dfab681bd None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:09.822125 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 139/290] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Sep 19 10:13:09 2022] GET /identity/v3/users/9360b53adb4948f897840f4ee7d0144c => generated 297 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:13:09.827993 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc90ebdb-0677-4f3b-9989-812dfab681bd None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:09.870348 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ee12ad-bebf-4db6-88c5-b9dfa1ed9bd2 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:09.926351 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9e7a5b-0a70-4f59-8eac-ce5cd5e1e541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:09.927376 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9e7a5b-0a70-4f59-8eac-ce5cd5e1e541 None admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:09.927907 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9e7a5b-0a70-4f59-8eac-ce5cd5e1e541 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:09.928433 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9e7a5b-0a70-4f59-8eac-ce5cd5e1e541 None admin] PATH_INFO: `/v3/projects/42b2443f228149a79b5bc408193a96bb/users/fad23c4571054ca8a153cf1811813d1b/roles/6c2e7a94daa04d7695a6fa91e5cca692` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:09.931404 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9e7a5b-0a70-4f59-8eac-ce5cd5e1e541 None admin] RBAC: Authorizing `identity:create_grant(project_id=42b2443f228149a79b5bc408193a96bb, user_id=fad23c4571054ca8a153cf1811813d1b, role_id=6c2e7a94daa04d7695a6fa91e5cca692)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:09.933067 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9e7a5b-0a70-4f59-8eac-ce5cd5e1e541 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:09.956325 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 152/291] 10.222.0.66 () {58 vars in 1439 bytes} [Mon Sep 19 10:13:09 2022] PUT /identity/v3/projects/42b2443f228149a79b5bc408193a96bb/users/fad23c4571054ca8a153cf1811813d1b/roles/6c2e7a94daa04d7695a6fa91e5cca692 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:13:10.007576 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc90ebdb-0677-4f3b-9989-812dfab681bd None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:10.045655 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75d7771-27d7-4ba6-a1e0-aef910a02d8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:10.046741 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75d7771-27d7-4ba6-a1e0-aef910a02d8f None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:10.047219 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75d7771-27d7-4ba6-a1e0-aef910a02d8f None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:10.047757 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75d7771-27d7-4ba6-a1e0-aef910a02d8f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:10.117835 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:10.152070 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75d7771-27d7-4ba6-a1e0-aef910a02d8f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:10.154013 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75d7771-27d7-4ba6-a1e0-aef910a02d8f None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:10.261904 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 140/292] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Sep 19 10:13:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 19 10:13:10.267748 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9e7a5b-0a70-4f59-8eac-ce5cd5e1e541 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:10.360841 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:10.377647 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9e7a5b-0a70-4f59-8eac-ce5cd5e1e541 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:10.413115 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e488aafa-cead-46ff-a61c-7eae92bbbdf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:10.413755 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e488aafa-cead-46ff-a61c-7eae92bbbdf8 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:10.414032 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e488aafa-cead-46ff-a61c-7eae92bbbdf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:10.414302 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e488aafa-cead-46ff-a61c-7eae92bbbdf8 None admin] PATH_INFO: `/v3/projects/42b2443f228149a79b5bc408193a96bb` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:10.415443 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e488aafa-cead-46ff-a61c-7eae92bbbdf8 None admin] RBAC: Authorizing `identity:get_project(project_id=42b2443f228149a79b5bc408193a96bb)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:10.416928 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e488aafa-cead-46ff-a61c-7eae92bbbdf8 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:10.418561 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 153/293] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Sep 19 10:13:10 2022] GET /identity/v3/projects/42b2443f228149a79b5bc408193a96bb => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:13:10.424761 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75d7771-27d7-4ba6-a1e0-aef910a02d8f None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:10.504180 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:10.528882 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75d7771-27d7-4ba6-a1e0-aef910a02d8f None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:10.564614 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a6b61a-0868-4b06-bac3-86df2728fd88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:10.565222 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a6b61a-0868-4b06-bac3-86df2728fd88 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:10.565499 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a6b61a-0868-4b06-bac3-86df2728fd88 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:10.565770 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a6b61a-0868-4b06-bac3-86df2728fd88 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:10.566493 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a6b61a-0868-4b06-bac3-86df2728fd88 None admin] RBAC: Adding query filter params (role.id=cd5b42ed3b754b58817a62bbe74651b4, scope.project.id=42b2443f228149a79b5bc408193a96bb, user.id=9360b53adb4948f897840f4ee7d0144c) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:13:10.567033 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a6b61a-0868-4b06-bac3-86df2728fd88 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:10.568782 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a6b61a-0868-4b06-bac3-86df2728fd88 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:10.575557 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 141/294] 10.222.0.66 () {56 vars in 1374 bytes} [Mon Sep 19 10:13:10 2022] GET /identity/v3/role_assignments?user.id=9360b53adb4948f897840f4ee7d0144c&scope.project.id=42b2443f228149a79b5bc408193a96bb&role.id=cd5b42ed3b754b58817a62bbe74651b4 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:13:11.330859 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a05a1dd-9747-41cb-93a8-f3a8ce511699 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:11.331370 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a05a1dd-9747-41cb-93a8-f3a8ce511699 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:11.331370 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a05a1dd-9747-41cb-93a8-f3a8ce511699 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:11.333022 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 154/295] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:13:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:13:11.338388 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998b63f4-acb5-48af-a457-b3f4399f9af8 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:11.338812 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998b63f4-acb5-48af-a457-b3f4399f9af8 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:11.338980 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998b63f4-acb5-48af-a457-b3f4399f9af8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:11.357104 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-998b63f4-acb5-48af-a457-b3f4399f9af8 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:13:11.358291 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-998b63f4-acb5-48af-a457-b3f4399f9af8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:13:11.431406 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 142/296] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:13:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 10:13:11.699348 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a629f8-88c6-4365-913c-8de3f5b6f781 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:11.699655 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a629f8-88c6-4365-913c-8de3f5b6f781 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:11.699907 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a629f8-88c6-4365-913c-8de3f5b6f781 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:11.701284 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 155/297] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:13:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:13:11.706575 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c18fc2b-7259-4d84-9da4-a14ffcd92a6a None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:11.706877 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c18fc2b-7259-4d84-9da4-a14ffcd92a6a None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:11.707882 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a629f8-88c6-4365-913c-8de3f5b6f781 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:11.708320 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c18fc2b-7259-4d84-9da4-a14ffcd92a6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:11.732013 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-9c18fc2b-7259-4d84-9da4-a14ffcd92a6a None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:13:11.733830 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-9c18fc2b-7259-4d84-9da4-a14ffcd92a6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:13:11.816262 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:11.822444 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 143/298] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:13:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 10:13:11.824411 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3149e45b-67a1-49fd-9d2b-253aafc9edf7 None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:11.824756 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3149e45b-67a1-49fd-9d2b-253aafc9edf7 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:11.825132 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3149e45b-67a1-49fd-9d2b-253aafc9edf7 None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:11.825484 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a629f8-88c6-4365-913c-8de3f5b6f781 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:11.828292 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 144/299] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:13:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:13:11.831996 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f572af-5055-423a-a91c-4afe4080ef63 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:11.832426 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f572af-5055-423a-a91c-4afe4080ef63 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:11.832781 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f572af-5055-423a-a91c-4afe4080ef63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:11.853853 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-48f572af-5055-423a-a91c-4afe4080ef63 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:13:11.855167 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-48f572af-5055-423a-a91c-4afe4080ef63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:13:11.872013 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7c4272-00bc-4b83-aa67-a8f2e6ed951c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:11.874986 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7c4272-00bc-4b83-aa67-a8f2e6ed951c None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:11.875584 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7c4272-00bc-4b83-aa67-a8f2e6ed951c None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:11.876041 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7c4272-00bc-4b83-aa67-a8f2e6ed951c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:11.887428 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7c4272-00bc-4b83-aa67-a8f2e6ed951c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 10:13:11.893523 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-2b7c4272-00bc-4b83-aa67-a8f2e6ed951c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 19 10:13:11.893523 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:13:11.893523 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:13:11.893523 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:13:11.893523 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:13:11.893523 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:13:11.893523 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:13:11.893523 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:13:11.893523 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:13:11.893523 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:13:11.893523 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:13:11.893523 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:13:11.893523 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 10:13:11.893523 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 10:13:11.893523 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 10:13:11.893523 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 10:13:11.894409 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 10:13:11.894409 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 10:13:11.894409 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 10:13:11.894409 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 10:13:11.894409 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:13:11.894409 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:13:11.894409 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:13:11.894409 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:13:11.894409 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:13:11.894409 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:13:11.894409 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:13:11.894409 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 19 10:13:11.894409 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:13:11.894409 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:13:11.894409 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:13:11.894409 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:13:11.895487 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:13:11.895487 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:13:11.895487 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:13:11.895487 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:13:11.895487 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 10:13:11.895487 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 10:13:11.895487 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 10:13:11.895487 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 10:13:11.895487 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 10:13:11.895487 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 10:13:11.895487 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 19 10:13:11.895487 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 19 10:13:11.904679 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 156/300] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Sep 19 10:13:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 10:13:11.908843 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7c4272-00bc-4b83-aa67-a8f2e6ed951c None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:11.926066 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:11.933411 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 145/301] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:13:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 10:13:12.018980 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7c4272-00bc-4b83-aa67-a8f2e6ed951c None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:12.053694 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7814188-c5b1-4e3c-9fe7-616fdbb2bdae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:12.054309 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7814188-c5b1-4e3c-9fe7-616fdbb2bdae None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:12.054592 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7814188-c5b1-4e3c-9fe7-616fdbb2bdae None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:12.054864 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7814188-c5b1-4e3c-9fe7-616fdbb2bdae None admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:12.055522 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7814188-c5b1-4e3c-9fe7-616fdbb2bdae None admin] RBAC: Adding query filter params (name=member) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:13:12.055827 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7814188-c5b1-4e3c-9fe7-616fdbb2bdae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:12.057249 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7814188-c5b1-4e3c-9fe7-616fdbb2bdae None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:12.065433 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 157/302] 10.222.0.66 () {56 vars in 1101 bytes} [Mon Sep 19 10:13:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 10:13:12.071879 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f572af-5055-423a-a91c-4afe4080ef63 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:12.132523 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7814188-c5b1-4e3c-9fe7-616fdbb2bdae None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:12.186075 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f572af-5055-423a-a91c-4afe4080ef63 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:12.213033 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:12.216940 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:12.225146 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8c1ad1-061e-4654-8bae-3604f6240ec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:12.225797 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8c1ad1-061e-4654-8bae-3604f6240ec5 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:12.226082 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8c1ad1-061e-4654-8bae-3604f6240ec5 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:12.226353 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8c1ad1-061e-4654-8bae-3604f6240ec5 None admin] PATH_INFO: `/v3/users/cf59020a5787493ab0461175ab88b6b1` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:12.227499 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8c1ad1-061e-4654-8bae-3604f6240ec5 None admin] RBAC: Authorizing `identity:get_user(user_id=cf59020a5787493ab0461175ab88b6b1)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:12.229000 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8c1ad1-061e-4654-8bae-3604f6240ec5 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:12.230784 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 146/303] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Sep 19 10:13:12 2022] GET /identity/v3/users/cf59020a5787493ab0461175ab88b6b1 => generated 293 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:13:12.236467 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8c1ad1-061e-4654-8bae-3604f6240ec5 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:12.246543 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7814188-c5b1-4e3c-9fe7-616fdbb2bdae None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:12.284341 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8f0db5-3ab0-4208-b76b-7c846c960305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:12.284973 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8f0db5-3ab0-4208-b76b-7c846c960305 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:12.285262 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8f0db5-3ab0-4208-b76b-7c846c960305 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:12.285539 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8f0db5-3ab0-4208-b76b-7c846c960305 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:12.297113 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8f0db5-3ab0-4208-b76b-7c846c960305 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 10:13:12.302353 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-af8f0db5-3ab0-4208-b76b-7c846c960305 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 19 10:13:12.302353 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:13:12.302353 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:13:12.302353 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:13:12.302353 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:13:12.302353 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:13:12.302353 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:13:12.302353 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:13:12.302353 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:13:12.302353 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:13:12.302353 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:13:12.302353 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:13:12.302353 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 10:13:12.302353 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 10:13:12.302353 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 10:13:12.302353 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 10:13:12.303227 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 10:13:12.303227 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 10:13:12.303227 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 10:13:12.303227 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 10:13:12.303227 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:13:12.303227 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:13:12.303227 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:13:12.303227 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:13:12.303227 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:13:12.303227 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:13:12.303227 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:13:12.303227 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 19 10:13:12.303227 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:13:12.303227 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:13:12.303227 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:13:12.303227 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:13:12.304084 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:13:12.304084 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:13:12.304084 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:13:12.304084 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:13:12.304084 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 10:13:12.304084 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 10:13:12.304084 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 10:13:12.304084 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 10:13:12.304084 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 10:13:12.304084 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 10:13:12.304084 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 19 10:13:12.304084 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 19 10:13:12.304084 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 158/304] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Sep 19 10:13:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 10:13:12.304749 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8f0db5-3ab0-4208-b76b-7c846c960305 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:12.347030 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8c1ad1-061e-4654-8bae-3604f6240ec5 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:12.382592 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629fcbf2-402f-4625-924c-1fdc21a7b396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:12.383568 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629fcbf2-402f-4625-924c-1fdc21a7b396 None admin] REQUEST_METHOD: `PUT` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:12.384040 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629fcbf2-402f-4625-924c-1fdc21a7b396 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:12.384646 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629fcbf2-402f-4625-924c-1fdc21a7b396 None admin] PATH_INFO: `/v3/system/users/cf59020a5787493ab0461175ab88b6b1/roles/cd5b42ed3b754b58817a62bbe74651b4` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:12.386133 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629fcbf2-402f-4625-924c-1fdc21a7b396 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=cf59020a5787493ab0461175ab88b6b1, role_id=cd5b42ed3b754b58817a62bbe74651b4)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:12.387574 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629fcbf2-402f-4625-924c-1fdc21a7b396 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:12.397779 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 147/305] 10.222.0.66 () {58 vars in 1334 bytes} [Mon Sep 19 10:13:12 2022] PUT /identity/v3/system/users/cf59020a5787493ab0461175ab88b6b1/roles/cd5b42ed3b754b58817a62bbe74651b4 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:13:12.409218 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629fcbf2-402f-4625-924c-1fdc21a7b396 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:12.418407 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8f0db5-3ab0-4208-b76b-7c846c960305 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:12.477169 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9a33c9-88ba-42c8-a1f8-154a89007122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:12.478528 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9a33c9-88ba-42c8-a1f8-154a89007122 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:12.479580 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9a33c9-88ba-42c8-a1f8-154a89007122 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:12.480155 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9a33c9-88ba-42c8-a1f8-154a89007122 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:12.482234 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9a33c9-88ba-42c8-a1f8-154a89007122 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:12.484666 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9a33c9-88ba-42c8-a1f8-154a89007122 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:12.488444 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 159/306] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 19 10:13:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:13:12.495171 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9a33c9-88ba-42c8-a1f8-154a89007122 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:12.500374 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:12.505669 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:12.558101 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629fcbf2-402f-4625-924c-1fdc21a7b396 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:12.601489 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cc2337-3ffb-4c9a-80eb-0b99b58814c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:12.602393 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cc2337-3ffb-4c9a-80eb-0b99b58814c2 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:12.602820 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cc2337-3ffb-4c9a-80eb-0b99b58814c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:12.603231 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cc2337-3ffb-4c9a-80eb-0b99b58814c2 None admin] PATH_INFO: `/v3/roles` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:12.604287 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cc2337-3ffb-4c9a-80eb-0b99b58814c2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:13:12.604751 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cc2337-3ffb-4c9a-80eb-0b99b58814c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:12.606944 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cc2337-3ffb-4c9a-80eb-0b99b58814c2 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:12.620422 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 148/307] 10.222.0.66 () {56 vars in 1101 bytes} [Mon Sep 19 10:13:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:13:12.625836 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfd3238-adcb-49bb-8a40-5c22b9294418 None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:12.626228 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfd3238-adcb-49bb-8a40-5c22b9294418 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:12.626653 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfd3238-adcb-49bb-8a40-5c22b9294418 None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:12.628849 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 149/308] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:13:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:13:12.629688 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfd3238-adcb-49bb-8a40-5c22b9294418 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:12.650750 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9a33c9-88ba-42c8-a1f8-154a89007122 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:12.691136 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9757935d-d606-49fa-aa7b-c603fe8f3c8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:12.691862 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9757935d-d606-49fa-aa7b-c603fe8f3c8e None admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:12.692224 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9757935d-d606-49fa-aa7b-c603fe8f3c8e None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:12.692498 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9757935d-d606-49fa-aa7b-c603fe8f3c8e None admin] PATH_INFO: `/v3/groups` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:12.693158 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9757935d-d606-49fa-aa7b-c603fe8f3c8e None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:12.694594 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9757935d-d606-49fa-aa7b-c603fe8f3c8e None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:12.712670 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 160/309] 10.222.0.66 () {60 vars in 1134 bytes} [Mon Sep 19 10:13:12 2022] POST /identity/v3/groups => generated 229 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 10:13:12.713992 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12922138-b973-42fd-8d38-89ee7c07162e None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:12.714353 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12922138-b973-42fd-8d38-89ee7c07162e None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:12.714751 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12922138-b973-42fd-8d38-89ee7c07162e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:12.742533 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-12922138-b973-42fd-8d38-89ee7c07162e None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:13:12.744063 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-12922138-b973-42fd-8d38-89ee7c07162e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:13:12.768367 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfd3238-adcb-49bb-8a40-5c22b9294418 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:12.807952 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:12.821706 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8e3a2b-8d94-4935-98e4-64b37e7c0324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:12.822327 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8e3a2b-8d94-4935-98e4-64b37e7c0324 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:12.822667 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8e3a2b-8d94-4935-98e4-64b37e7c0324 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:12.822949 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8e3a2b-8d94-4935-98e4-64b37e7c0324 None admin] PATH_INFO: `/v3/users/9e136b869d3c4c989b22d6cd62557c2b` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:12.834169 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:12.841340 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8e3a2b-8d94-4935-98e4-64b37e7c0324 None admin] RBAC: Authorizing `identity:get_user(user_id=9e136b869d3c4c989b22d6cd62557c2b)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:12.844079 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8e3a2b-8d94-4935-98e4-64b37e7c0324 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:12.849896 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 150/310] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Sep 19 10:13:12 2022] GET /identity/v3/users/9e136b869d3c4c989b22d6cd62557c2b => generated 293 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:13:12.850111 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 161/311] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:13:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 10:13:12.853467 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8e3a2b-8d94-4935-98e4-64b37e7c0324 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:12.975545 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8e3a2b-8d94-4935-98e4-64b37e7c0324 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:13.013200 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02aee9f-91d9-45d5-8b54-df49df762140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:13.013810 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02aee9f-91d9-45d5-8b54-df49df762140 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:13.014138 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02aee9f-91d9-45d5-8b54-df49df762140 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:13.014414 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02aee9f-91d9-45d5-8b54-df49df762140 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:13.015139 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02aee9f-91d9-45d5-8b54-df49df762140 None admin] RBAC: Adding query filter params (role.id=6c2e7a94daa04d7695a6fa91e5cca692, user.id=9e136b869d3c4c989b22d6cd62557c2b, scope.system=all) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:13:13.015500 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02aee9f-91d9-45d5-8b54-df49df762140 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:13.016994 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02aee9f-91d9-45d5-8b54-df49df762140 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:13.022243 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 151/312] 10.222.0.66 () {56 vars in 1308 bytes} [Mon Sep 19 10:13:12 2022] GET /identity/v3/role_assignments?user.id=9e136b869d3c4c989b22d6cd62557c2b&scope.system=all&role.id=6c2e7a94daa04d7695a6fa91e5cca692 => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:13:13.149556 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12922138-b973-42fd-8d38-89ee7c07162e None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:13.265718 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12922138-b973-42fd-8d38-89ee7c07162e None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:13.308246 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef91f717-f86f-41bc-ae46-b012ab662e9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:13.308886 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef91f717-f86f-41bc-ae46-b012ab662e9e None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:13.309161 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef91f717-f86f-41bc-ae46-b012ab662e9e None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:13.309429 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef91f717-f86f-41bc-ae46-b012ab662e9e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:13.320024 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef91f717-f86f-41bc-ae46-b012ab662e9e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 10:13:13.324823 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-ef91f717-f86f-41bc-ae46-b012ab662e9e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 19 10:13:13.324823 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:13:13.324823 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:13:13.324823 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:13:13.324823 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:13:13.324823 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:13:13.324823 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:13:13.324823 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:13:13.324823 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:13:13.324823 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:13:13.324823 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:13:13.324823 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:13:13.324823 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 10:13:13.324823 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 10:13:13.324823 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 10:13:13.324823 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 10:13:13.325711 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 10:13:13.325711 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 10:13:13.325711 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 10:13:13.325711 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 10:13:13.325711 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:13:13.325711 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:13:13.325711 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:13:13.325711 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:13:13.325711 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:13:13.325711 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:13:13.325711 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:13:13.325711 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 19 10:13:13.325711 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:13:13.325711 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:13:13.325711 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:13:13.325711 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:13:13.326882 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:13:13.326882 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:13:13.326882 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:13:13.326882 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:13:13.326882 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 10:13:13.326882 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 10:13:13.326882 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 10:13:13.326882 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 10:13:13.326882 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 10:13:13.326882 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 10:13:13.326882 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 19 10:13:13.326882 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 19 10:13:13.326882 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 162/313] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Sep 19 10:13:13 2022] GET /identity/v3/roles/reader => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:13:13.331975 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02aee9f-91d9-45d5-8b54-df49df762140 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:13.383095 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:13.443128 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02aee9f-91d9-45d5-8b54-df49df762140 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:13.477158 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bf72d6-2432-4f58-b93b-b831052f7b0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:13.477770 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bf72d6-2432-4f58-b93b-b831052f7b0c None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:13.478047 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bf72d6-2432-4f58-b93b-b831052f7b0c None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:13.478420 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bf72d6-2432-4f58-b93b-b831052f7b0c None admin] PATH_INFO: `/v3/roles` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:13.479086 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bf72d6-2432-4f58-b93b-b831052f7b0c None admin] RBAC: Adding query filter params (name=reader) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:13:13.479386 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bf72d6-2432-4f58-b93b-b831052f7b0c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:13.480822 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bf72d6-2432-4f58-b93b-b831052f7b0c None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:13.489648 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 152/314] 10.222.0.66 () {56 vars in 1101 bytes} [Mon Sep 19 10:13:13 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:13:13.495470 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef91f717-f86f-41bc-ae46-b012ab662e9e None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:13.551876 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:13.601699 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef91f717-f86f-41bc-ae46-b012ab662e9e None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:13.636822 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f460cac-0b5f-495b-ac16-9cbbab3d14ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:13.637503 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f460cac-0b5f-495b-ac16-9cbbab3d14ae None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:13.637785 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f460cac-0b5f-495b-ac16-9cbbab3d14ae None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:13.638053 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f460cac-0b5f-495b-ac16-9cbbab3d14ae None admin] PATH_INFO: `/v3/users/fad23c4571054ca8a153cf1811813d1b` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:13.639193 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f460cac-0b5f-495b-ac16-9cbbab3d14ae None admin] RBAC: Authorizing `identity:get_user(user_id=fad23c4571054ca8a153cf1811813d1b)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:13.640662 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f460cac-0b5f-495b-ac16-9cbbab3d14ae None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:13.642526 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 163/315] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Sep 19 10:13:13 2022] GET /identity/v3/users/fad23c4571054ca8a153cf1811813d1b => generated 297 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:13:13.648106 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bf72d6-2432-4f58-b93b-b831052f7b0c None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:13.762484 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bf72d6-2432-4f58-b93b-b831052f7b0c None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:13.772200 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:13.798849 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d5d701-1300-4fc2-895c-52c943013216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:13.799622 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d5d701-1300-4fc2-895c-52c943013216 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:13.800025 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d5d701-1300-4fc2-895c-52c943013216 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:13.800424 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d5d701-1300-4fc2-895c-52c943013216 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:13.870098 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d5d701-1300-4fc2-895c-52c943013216 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:13.871703 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d5d701-1300-4fc2-895c-52c943013216 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:13.977448 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 153/316] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Sep 19 10:13:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 10:13:13.982933 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f460cac-0b5f-495b-ac16-9cbbab3d14ae None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:14.084801 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f460cac-0b5f-495b-ac16-9cbbab3d14ae None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:14.105670 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:14.120282 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbc679a-9454-46af-a2cc-5501b9bd2364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:14.120919 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbc679a-9454-46af-a2cc-5501b9bd2364 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:14.121195 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbc679a-9454-46af-a2cc-5501b9bd2364 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:14.121465 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbc679a-9454-46af-a2cc-5501b9bd2364 None admin] PATH_INFO: `/v3/projects/42b2443f228149a79b5bc408193a96bb` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:14.122581 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbc679a-9454-46af-a2cc-5501b9bd2364 None admin] RBAC: Authorizing `identity:get_project(project_id=42b2443f228149a79b5bc408193a96bb)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:14.124018 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbc679a-9454-46af-a2cc-5501b9bd2364 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:14.125952 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 164/317] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Sep 19 10:13:13 2022] GET /identity/v3/projects/42b2443f228149a79b5bc408193a96bb => generated 302 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:13:14.132564 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d5d701-1300-4fc2-895c-52c943013216 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:14.144010 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:14.238588 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d5d701-1300-4fc2-895c-52c943013216 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:14.274421 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a6e77d-bddb-45c0-a0e2-c926dd24d71b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:14.275030 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a6e77d-bddb-45c0-a0e2-c926dd24d71b None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:14.275307 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a6e77d-bddb-45c0-a0e2-c926dd24d71b None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:14.275576 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a6e77d-bddb-45c0-a0e2-c926dd24d71b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:14.276326 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a6e77d-bddb-45c0-a0e2-c926dd24d71b None admin] RBAC: Adding query filter params (role.id=6c2e7a94daa04d7695a6fa91e5cca692, scope.project.id=42b2443f228149a79b5bc408193a96bb, user.id=fad23c4571054ca8a153cf1811813d1b) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:13:14.276676 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a6e77d-bddb-45c0-a0e2-c926dd24d71b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:14.278178 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a6e77d-bddb-45c0-a0e2-c926dd24d71b None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:14.284391 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 154/318] 10.222.0.66 () {56 vars in 1374 bytes} [Mon Sep 19 10:13:14 2022] GET /identity/v3/role_assignments?user.id=fad23c4571054ca8a153cf1811813d1b&scope.project.id=42b2443f228149a79b5bc408193a96bb&role.id=6c2e7a94daa04d7695a6fa91e5cca692 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 10:13:14.705196 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f8794d-34a5-432e-ad7c-b2481358db9c None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:14.705684 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f8794d-34a5-432e-ad7c-b2481358db9c None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:14.705787 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f8794d-34a5-432e-ad7c-b2481358db9c None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:14.707254 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 165/319] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:13:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:13:14.712949 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e66502-246a-4fb5-8d43-c95449dfd269 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:14.713373 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e66502-246a-4fb5-8d43-c95449dfd269 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:14.713568 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e66502-246a-4fb5-8d43-c95449dfd269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:14.732156 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-23e66502-246a-4fb5-8d43-c95449dfd269 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:13:14.733369 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-23e66502-246a-4fb5-8d43-c95449dfd269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:13:14.803012 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 155/320] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:13:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 10:13:15.071635 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f8794d-34a5-432e-ad7c-b2481358db9c None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:15.075319 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c01aa56-0ab0-4521-a71c-cd64073fd438 None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:15.075608 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c01aa56-0ab0-4521-a71c-cd64073fd438 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:15.075883 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c01aa56-0ab0-4521-a71c-cd64073fd438 None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:15.077276 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 156/321] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:13:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 10:13:15.082642 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d42d3bd-594d-444e-98e9-d9fd3c4872bf None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:15.082927 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d42d3bd-594d-444e-98e9-d9fd3c4872bf None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:15.083201 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d42d3bd-594d-444e-98e9-d9fd3c4872bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:15.090519 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:15.104905 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-3d42d3bd-594d-444e-98e9-d9fd3c4872bf None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:13:15.106100 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-3d42d3bd-594d-444e-98e9-d9fd3c4872bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:13:15.178979 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 157/322] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:13:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 10:13:15.185066 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f8794d-34a5-432e-ad7c-b2481358db9c None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:15.223024 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73a1f03-cf6e-4551-8c8b-01fdaf45c437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:15.223683 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73a1f03-cf6e-4551-8c8b-01fdaf45c437 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:15.223959 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73a1f03-cf6e-4551-8c8b-01fdaf45c437 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:15.224372 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73a1f03-cf6e-4551-8c8b-01fdaf45c437 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:15.236544 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73a1f03-cf6e-4551-8c8b-01fdaf45c437 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 10:13:15.241417 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-f73a1f03-cf6e-4551-8c8b-01fdaf45c437 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 19 10:13:15.241417 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:13:15.241417 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:13:15.241417 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:13:15.241417 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:13:15.241417 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:13:15.241417 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:13:15.241417 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:13:15.241417 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:13:15.241417 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:13:15.241417 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:13:15.241417 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:13:15.241417 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 10:13:15.241417 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 10:13:15.241417 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 10:13:15.241417 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 10:13:15.242264 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 10:13:15.242264 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 10:13:15.242264 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 10:13:15.242264 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 10:13:15.242264 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:13:15.242264 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:13:15.242264 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:13:15.242264 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:13:15.242264 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:13:15.242264 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:13:15.242264 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:13:15.242264 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 19 10:13:15.242264 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:13:15.242264 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:13:15.242264 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:13:15.242264 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:13:15.243347 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:13:15.243347 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:13:15.243347 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:13:15.243347 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:13:15.243347 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 10:13:15.243347 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 10:13:15.243347 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 10:13:15.243347 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 10:13:15.243347 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 10:13:15.243347 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 10:13:15.243347 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 19 10:13:15.243347 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 19 10:13:15.243347 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 166/323] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Sep 19 10:13:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:13:15.248365 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d42d3bd-594d-444e-98e9-d9fd3c4872bf None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:15.318784 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11312ec4-453d-4e59-b69c-9d35e50253a8 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:15.319129 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11312ec4-453d-4e59-b69c-9d35e50253a8 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:15.319336 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11312ec4-453d-4e59-b69c-9d35e50253a8 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:15.320715 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 167/324] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:13:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 10:13:15.325670 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98248868-bcb8-4797-90e9-4705fdc37439 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:15.325898 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98248868-bcb8-4797-90e9-4705fdc37439 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:15.326180 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98248868-bcb8-4797-90e9-4705fdc37439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:15.345366 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-98248868-bcb8-4797-90e9-4705fdc37439 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:13:15.346559 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-98248868-bcb8-4797-90e9-4705fdc37439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:13:15.351934 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d42d3bd-594d-444e-98e9-d9fd3c4872bf None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:15.385393 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:15.391141 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b7a8e2-0757-495a-8ccc-996566a7995f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:15.391764 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b7a8e2-0757-495a-8ccc-996566a7995f None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:15.392050 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b7a8e2-0757-495a-8ccc-996566a7995f None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:15.392354 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b7a8e2-0757-495a-8ccc-996566a7995f None admin] PATH_INFO: `/v3/roles` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:15.393025 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b7a8e2-0757-495a-8ccc-996566a7995f None admin] RBAC: Adding query filter params (name=member) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:13:15.393331 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b7a8e2-0757-495a-8ccc-996566a7995f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:15.394215 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:15.394731 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b7a8e2-0757-495a-8ccc-996566a7995f None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:15.403905 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 158/325] 10.222.0.66 () {56 vars in 1101 bytes} [Mon Sep 19 10:13:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:13:15.410307 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b7a8e2-0757-495a-8ccc-996566a7995f None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:15.422923 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 168/326] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:13:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 10:13:15.452245 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98248868-bcb8-4797-90e9-4705fdc37439 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:15.518449 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b7a8e2-0757-495a-8ccc-996566a7995f None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:15.554829 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d139f13-6160-4741-970f-6d535e2b348c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:15.555818 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d139f13-6160-4741-970f-6d535e2b348c None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:15.556018 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98248868-bcb8-4797-90e9-4705fdc37439 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:15.556501 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d139f13-6160-4741-970f-6d535e2b348c None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:15.556951 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d139f13-6160-4741-970f-6d535e2b348c None admin] PATH_INFO: `/v3/users/cf59020a5787493ab0461175ab88b6b1` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:15.559176 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d139f13-6160-4741-970f-6d535e2b348c None admin] RBAC: Authorizing `identity:get_user(user_id=cf59020a5787493ab0461175ab88b6b1)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:15.560944 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d139f13-6160-4741-970f-6d535e2b348c None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:15.567675 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 159/327] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Sep 19 10:13:15 2022] GET /identity/v3/users/cf59020a5787493ab0461175ab88b6b1 => generated 293 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:13:15.568623 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d139f13-6160-4741-970f-6d535e2b348c None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:15.595798 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888944e5-e2f5-4cab-b164-97c16be8ff54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:15.596046 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888944e5-e2f5-4cab-b164-97c16be8ff54 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:15.596340 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888944e5-e2f5-4cab-b164-97c16be8ff54 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:15.596609 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888944e5-e2f5-4cab-b164-97c16be8ff54 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:15.597716 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888944e5-e2f5-4cab-b164-97c16be8ff54 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:15.599158 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888944e5-e2f5-4cab-b164-97c16be8ff54 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:15.601444 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 169/328] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 19 10:13:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 10:13:15.606709 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888944e5-e2f5-4cab-b164-97c16be8ff54 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:15.641163 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:15.657390 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:15.685169 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d139f13-6160-4741-970f-6d535e2b348c None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:15.719740 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c912ea1d-47a7-4dff-8b60-8cf06c8a7064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:15.720395 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c912ea1d-47a7-4dff-8b60-8cf06c8a7064 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:15.720647 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c912ea1d-47a7-4dff-8b60-8cf06c8a7064 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:15.720920 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c912ea1d-47a7-4dff-8b60-8cf06c8a7064 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:15.721230 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888944e5-e2f5-4cab-b164-97c16be8ff54 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:15.721642 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c912ea1d-47a7-4dff-8b60-8cf06c8a7064 None admin] RBAC: Adding query filter params (role.id=cd5b42ed3b754b58817a62bbe74651b4, user.id=cf59020a5787493ab0461175ab88b6b1, scope.system=all) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:13:15.721949 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c912ea1d-47a7-4dff-8b60-8cf06c8a7064 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:15.723388 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c912ea1d-47a7-4dff-8b60-8cf06c8a7064 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:15.748194 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 160/329] 10.222.0.66 () {56 vars in 1308 bytes} [Mon Sep 19 10:13:15 2022] GET /identity/v3/role_assignments?user.id=cf59020a5787493ab0461175ab88b6b1&scope.system=all&role.id=cd5b42ed3b754b58817a62bbe74651b4 => generated 510 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 10:13:15.748194 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c912ea1d-47a7-4dff-8b60-8cf06c8a7064 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:15.756862 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6ff4f4-8c41-4505-a554-83d3a7a34fe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:15.757489 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6ff4f4-8c41-4505-a554-83d3a7a34fe0 None admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:15.757774 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6ff4f4-8c41-4505-a554-83d3a7a34fe0 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:15.758045 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6ff4f4-8c41-4505-a554-83d3a7a34fe0 None admin] PATH_INFO: `/v3/groups` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:15.758693 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6ff4f4-8c41-4505-a554-83d3a7a34fe0 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:15.760279 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6ff4f4-8c41-4505-a554-83d3a7a34fe0 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:15.779589 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 170/330] 10.222.0.66 () {60 vars in 1134 bytes} [Mon Sep 19 10:13:15 2022] POST /identity/v3/groups => generated 226 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 10:13:15.862847 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c912ea1d-47a7-4dff-8b60-8cf06c8a7064 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:15.888340 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:15.909631 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81734b5f-913b-4ed5-8afa-5f34254fa5b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:15.910614 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81734b5f-913b-4ed5-8afa-5f34254fa5b0 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:15.911071 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81734b5f-913b-4ed5-8afa-5f34254fa5b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:15.911536 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81734b5f-913b-4ed5-8afa-5f34254fa5b0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:15.925568 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81734b5f-913b-4ed5-8afa-5f34254fa5b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 10:13:15.931147 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-81734b5f-913b-4ed5-8afa-5f34254fa5b0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 19 10:13:15.931147 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:13:15.931147 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:13:15.931147 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:13:15.931147 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:13:15.931147 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:13:15.931147 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:13:15.931147 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:13:15.931147 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:13:15.931147 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:13:15.931147 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:13:15.931147 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:13:15.931147 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 10:13:15.931147 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 10:13:15.931147 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 10:13:15.931147 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 10:13:15.932085 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 10:13:15.932085 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 10:13:15.932085 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 10:13:15.932085 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 10:13:15.932085 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:13:15.932085 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:13:15.932085 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:13:15.932085 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:13:15.932085 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:13:15.932085 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:13:15.932085 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:13:15.932085 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Sep 19 10:13:15.932085 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:13:15.932085 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:13:15.932085 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:13:15.932085 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:13:15.932910 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:13:15.932910 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:13:15.932910 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:13:15.932910 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:13:15.932910 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 10:13:15.932910 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 10:13:15.932910 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 10:13:15.932910 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 10:13:15.932910 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 10:13:15.932910 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 10:13:15.932910 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 19 10:13:15.932910 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Sep 19 10:13:15.932910 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 161/331] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Sep 19 10:13:15 2022] GET /identity/v3/roles/reader => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:13:15.938638 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6ff4f4-8c41-4505-a554-83d3a7a34fe0 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:16.044913 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6ff4f4-8c41-4505-a554-83d3a7a34fe0 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:16.052056 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:16.081958 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e445a7-6a29-4393-b713-7dd8379abbf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:16.082573 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e445a7-6a29-4393-b713-7dd8379abbf6 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:16.082856 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e445a7-6a29-4393-b713-7dd8379abbf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:16.083132 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e445a7-6a29-4393-b713-7dd8379abbf6 None admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:16.084432 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e445a7-6a29-4393-b713-7dd8379abbf6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:13:16.084737 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e445a7-6a29-4393-b713-7dd8379abbf6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:16.086177 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e445a7-6a29-4393-b713-7dd8379abbf6 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:16.095047 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 171/332] 10.222.0.66 () {56 vars in 1101 bytes} [Mon Sep 19 10:13:15 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:13:16.100788 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81734b5f-913b-4ed5-8afa-5f34254fa5b0 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:16.214709 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81734b5f-913b-4ed5-8afa-5f34254fa5b0 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:16.250656 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373a540d-726e-4f21-9453-c30c0c75033a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:16.251299 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373a540d-726e-4f21-9453-c30c0c75033a None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:16.251579 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373a540d-726e-4f21-9453-c30c0c75033a None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:16.251852 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373a540d-726e-4f21-9453-c30c0c75033a None admin] PATH_INFO: `/v3/users/9e136b869d3c4c989b22d6cd62557c2b` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:16.253934 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373a540d-726e-4f21-9453-c30c0c75033a None admin] RBAC: Authorizing `identity:get_user(user_id=9e136b869d3c4c989b22d6cd62557c2b)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:16.255395 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373a540d-726e-4f21-9453-c30c0c75033a None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:16.257782 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 162/333] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Sep 19 10:13:16 2022] GET /identity/v3/users/9e136b869d3c4c989b22d6cd62557c2b => generated 293 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:13:16.263281 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e445a7-6a29-4393-b713-7dd8379abbf6 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:16.378025 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e445a7-6a29-4393-b713-7dd8379abbf6 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:16.417275 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa41dcf0-ca3f-433f-b2a4-221a29fd984d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:16.417953 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa41dcf0-ca3f-433f-b2a4-221a29fd984d None admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:16.418215 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa41dcf0-ca3f-433f-b2a4-221a29fd984d None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:16.418487 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa41dcf0-ca3f-433f-b2a4-221a29fd984d None admin] PATH_INFO: `/v3/system/users/9e136b869d3c4c989b22d6cd62557c2b/roles/6c2e7a94daa04d7695a6fa91e5cca692` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:16.420909 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa41dcf0-ca3f-433f-b2a4-221a29fd984d None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=9e136b869d3c4c989b22d6cd62557c2b, role_id=6c2e7a94daa04d7695a6fa91e5cca692)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:16.422308 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa41dcf0-ca3f-433f-b2a4-221a29fd984d None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:16.439549 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 172/334] 10.222.0.66 () {58 vars in 1334 bytes} [Mon Sep 19 10:13:16 2022] PUT /identity/v3/system/users/9e136b869d3c4c989b22d6cd62557c2b/roles/6c2e7a94daa04d7695a6fa91e5cca692 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 10:13:18.602690 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538a8fb7-55b3-4dcc-a312-20f7363fb10c None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:18.603726 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538a8fb7-55b3-4dcc-a312-20f7363fb10c None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:18.604269 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538a8fb7-55b3-4dcc-a312-20f7363fb10c None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:18.606125 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 163/335] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:13:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:13:18.611663 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf886e9-5f3e-46bc-b4e5-a807f6cee052 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:18.612551 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf886e9-5f3e-46bc-b4e5-a807f6cee052 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:18.613050 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf886e9-5f3e-46bc-b4e5-a807f6cee052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:18.638028 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-caf886e9-5f3e-46bc-b4e5-a807f6cee052 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:13:18.639274 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-caf886e9-5f3e-46bc-b4e5-a807f6cee052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:13:18.680268 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:18.737660 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 173/336] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:13:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 10:13:19.204256 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e498167b-1edf-4248-8d46-6a7abd0b8f38 None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:19.204947 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e498167b-1edf-4248-8d46-6a7abd0b8f38 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:19.205479 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e498167b-1edf-4248-8d46-6a7abd0b8f38 None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:19.207379 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 164/337] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:13:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:13:19.214912 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d08366-f84e-4030-84b6-352356b20b2d None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:19.215571 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d08366-f84e-4030-84b6-352356b20b2d None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:19.216051 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d08366-f84e-4030-84b6-352356b20b2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:19.241186 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-14d08366-f84e-4030-84b6-352356b20b2d None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:13:19.242737 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-14d08366-f84e-4030-84b6-352356b20b2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:13:19.313852 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e498167b-1edf-4248-8d46-6a7abd0b8f38 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:19.352882 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 174/338] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:13:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 10:13:19.354483 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7024f201-d117-4306-a183-e08a7f718f42 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:19.354993 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7024f201-d117-4306-a183-e08a7f718f42 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:19.355467 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7024f201-d117-4306-a183-e08a7f718f42 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:19.357269 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 175/339] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:13:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:13:19.358545 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dc078f-52eb-4f08-b467-6d4e9f14cb0f None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:19.359028 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dc078f-52eb-4f08-b467-6d4e9f14cb0f None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:19.359498 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dc078f-52eb-4f08-b467-6d4e9f14cb0f None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:19.360929 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 176/340] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:13:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:13:19.362154 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce57b83-47b3-4a66-80dc-f580b92de27a None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:19.362643 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce57b83-47b3-4a66-80dc-f580b92de27a None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:19.363133 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce57b83-47b3-4a66-80dc-f580b92de27a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:19.390957 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-fce57b83-47b3-4a66-80dc-f580b92de27a None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:13:19.392548 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-fce57b83-47b3-4a66-80dc-f580b92de27a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:13:19.412575 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:19.506564 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e498167b-1edf-4248-8d46-6a7abd0b8f38 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:19.527081 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 177/341] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:13:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 10:13:19.530390 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d66b62c-bb81-4202-9f61-f340203bf1c9 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:19.531780 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d66b62c-bb81-4202-9f61-f340203bf1c9 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:19.533105 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d66b62c-bb81-4202-9f61-f340203bf1c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:19.565382 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-2d66b62c-bb81-4202-9f61-f340203bf1c9 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:13:19.567769 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-2d66b62c-bb81-4202-9f61-f340203bf1c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:13:19.572866 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ff7a79-d300-40ec-8a3b-8e8eba0477e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:19.573799 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ff7a79-d300-40ec-8a3b-8e8eba0477e7 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:19.574288 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ff7a79-d300-40ec-8a3b-8e8eba0477e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:19.574766 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ff7a79-d300-40ec-8a3b-8e8eba0477e7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:19.593460 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ff7a79-d300-40ec-8a3b-8e8eba0477e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 10:13:19.599656 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-56ff7a79-d300-40ec-8a3b-8e8eba0477e7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 10:13:19.599656 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:13:19.599656 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:13:19.599656 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:13:19.599656 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:13:19.599656 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:13:19.599656 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:13:19.599656 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:13:19.599656 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:13:19.599656 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:13:19.599656 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:13:19.599656 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:13:19.599656 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 10:13:19.599656 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 10:13:19.599656 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 10:13:19.599656 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 10:13:19.600623 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 10:13:19.600623 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 10:13:19.600623 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 10:13:19.600623 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 10:13:19.600623 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:13:19.600623 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:13:19.600623 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:13:19.600623 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:13:19.600623 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:13:19.600623 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:13:19.600623 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:13:19.600623 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Sep 19 10:13:19.600623 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:13:19.600623 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:13:19.600623 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:13:19.600623 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:13:19.601453 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:13:19.601453 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:13:19.601453 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:13:19.601453 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:13:19.601453 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 10:13:19.601453 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 10:13:19.601453 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 10:13:19.601453 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 10:13:19.601453 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 10:13:19.601453 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 10:13:19.601453 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 10:13:19.601453 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Sep 19 10:13:19.607687 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 165/342] 10.222.0.66 () {56 vars in 1114 bytes} [Mon Sep 19 10:13:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:13:19.609758 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:19.615855 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ff7a79-d300-40ec-8a3b-8e8eba0477e7 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:19.698302 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 178/343] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:13:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 10:13:19.716785 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d66b62c-bb81-4202-9f61-f340203bf1c9 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:19.841967 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ff7a79-d300-40ec-8a3b-8e8eba0477e7 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:19.851668 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:19.898110 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96435e9-4373-4fa7-8102-5b69bb45258a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:19.898740 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96435e9-4373-4fa7-8102-5b69bb45258a None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:19.899195 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96435e9-4373-4fa7-8102-5b69bb45258a None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:19.899627 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96435e9-4373-4fa7-8102-5b69bb45258a None admin] PATH_INFO: `/v3/roles` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:19.900490 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96435e9-4373-4fa7-8102-5b69bb45258a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:13:19.900962 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96435e9-4373-4fa7-8102-5b69bb45258a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:19.902517 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96435e9-4373-4fa7-8102-5b69bb45258a None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:19.916308 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 166/344] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Sep 19 10:13:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:13:19.916510 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d66b62c-bb81-4202-9f61-f340203bf1c9 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:19.917580 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96435e9-4373-4fa7-8102-5b69bb45258a None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:19.985268 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbfbb6b-3888-4b45-8a13-f3f001f7c30c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:19.985917 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbfbb6b-3888-4b45-8a13-f3f001f7c30c None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:19.986196 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbfbb6b-3888-4b45-8a13-f3f001f7c30c None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:19.986472 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbfbb6b-3888-4b45-8a13-f3f001f7c30c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:20.009584 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbfbb6b-3888-4b45-8a13-f3f001f7c30c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 10:13:20.014776 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-6fbfbb6b-3888-4b45-8a13-f3f001f7c30c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 19 10:13:20.014776 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:13:20.014776 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:13:20.014776 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:13:20.014776 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:13:20.014776 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:13:20.014776 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:13:20.014776 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:13:20.014776 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:13:20.014776 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:13:20.014776 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:13:20.014776 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:13:20.014776 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 10:13:20.014776 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 10:13:20.014776 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 10:13:20.014776 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 10:13:20.015649 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 10:13:20.015649 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 10:13:20.015649 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 10:13:20.015649 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 10:13:20.015649 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:13:20.015649 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:13:20.015649 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:13:20.015649 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:13:20.015649 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:13:20.015649 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:13:20.015649 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:13:20.015649 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 19 10:13:20.015649 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:13:20.015649 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:13:20.015649 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:13:20.015649 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:13:20.016468 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:13:20.016468 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:13:20.016468 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:13:20.016468 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:13:20.016468 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 10:13:20.016468 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 10:13:20.016468 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 10:13:20.016468 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 10:13:20.016468 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 10:13:20.016468 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 10:13:20.016468 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 19 10:13:20.016468 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 19 10:13:20.016468 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 179/345] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Sep 19 10:13:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 10:13:20.017146 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbfbb6b-3888-4b45-8a13-f3f001f7c30c None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:20.059055 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:20.092061 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96435e9-4373-4fa7-8102-5b69bb45258a None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:20.137804 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a87327b-b3af-40c0-b61a-4dcb1e3cd954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:20.139575 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a87327b-b3af-40c0-b61a-4dcb1e3cd954 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:20.140025 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a87327b-b3af-40c0-b61a-4dcb1e3cd954 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:20.140477 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a87327b-b3af-40c0-b61a-4dcb1e3cd954 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:20.179135 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbfbb6b-3888-4b45-8a13-f3f001f7c30c None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:20.192748 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:20.225217 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce56dfa-833c-41e3-be33-ff9c278144fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:20.225895 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce56dfa-833c-41e3-be33-ff9c278144fd None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:20.226182 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce56dfa-833c-41e3-be33-ff9c278144fd None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:20.226458 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce56dfa-833c-41e3-be33-ff9c278144fd None admin] PATH_INFO: `/v3/roles/member` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:20.230732 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a87327b-b3af-40c0-b61a-4dcb1e3cd954 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:20.232536 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a87327b-b3af-40c0-b61a-4dcb1e3cd954 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:20.240416 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce56dfa-833c-41e3-be33-ff9c278144fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 10:13:20.245393 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-4ce56dfa-833c-41e3-be33-ff9c278144fd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 19 10:13:20.245393 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:13:20.245393 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:13:20.245393 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:13:20.245393 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:13:20.245393 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:13:20.245393 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:13:20.245393 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:13:20.245393 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:13:20.245393 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:13:20.245393 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:13:20.245393 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:13:20.245393 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 10:13:20.245393 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 10:13:20.245393 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 10:13:20.245393 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 10:13:20.246580 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 10:13:20.246580 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 10:13:20.246580 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 10:13:20.246580 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 10:13:20.246580 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:13:20.246580 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:13:20.246580 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:13:20.246580 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:13:20.246580 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:13:20.246580 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:13:20.246580 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:13:20.246580 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 19 10:13:20.246580 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:13:20.246580 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:13:20.246580 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:13:20.246580 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:13:20.247396 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:13:20.247396 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:13:20.247396 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:13:20.247396 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:13:20.247396 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 10:13:20.247396 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 10:13:20.247396 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 10:13:20.247396 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 10:13:20.247396 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 10:13:20.247396 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 10:13:20.247396 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 19 10:13:20.247396 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 19 10:13:20.247396 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 180/346] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Sep 19 10:13:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:13:20.248944 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce56dfa-833c-41e3-be33-ff9c278144fd None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:20.347820 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:20.371320 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 167/347] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Sep 19 10:13:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 10:13:20.371320 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a87327b-b3af-40c0-b61a-4dcb1e3cd954 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:20.392108 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce56dfa-833c-41e3-be33-ff9c278144fd None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:20.445325 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a4e9a0-ede2-45be-b19c-72790769b638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:20.446223 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a4e9a0-ede2-45be-b19c-72790769b638 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:20.446799 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a4e9a0-ede2-45be-b19c-72790769b638 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:20.447522 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a4e9a0-ede2-45be-b19c-72790769b638 None admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:20.449419 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a4e9a0-ede2-45be-b19c-72790769b638 None admin] RBAC: Adding query filter params (name=member) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:13:20.449906 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a4e9a0-ede2-45be-b19c-72790769b638 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:20.451963 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a4e9a0-ede2-45be-b19c-72790769b638 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:20.464005 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:20.470819 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 181/348] 10.222.0.66 () {56 vars in 1101 bytes} [Mon Sep 19 10:13:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:13:20.473709 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf49b93-bf91-40c8-bcf7-871a8e294acd None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:20.474784 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf49b93-bf91-40c8-bcf7-871a8e294acd None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:20.475360 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf49b93-bf91-40c8-bcf7-871a8e294acd None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:20.477487 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 182/349] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:13:20 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:13:20.478664 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf49b93-bf91-40c8-bcf7-871a8e294acd None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:20.511466 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a87327b-b3af-40c0-b61a-4dcb1e3cd954 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:20.555538 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dbbd2c-8655-4052-8a60-02865cc52ec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:20.556246 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dbbd2c-8655-4052-8a60-02865cc52ec5 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:20.556531 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dbbd2c-8655-4052-8a60-02865cc52ec5 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:20.556801 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dbbd2c-8655-4052-8a60-02865cc52ec5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:20.570256 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dbbd2c-8655-4052-8a60-02865cc52ec5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 10:13:20.576453 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-31dbbd2c-8655-4052-8a60-02865cc52ec5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 19 10:13:20.576453 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:13:20.576453 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:13:20.576453 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:13:20.576453 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:13:20.576453 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:13:20.576453 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:13:20.576453 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:13:20.576453 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:13:20.576453 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:13:20.576453 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:13:20.576453 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:13:20.576453 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 10:13:20.576453 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 10:13:20.576453 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 10:13:20.576453 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 10:13:20.577366 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 10:13:20.577366 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 10:13:20.577366 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 10:13:20.577366 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 10:13:20.577366 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:13:20.577366 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:13:20.577366 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:13:20.577366 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:13:20.577366 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:13:20.577366 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:13:20.577366 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:13:20.577366 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Sep 19 10:13:20.577366 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:13:20.577366 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:13:20.577366 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:13:20.577366 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:13:20.578565 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:13:20.578565 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:13:20.578565 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:13:20.578565 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:13:20.578565 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 10:13:20.578565 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 10:13:20.578565 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 10:13:20.578565 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 10:13:20.578565 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 10:13:20.578565 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 10:13:20.578565 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 19 10:13:20.578565 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Sep 19 10:13:20.578565 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 168/350] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Sep 19 10:13:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:13:20.579382 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dbbd2c-8655-4052-8a60-02865cc52ec5 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:20.650505 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf49b93-bf91-40c8-bcf7-871a8e294acd None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:20.703563 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f733743-d408-47af-845e-316cb89d50b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:20.704241 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f733743-d408-47af-845e-316cb89d50b1 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:20.704492 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f733743-d408-47af-845e-316cb89d50b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:20.704770 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f733743-d408-47af-845e-316cb89d50b1 None admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:20.705440 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f733743-d408-47af-845e-316cb89d50b1 None admin] RBAC: Adding query filter params (name=member) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:13:20.705744 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f733743-d408-47af-845e-316cb89d50b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:20.707220 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f733743-d408-47af-845e-316cb89d50b1 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:20.708694 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:20.715009 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dbbd2c-8655-4052-8a60-02865cc52ec5 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:20.718764 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 183/351] 10.222.0.66 () {56 vars in 1101 bytes} [Mon Sep 19 10:13:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:13:20.719605 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f733743-d408-47af-845e-316cb89d50b1 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:20.749418 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:20.757685 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d510c86a-843f-4abb-8c3c-45f15a9e0f50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:20.758328 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d510c86a-843f-4abb-8c3c-45f15a9e0f50 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:20.758603 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d510c86a-843f-4abb-8c3c-45f15a9e0f50 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:20.758871 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d510c86a-843f-4abb-8c3c-45f15a9e0f50 None admin] PATH_INFO: `/v3/projects/5f95307582374302a3632bd00efa5a75` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:20.760104 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d510c86a-843f-4abb-8c3c-45f15a9e0f50 None admin] RBAC: Authorizing `identity:get_project(project_id=5f95307582374302a3632bd00efa5a75)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:20.762043 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d510c86a-843f-4abb-8c3c-45f15a9e0f50 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:20.763372 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 169/352] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Sep 19 10:13:20 2022] GET /identity/v3/projects/5f95307582374302a3632bd00efa5a75 => generated 298 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:13:20.764691 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e753c9-4137-4c34-ae25-da106b87703a None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:20.764974 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e753c9-4137-4c34-ae25-da106b87703a None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:20.765244 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e753c9-4137-4c34-ae25-da106b87703a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:20.785229 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-07e753c9-4137-4c34-ae25-da106b87703a None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:13:20.787218 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-07e753c9-4137-4c34-ae25-da106b87703a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:13:20.858283 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f733743-d408-47af-845e-316cb89d50b1 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:20.861784 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 170/353] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:13:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 10:13:20.868286 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e753c9-4137-4c34-ae25-da106b87703a None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:20.914657 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06683bb-9862-41d1-a529-8ab44ec1d694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:20.915200 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06683bb-9862-41d1-a529-8ab44ec1d694 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:20.915477 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06683bb-9862-41d1-a529-8ab44ec1d694 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:20.915748 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06683bb-9862-41d1-a529-8ab44ec1d694 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:20.996139 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:21.003916 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06683bb-9862-41d1-a529-8ab44ec1d694 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:21.006328 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06683bb-9862-41d1-a529-8ab44ec1d694 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:21.008420 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e753c9-4137-4c34-ae25-da106b87703a None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:21.040014 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:21.050473 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda7e886-948e-4854-b18e-d6e5be90068a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:21.051084 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda7e886-948e-4854-b18e-d6e5be90068a None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:21.051360 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda7e886-948e-4854-b18e-d6e5be90068a None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:21.051629 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda7e886-948e-4854-b18e-d6e5be90068a None admin] PATH_INFO: `/v3/roles` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:21.055751 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda7e886-948e-4854-b18e-d6e5be90068a None admin] RBAC: Adding query filter params (name=reader) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:13:21.055751 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda7e886-948e-4854-b18e-d6e5be90068a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:21.055751 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda7e886-948e-4854-b18e-d6e5be90068a None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:21.065053 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 171/354] 10.222.0.66 () {56 vars in 1101 bytes} [Mon Sep 19 10:13:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:13:21.066730 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887f1e1f-08f2-4a7a-8c24-19055c2bd3ee None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:21.066969 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887f1e1f-08f2-4a7a-8c24-19055c2bd3ee None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:21.067515 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887f1e1f-08f2-4a7a-8c24-19055c2bd3ee None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:21.070379 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 172/355] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:13:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:13:21.071202 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887f1e1f-08f2-4a7a-8c24-19055c2bd3ee None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:21.137069 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 184/356] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Sep 19 10:13:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 10:13:21.137766 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06683bb-9862-41d1-a529-8ab44ec1d694 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:21.209351 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887f1e1f-08f2-4a7a-8c24-19055c2bd3ee None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:21.250850 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e67074-2c54-4e5d-aaaf-e3f93d83bde7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:21.251467 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e67074-2c54-4e5d-aaaf-e3f93d83bde7 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:21.251753 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e67074-2c54-4e5d-aaaf-e3f93d83bde7 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:21.252026 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e67074-2c54-4e5d-aaaf-e3f93d83bde7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:21.254462 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:21.259640 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06683bb-9862-41d1-a529-8ab44ec1d694 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:21.302475 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ae2d51-8059-4348-8dba-c802c599ab40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:21.303604 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ae2d51-8059-4348-8dba-c802c599ab40 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:21.303604 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ae2d51-8059-4348-8dba-c802c599ab40 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:21.303604 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ae2d51-8059-4348-8dba-c802c599ab40 None admin] PATH_INFO: `/v3/groups/cae904455ede418fa1cc578d3df1c794` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:21.312132 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ae2d51-8059-4348-8dba-c802c599ab40 None admin] RBAC: Authorizing `identity:get_group(group_id=cae904455ede418fa1cc578d3df1c794)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:21.313640 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ae2d51-8059-4348-8dba-c802c599ab40 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:21.315281 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 185/357] 10.222.0.66 () {56 vars in 1180 bytes} [Mon Sep 19 10:13:21 2022] GET /identity/v3/groups/cae904455ede418fa1cc578d3df1c794 => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:13:21.317003 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ae2d51-8059-4348-8dba-c802c599ab40 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:21.326276 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:21.339132 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e67074-2c54-4e5d-aaaf-e3f93d83bde7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:21.340659 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e67074-2c54-4e5d-aaaf-e3f93d83bde7 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:21.433686 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ae2d51-8059-4348-8dba-c802c599ab40 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:21.464844 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 173/358] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Sep 19 10:13:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 10:13:21.470764 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f632d64-05d1-4ba1-b13a-1a147c370316 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:21.471048 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f632d64-05d1-4ba1-b13a-1a147c370316 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:21.471315 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f632d64-05d1-4ba1-b13a-1a147c370316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:21.478743 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf767534-6bbe-4510-b1e4-1c5fc47cf658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:21.479654 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf767534-6bbe-4510-b1e4-1c5fc47cf658 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:21.479941 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf767534-6bbe-4510-b1e4-1c5fc47cf658 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:21.480255 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf767534-6bbe-4510-b1e4-1c5fc47cf658 None admin] PATH_INFO: `/v3/users/9e136b869d3c4c989b22d6cd62557c2b` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:21.481473 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf767534-6bbe-4510-b1e4-1c5fc47cf658 None admin] RBAC: Authorizing `identity:get_user(user_id=9e136b869d3c4c989b22d6cd62557c2b)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:21.482937 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf767534-6bbe-4510-b1e4-1c5fc47cf658 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:21.484779 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 186/359] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Sep 19 10:13:21 2022] GET /identity/v3/users/9e136b869d3c4c989b22d6cd62557c2b => generated 293 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:13:21.485451 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf767534-6bbe-4510-b1e4-1c5fc47cf658 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:21.494901 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-0f632d64-05d1-4ba1-b13a-1a147c370316 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:13:21.496134 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-0f632d64-05d1-4ba1-b13a-1a147c370316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:13:21.521831 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:21.575513 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 174/360] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:13:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 10:13:21.580559 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f632d64-05d1-4ba1-b13a-1a147c370316 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:21.608030 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:21.613061 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf767534-6bbe-4510-b1e4-1c5fc47cf658 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:21.657488 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3088ff3d-2d8a-4f45-8732-80912a8d0bf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:21.658136 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3088ff3d-2d8a-4f45-8732-80912a8d0bf5 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:21.658421 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3088ff3d-2d8a-4f45-8732-80912a8d0bf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:21.658694 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3088ff3d-2d8a-4f45-8732-80912a8d0bf5 None admin] PATH_INFO: `/v3/projects/42b2443f228149a79b5bc408193a96bb` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:21.661023 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3088ff3d-2d8a-4f45-8732-80912a8d0bf5 None admin] RBAC: Authorizing `identity:get_project(project_id=42b2443f228149a79b5bc408193a96bb)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:21.663095 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3088ff3d-2d8a-4f45-8732-80912a8d0bf5 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:21.665132 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 187/361] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Sep 19 10:13:21 2022] GET /identity/v3/projects/42b2443f228149a79b5bc408193a96bb => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:13:21.665920 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3088ff3d-2d8a-4f45-8732-80912a8d0bf5 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:21.711754 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f632d64-05d1-4ba1-b13a-1a147c370316 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:21.757331 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f8bebb-937c-454c-af89-0f85655df3af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:21.758215 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f8bebb-937c-454c-af89-0f85655df3af None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:21.759554 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f8bebb-937c-454c-af89-0f85655df3af None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:21.759554 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f8bebb-937c-454c-af89-0f85655df3af None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:21.776014 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f8bebb-937c-454c-af89-0f85655df3af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 10:13:21.781111 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-b9f8bebb-937c-454c-af89-0f85655df3af None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 10:13:21.781111 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:13:21.781111 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:13:21.781111 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:13:21.781111 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:13:21.781111 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:13:21.781111 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:13:21.781111 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:13:21.781111 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:13:21.781111 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:13:21.781111 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:13:21.781111 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:13:21.781111 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 10:13:21.781111 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 10:13:21.781111 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 10:13:21.781111 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 10:13:21.782016 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 10:13:21.782016 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 10:13:21.782016 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 10:13:21.782016 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 10:13:21.782016 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:13:21.782016 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:13:21.782016 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:13:21.782016 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:13:21.782016 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:13:21.782016 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:13:21.782016 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:13:21.782016 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Sep 19 10:13:21.782016 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:13:21.782016 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:13:21.782016 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:13:21.782016 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:13:21.782842 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:13:21.782842 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:13:21.782842 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:13:21.782842 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:13:21.782842 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 10:13:21.782842 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 10:13:21.782842 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 10:13:21.782842 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 10:13:21.782842 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 10:13:21.782842 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 10:13:21.782842 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 10:13:21.782842 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Sep 19 10:13:21.782842 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 175/362] 10.222.0.66 () {56 vars in 1114 bytes} [Mon Sep 19 10:13:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:13:21.783505 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f8bebb-937c-454c-af89-0f85655df3af None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:21.797735 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:21.801770 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3088ff3d-2d8a-4f45-8732-80912a8d0bf5 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:21.847519 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3e5718-4eea-4827-b9c3-a667803192eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:21.848513 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3e5718-4eea-4827-b9c3-a667803192eb None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:21.849208 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3e5718-4eea-4827-b9c3-a667803192eb None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:21.849769 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3e5718-4eea-4827-b9c3-a667803192eb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:21.850933 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3e5718-4eea-4827-b9c3-a667803192eb None admin] RBAC: Adding query filter params (group.id=cae904455ede418fa1cc578d3df1c794, role.id=43fe0942f9c9486ca3e7c83be55eb915, scope.project.id=5f95307582374302a3632bd00efa5a75) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:13:21.851397 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3e5718-4eea-4827-b9c3-a667803192eb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:21.853026 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3e5718-4eea-4827-b9c3-a667803192eb None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:21.861061 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 188/363] 10.222.0.66 () {56 vars in 1376 bytes} [Mon Sep 19 10:13:21 2022] GET /identity/v3/role_assignments?group.id=cae904455ede418fa1cc578d3df1c794&scope.project.id=5f95307582374302a3632bd00efa5a75&role.id=43fe0942f9c9486ca3e7c83be55eb915 => generated 260 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:13:21.862083 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3e5718-4eea-4827-b9c3-a667803192eb None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:21.878217 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:21.920492 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f8bebb-937c-454c-af89-0f85655df3af None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:21.964543 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1216d95b-76a9-4667-a573-ebc1cc8c9326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:21.965206 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1216d95b-76a9-4667-a573-ebc1cc8c9326 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:21.965488 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1216d95b-76a9-4667-a573-ebc1cc8c9326 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:21.965763 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1216d95b-76a9-4667-a573-ebc1cc8c9326 None admin] PATH_INFO: `/v3/projects/5f95307582374302a3632bd00efa5a75` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:21.967138 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1216d95b-76a9-4667-a573-ebc1cc8c9326 None admin] RBAC: Authorizing `identity:get_project(project_id=5f95307582374302a3632bd00efa5a75)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:21.968672 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1216d95b-76a9-4667-a573-ebc1cc8c9326 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:21.970974 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 176/364] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Sep 19 10:13:21 2022] GET /identity/v3/projects/5f95307582374302a3632bd00efa5a75 => generated 298 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:13:21.971500 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1216d95b-76a9-4667-a573-ebc1cc8c9326 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:21.995951 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3e5718-4eea-4827-b9c3-a667803192eb None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:22.032433 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ab02e8-4ead-4970-ae6b-054728ae8a5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:22.033063 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ab02e8-4ead-4970-ae6b-054728ae8a5b None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:22.033353 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ab02e8-4ead-4970-ae6b-054728ae8a5b None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:22.033624 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ab02e8-4ead-4970-ae6b-054728ae8a5b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:22.034360 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ab02e8-4ead-4970-ae6b-054728ae8a5b None admin] RBAC: Adding query filter params (role.id=6c2e7a94daa04d7695a6fa91e5cca692, user.id=9e136b869d3c4c989b22d6cd62557c2b, scope.system=all) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:13:22.034665 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ab02e8-4ead-4970-ae6b-054728ae8a5b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:22.036133 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ab02e8-4ead-4970-ae6b-054728ae8a5b None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:22.052328 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 189/365] 10.222.0.66 () {56 vars in 1308 bytes} [Mon Sep 19 10:13:21 2022] GET /identity/v3/role_assignments?user.id=9e136b869d3c4c989b22d6cd62557c2b&scope.system=all&role.id=6c2e7a94daa04d7695a6fa91e5cca692 => generated 510 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:13:22.053708 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ab02e8-4ead-4970-ae6b-054728ae8a5b None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:22.090791 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:22.097595 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1216d95b-76a9-4667-a573-ebc1cc8c9326 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:22.149872 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1b8cc0-c307-4758-9344-0b3a6bb3ecf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:22.150540 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1b8cc0-c307-4758-9344-0b3a6bb3ecf5 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:22.150830 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1b8cc0-c307-4758-9344-0b3a6bb3ecf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:22.151097 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1b8cc0-c307-4758-9344-0b3a6bb3ecf5 None admin] PATH_INFO: `/v3/groups/cae904455ede418fa1cc578d3df1c794` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:22.152628 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1b8cc0-c307-4758-9344-0b3a6bb3ecf5 None admin] RBAC: Authorizing `identity:get_group(group_id=cae904455ede418fa1cc578d3df1c794)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:22.154704 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1b8cc0-c307-4758-9344-0b3a6bb3ecf5 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:22.162324 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 177/366] 10.222.0.66 () {56 vars in 1180 bytes} [Mon Sep 19 10:13:21 2022] GET /identity/v3/groups/cae904455ede418fa1cc578d3df1c794 => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:13:22.162324 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1b8cc0-c307-4758-9344-0b3a6bb3ecf5 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:22.190669 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:22.223660 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ab02e8-4ead-4970-ae6b-054728ae8a5b None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:22.268524 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f055b084-c357-48dd-b8e1-17da8adae723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:22.269144 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f055b084-c357-48dd-b8e1-17da8adae723 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:22.269426 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f055b084-c357-48dd-b8e1-17da8adae723 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:22.269702 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f055b084-c357-48dd-b8e1-17da8adae723 None admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:22.270368 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f055b084-c357-48dd-b8e1-17da8adae723 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:13:22.270686 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f055b084-c357-48dd-b8e1-17da8adae723 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:22.272727 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f055b084-c357-48dd-b8e1-17da8adae723 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:22.283001 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 190/367] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Sep 19 10:13:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:13:22.284265 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f055b084-c357-48dd-b8e1-17da8adae723 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:22.315099 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1b8cc0-c307-4758-9344-0b3a6bb3ecf5 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:22.365950 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9b4564-c89d-4694-9ce1-8a5b60596cf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:22.366604 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9b4564-c89d-4694-9ce1-8a5b60596cf8 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:22.366885 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9b4564-c89d-4694-9ce1-8a5b60596cf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:22.367157 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9b4564-c89d-4694-9ce1-8a5b60596cf8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:22.382310 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9b4564-c89d-4694-9ce1-8a5b60596cf8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 10:13:22.387867 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-bf9b4564-c89d-4694-9ce1-8a5b60596cf8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 10:13:22.387867 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:13:22.387867 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:13:22.387867 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:13:22.387867 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:13:22.387867 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:13:22.387867 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:13:22.387867 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:13:22.387867 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:13:22.387867 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:13:22.387867 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:13:22.387867 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:13:22.387867 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 10:13:22.387867 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 10:13:22.387867 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 10:13:22.387867 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 10:13:22.389082 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 10:13:22.389082 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 10:13:22.389082 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 10:13:22.389082 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 10:13:22.389082 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:13:22.389082 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:13:22.389082 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:13:22.389082 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:13:22.389082 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:13:22.389082 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:13:22.389082 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:13:22.389082 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Sep 19 10:13:22.389082 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:13:22.389082 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:13:22.389082 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:13:22.389082 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:13:22.390052 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:13:22.390052 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:13:22.390052 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:13:22.390052 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:13:22.390052 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 10:13:22.390052 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 10:13:22.390052 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 10:13:22.390052 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 10:13:22.390052 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 10:13:22.390052 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 10:13:22.390052 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 10:13:22.390052 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Sep 19 10:13:22.390052 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 178/368] 10.222.0.66 () {56 vars in 1096 bytes} [Mon Sep 19 10:13:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:13:22.390052 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9b4564-c89d-4694-9ce1-8a5b60596cf8 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:22.399609 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:22.425938 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f055b084-c357-48dd-b8e1-17da8adae723 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:22.466117 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857001d9-3b26-4caa-a4f5-14a63f6cab3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:22.466759 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857001d9-3b26-4caa-a4f5-14a63f6cab3d None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:22.467040 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857001d9-3b26-4caa-a4f5-14a63f6cab3d None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:22.467313 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857001d9-3b26-4caa-a4f5-14a63f6cab3d None admin] PATH_INFO: `/v3/groups/cae904455ede418fa1cc578d3df1c794` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:22.468758 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857001d9-3b26-4caa-a4f5-14a63f6cab3d None admin] RBAC: Authorizing `identity:get_group(group_id=cae904455ede418fa1cc578d3df1c794)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:22.470399 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857001d9-3b26-4caa-a4f5-14a63f6cab3d None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:22.472506 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 191/369] 10.222.0.66 () {56 vars in 1180 bytes} [Mon Sep 19 10:13:22 2022] GET /identity/v3/groups/cae904455ede418fa1cc578d3df1c794 => generated 226 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:13:22.474308 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857001d9-3b26-4caa-a4f5-14a63f6cab3d None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:22.508350 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:22.533731 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9b4564-c89d-4694-9ce1-8a5b60596cf8 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:22.586320 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e478ccb-6672-46b0-93ee-e3ffa04bb4c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:22.587033 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e478ccb-6672-46b0-93ee-e3ffa04bb4c6 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:22.587209 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e478ccb-6672-46b0-93ee-e3ffa04bb4c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:22.587542 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e478ccb-6672-46b0-93ee-e3ffa04bb4c6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:22.588696 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e478ccb-6672-46b0-93ee-e3ffa04bb4c6 None admin] RBAC: Adding query filter params (group.id=cae904455ede418fa1cc578d3df1c794, role.id=cd5b42ed3b754b58817a62bbe74651b4, scope.project.id=42b2443f228149a79b5bc408193a96bb) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:13:22.588696 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e478ccb-6672-46b0-93ee-e3ffa04bb4c6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:22.590428 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e478ccb-6672-46b0-93ee-e3ffa04bb4c6 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:22.596006 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 179/370] 10.222.0.66 () {56 vars in 1376 bytes} [Mon Sep 19 10:13:22 2022] GET /identity/v3/role_assignments?group.id=cae904455ede418fa1cc578d3df1c794&scope.project.id=42b2443f228149a79b5bc408193a96bb&role.id=cd5b42ed3b754b58817a62bbe74651b4 => generated 260 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:13:22.600379 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e478ccb-6672-46b0-93ee-e3ffa04bb4c6 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:22.622753 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857001d9-3b26-4caa-a4f5-14a63f6cab3d None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:22.675256 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadf4674-0056-4d8b-bb4b-04ce518e13a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:22.675486 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadf4674-0056-4d8b-bb4b-04ce518e13a6 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:22.675897 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadf4674-0056-4d8b-bb4b-04ce518e13a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:22.676197 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadf4674-0056-4d8b-bb4b-04ce518e13a6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:22.703163 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:22.729565 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e478ccb-6672-46b0-93ee-e3ffa04bb4c6 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:22.771831 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0fbb3e-4b3c-4d16-b99f-3e5dfadb2726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:22.773197 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0fbb3e-4b3c-4d16-b99f-3e5dfadb2726 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:22.773628 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0fbb3e-4b3c-4d16-b99f-3e5dfadb2726 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:22.774071 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0fbb3e-4b3c-4d16-b99f-3e5dfadb2726 None admin] PATH_INFO: `/v3/roles` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:22.774921 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0fbb3e-4b3c-4d16-b99f-3e5dfadb2726 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:13:22.775381 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0fbb3e-4b3c-4d16-b99f-3e5dfadb2726 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:22.776093 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadf4674-0056-4d8b-bb4b-04ce518e13a6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:22.777207 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0fbb3e-4b3c-4d16-b99f-3e5dfadb2726 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:22.777590 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadf4674-0056-4d8b-bb4b-04ce518e13a6 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:22.792758 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 180/371] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Sep 19 10:13:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:13:22.794382 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0fbb3e-4b3c-4d16-b99f-3e5dfadb2726 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:22.798866 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:22.913636 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0fbb3e-4b3c-4d16-b99f-3e5dfadb2726 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:22.921004 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 192/372] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Sep 19 10:13:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 10:13:22.923124 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadf4674-0056-4d8b-bb4b-04ce518e13a6 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:22.962918 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d011c74-10bd-4282-b64f-8f257806bb40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:22.963772 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d011c74-10bd-4282-b64f-8f257806bb40 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:22.964216 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d011c74-10bd-4282-b64f-8f257806bb40 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:22.964626 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d011c74-10bd-4282-b64f-8f257806bb40 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:22.966081 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d011c74-10bd-4282-b64f-8f257806bb40 None admin] RBAC: Adding query filter params (group.id=cae904455ede418fa1cc578d3df1c794, role.id=cd5b42ed3b754b58817a62bbe74651b4, scope.project.id=5f95307582374302a3632bd00efa5a75) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:13:22.966535 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d011c74-10bd-4282-b64f-8f257806bb40 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:22.968611 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d011c74-10bd-4282-b64f-8f257806bb40 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:22.975808 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:22.977259 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 181/373] 10.222.0.66 () {56 vars in 1376 bytes} [Mon Sep 19 10:13:22 2022] GET /identity/v3/role_assignments?group.id=cae904455ede418fa1cc578d3df1c794&scope.project.id=5f95307582374302a3632bd00efa5a75&role.id=cd5b42ed3b754b58817a62bbe74651b4 => generated 260 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:13:22.978216 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d011c74-10bd-4282-b64f-8f257806bb40 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:23.061834 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:23.101476 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadf4674-0056-4d8b-bb4b-04ce518e13a6 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:23.107037 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d011c74-10bd-4282-b64f-8f257806bb40 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:23.150857 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d2e16f-24d0-448a-bea3-fc9756db69c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:23.152527 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d2e16f-24d0-448a-bea3-fc9756db69c3 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:23.152983 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d2e16f-24d0-448a-bea3-fc9756db69c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:23.153394 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d2e16f-24d0-448a-bea3-fc9756db69c3 None admin] PATH_INFO: `/v3/projects/42b2443f228149a79b5bc408193a96bb` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:23.155065 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d2e16f-24d0-448a-bea3-fc9756db69c3 None admin] RBAC: Authorizing `identity:get_project(project_id=42b2443f228149a79b5bc408193a96bb)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:23.157036 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d2e16f-24d0-448a-bea3-fc9756db69c3 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:23.159477 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 182/374] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Sep 19 10:13:22 2022] GET /identity/v3/projects/42b2443f228149a79b5bc408193a96bb => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:13:23.166123 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d2e16f-24d0-448a-bea3-fc9756db69c3 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:23.200483 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be14f3d9-ad2e-497c-9841-42d4df8cea4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:23.201366 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be14f3d9-ad2e-497c-9841-42d4df8cea4e None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:23.201631 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be14f3d9-ad2e-497c-9841-42d4df8cea4e None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:23.201977 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be14f3d9-ad2e-497c-9841-42d4df8cea4e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:23.305303 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d2e16f-24d0-448a-bea3-fc9756db69c3 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:23.309836 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be14f3d9-ad2e-497c-9841-42d4df8cea4e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:23.312443 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be14f3d9-ad2e-497c-9841-42d4df8cea4e None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:23.376099 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d01c25d-49d6-41c8-9bfb-c081cc91cd66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:23.379176 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d01c25d-49d6-41c8-9bfb-c081cc91cd66 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:23.379641 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d01c25d-49d6-41c8-9bfb-c081cc91cd66 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:23.380083 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d01c25d-49d6-41c8-9bfb-c081cc91cd66 None admin] PATH_INFO: `/v3/groups/cae904455ede418fa1cc578d3df1c794` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:23.382943 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d01c25d-49d6-41c8-9bfb-c081cc91cd66 None admin] RBAC: Authorizing `identity:get_group(group_id=cae904455ede418fa1cc578d3df1c794)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:23.388027 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d01c25d-49d6-41c8-9bfb-c081cc91cd66 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:23.389959 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 183/375] 10.222.0.66 () {56 vars in 1180 bytes} [Mon Sep 19 10:13:23 2022] GET /identity/v3/groups/cae904455ede418fa1cc578d3df1c794 => generated 226 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 10:13:23.406161 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:23.413368 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d01c25d-49d6-41c8-9bfb-c081cc91cd66 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:23.417127 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:23.515138 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 193/376] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Sep 19 10:13:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 592 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 10:13:23.521802 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be14f3d9-ad2e-497c-9841-42d4df8cea4e None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:23.600050 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d01c25d-49d6-41c8-9bfb-c081cc91cd66 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:23.640535 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aadf2a-9df6-45d6-9dba-18b751a84491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:23.641158 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aadf2a-9df6-45d6-9dba-18b751a84491 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:23.641441 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aadf2a-9df6-45d6-9dba-18b751a84491 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:23.641882 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aadf2a-9df6-45d6-9dba-18b751a84491 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:23.642614 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81aadf2a-9df6-45d6-9dba-18b751a84491 None admin] RBAC: Adding query filter params (group.id=cae904455ede418fa1cc578d3df1c794, role.id=43fe0942f9c9486ca3e7c83be55eb915, scope.project.id=42b2443f228149a79b5bc408193a96bb) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:13:23.642924 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81aadf2a-9df6-45d6-9dba-18b751a84491 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:23.644474 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81aadf2a-9df6-45d6-9dba-18b751a84491 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:23.651778 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 184/377] 10.222.0.66 () {56 vars in 1376 bytes} [Mon Sep 19 10:13:23 2022] GET /identity/v3/role_assignments?group.id=cae904455ede418fa1cc578d3df1c794&scope.project.id=42b2443f228149a79b5bc408193a96bb&role.id=43fe0942f9c9486ca3e7c83be55eb915 => generated 260 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 10:13:23.705179 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be14f3d9-ad2e-497c-9841-42d4df8cea4e None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:23.747783 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b279cea-c638-4c27-89f2-b791818fa859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:23.748455 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b279cea-c638-4c27-89f2-b791818fa859 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:23.748738 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b279cea-c638-4c27-89f2-b791818fa859 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:23.749012 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b279cea-c638-4c27-89f2-b791818fa859 None admin] PATH_INFO: `/v3/projects/3c18c45cef234ea9b13f7b650328fff6` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:23.750152 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b279cea-c638-4c27-89f2-b791818fa859 None admin] RBAC: Authorizing `identity:get_project(project_id=3c18c45cef234ea9b13f7b650328fff6)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:23.751615 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b279cea-c638-4c27-89f2-b791818fa859 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:23.754274 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 194/378] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Sep 19 10:13:23 2022] GET /identity/v3/projects/3c18c45cef234ea9b13f7b650328fff6 => generated 344 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 10:13:23.758972 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aadf2a-9df6-45d6-9dba-18b751a84491 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:23.871477 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:23.910846 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aadf2a-9df6-45d6-9dba-18b751a84491 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:23.947670 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ca0f3a-7699-40c1-858d-26e47f2f0c5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:23.948715 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ca0f3a-7699-40c1-858d-26e47f2f0c5f None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:23.949207 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ca0f3a-7699-40c1-858d-26e47f2f0c5f None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:23.949704 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ca0f3a-7699-40c1-858d-26e47f2f0c5f None admin] PATH_INFO: `/v3/groups/0a72c1459f3f4be68569c6d81df4c53a` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:23.956544 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ca0f3a-7699-40c1-858d-26e47f2f0c5f None admin] RBAC: Authorizing `identity:get_group(group_id=0a72c1459f3f4be68569c6d81df4c53a)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:23.958419 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ca0f3a-7699-40c1-858d-26e47f2f0c5f None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:23.960619 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 185/379] 10.222.0.66 () {56 vars in 1180 bytes} [Mon Sep 19 10:13:23 2022] GET /identity/v3/groups/0a72c1459f3f4be68569c6d81df4c53a => generated 229 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:13:23.966124 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b279cea-c638-4c27-89f2-b791818fa859 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:24.006338 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:24.132050 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b279cea-c638-4c27-89f2-b791818fa859 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:24.183049 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43e5082-0066-48f2-b631-80f2362c4ffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:24.183673 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43e5082-0066-48f2-b631-80f2362c4ffd None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:24.183948 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43e5082-0066-48f2-b631-80f2362c4ffd None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:24.184243 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43e5082-0066-48f2-b631-80f2362c4ffd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:24.184963 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43e5082-0066-48f2-b631-80f2362c4ffd None admin] RBAC: Adding query filter params (group.id=0a72c1459f3f4be68569c6d81df4c53a, role.id=5c8b89fae4fa45bd944cbeaf442136e1, scope.project.id=3c18c45cef234ea9b13f7b650328fff6) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:13:24.185266 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43e5082-0066-48f2-b631-80f2362c4ffd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:24.186702 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43e5082-0066-48f2-b631-80f2362c4ffd None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:24.197800 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 195/380] 10.222.0.66 () {56 vars in 1376 bytes} [Mon Sep 19 10:13:23 2022] GET /identity/v3/role_assignments?group.id=0a72c1459f3f4be68569c6d81df4c53a&scope.project.id=3c18c45cef234ea9b13f7b650328fff6&role.id=5c8b89fae4fa45bd944cbeaf442136e1 => generated 260 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:13:24.314830 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdbc276-c915-4db9-b4ef-c7f74eefa863 None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:24.315157 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdbc276-c915-4db9-b4ef-c7f74eefa863 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:24.315376 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdbc276-c915-4db9-b4ef-c7f74eefa863 None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:24.317104 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 186/381] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:13:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:13:24.336108 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f42f7f-1e49-43ee-9d69-cd7a9f62f1c1 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:24.336461 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f42f7f-1e49-43ee-9d69-cd7a9f62f1c1 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:24.336677 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f42f7f-1e49-43ee-9d69-cd7a9f62f1c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:24.360978 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-61f42f7f-1e49-43ee-9d69-cd7a9f62f1c1 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:13:24.362167 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-61f42f7f-1e49-43ee-9d69-cd7a9f62f1c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:13:24.451547 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 196/382] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:13:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 10:13:24.719661 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdbc276-c915-4db9-b4ef-c7f74eefa863 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:24.853097 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdbc276-c915-4db9-b4ef-c7f74eefa863 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:24.894294 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:24.902874 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd0f23a-0c44-4255-b23f-dc758bd2caf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:24.903516 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd0f23a-0c44-4255-b23f-dc758bd2caf9 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:24.903793 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd0f23a-0c44-4255-b23f-dc758bd2caf9 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:24.904063 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd0f23a-0c44-4255-b23f-dc758bd2caf9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:24.921280 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd0f23a-0c44-4255-b23f-dc758bd2caf9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 10:13:24.926284 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-7cd0f23a-0c44-4255-b23f-dc758bd2caf9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 10:13:24.926284 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:13:24.926284 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:13:24.926284 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:13:24.926284 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:13:24.926284 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:13:24.926284 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:13:24.926284 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:13:24.926284 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:13:24.926284 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:13:24.926284 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:13:24.926284 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:13:24.926284 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 10:13:24.926284 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 10:13:24.926284 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 10:13:24.926284 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 10:13:24.927314 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 10:13:24.927314 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 10:13:24.927314 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 10:13:24.927314 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 10:13:24.927314 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:13:24.927314 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:13:24.927314 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:13:24.927314 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:13:24.927314 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:13:24.927314 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:13:24.927314 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:13:24.927314 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Sep 19 10:13:24.927314 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:13:24.927314 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:13:24.927314 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:13:24.927314 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:13:24.928122 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:13:24.928122 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:13:24.928122 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:13:24.928122 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:13:24.928122 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 10:13:24.928122 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 10:13:24.928122 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 10:13:24.928122 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 10:13:24.928122 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 10:13:24.928122 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 10:13:24.928122 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 10:13:24.928122 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Sep 19 10:13:24.928122 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 187/383] 10.222.0.66 () {56 vars in 1114 bytes} [Mon Sep 19 10:13:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:13:24.933975 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f42f7f-1e49-43ee-9d69-cd7a9f62f1c1 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:24.946947 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:25.074982 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f42f7f-1e49-43ee-9d69-cd7a9f62f1c1 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:25.092782 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff26735f-cdb1-4652-be1e-e88d3f3f5b4f None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:25.093063 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff26735f-cdb1-4652-be1e-e88d3f3f5b4f None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:25.093390 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff26735f-cdb1-4652-be1e-e88d3f3f5b4f None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:25.094959 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 188/384] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:13:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:13:25.119581 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9223cce7-4d1d-4fa9-9ca1-fde2212f0eff None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:25.119897 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9223cce7-4d1d-4fa9-9ca1-fde2212f0eff None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:25.120131 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9223cce7-4d1d-4fa9-9ca1-fde2212f0eff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:25.122312 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9829f471-c873-4a13-a6b1-dee1ee173f27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:25.127065 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9829f471-c873-4a13-a6b1-dee1ee173f27 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:25.127065 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9829f471-c873-4a13-a6b1-dee1ee173f27 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:25.127065 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9829f471-c873-4a13-a6b1-dee1ee173f27 None admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:25.127065 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9829f471-c873-4a13-a6b1-dee1ee173f27 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:13:25.127065 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9829f471-c873-4a13-a6b1-dee1ee173f27 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:25.127065 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9829f471-c873-4a13-a6b1-dee1ee173f27 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:25.136217 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 197/385] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Sep 19 10:13:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:13:25.151775 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9829f471-c873-4a13-a6b1-dee1ee173f27 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:25.156545 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-9223cce7-4d1d-4fa9-9ca1-fde2212f0eff None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:13:25.158090 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-9223cce7-4d1d-4fa9-9ca1-fde2212f0eff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:13:25.241907 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 189/386] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:13:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 10:13:25.283417 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:25.323057 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9829f471-c873-4a13-a6b1-dee1ee173f27 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:25.373505 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44196d4-fab9-4f07-8d81-995552348e7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:25.374409 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44196d4-fab9-4f07-8d81-995552348e7e None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:25.374893 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44196d4-fab9-4f07-8d81-995552348e7e None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:25.375362 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44196d4-fab9-4f07-8d81-995552348e7e None admin] PATH_INFO: `/v3/groups/cae904455ede418fa1cc578d3df1c794` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:25.376719 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44196d4-fab9-4f07-8d81-995552348e7e None admin] RBAC: Authorizing `identity:get_group(group_id=cae904455ede418fa1cc578d3df1c794)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:25.378324 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44196d4-fab9-4f07-8d81-995552348e7e None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:25.380385 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 198/387] 10.222.0.66 () {56 vars in 1180 bytes} [Mon Sep 19 10:13:25 2022] GET /identity/v3/groups/cae904455ede418fa1cc578d3df1c794 => generated 226 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 10:13:25.386437 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9223cce7-4d1d-4fa9-9ca1-fde2212f0eff None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:25.514027 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9223cce7-4d1d-4fa9-9ca1-fde2212f0eff None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:25.545595 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:25.561785 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc417519-fb96-4238-8191-8cee0fd534df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:25.562703 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc417519-fb96-4238-8191-8cee0fd534df None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:25.563154 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc417519-fb96-4238-8191-8cee0fd534df None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:25.563627 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc417519-fb96-4238-8191-8cee0fd534df None admin] PATH_INFO: `/v3/projects/5f95307582374302a3632bd00efa5a75` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:25.565221 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc417519-fb96-4238-8191-8cee0fd534df None admin] RBAC: Authorizing `identity:get_project(project_id=5f95307582374302a3632bd00efa5a75)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:25.565814 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44196d4-fab9-4f07-8d81-995552348e7e None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:25.567101 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc417519-fb96-4238-8191-8cee0fd534df None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:25.569000 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 190/388] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Sep 19 10:13:25 2022] GET /identity/v3/projects/5f95307582374302a3632bd00efa5a75 => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 10:13:25.574677 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc417519-fb96-4238-8191-8cee0fd534df None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:25.699522 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc417519-fb96-4238-8191-8cee0fd534df None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:25.734213 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ce39c9-9e2d-4682-b48b-b67e8ff87b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:25.735196 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ce39c9-9e2d-4682-b48b-b67e8ff87b5b None admin] REQUEST_METHOD: `PUT` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:25.735668 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ce39c9-9e2d-4682-b48b-b67e8ff87b5b None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:25.736112 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ce39c9-9e2d-4682-b48b-b67e8ff87b5b None admin] PATH_INFO: `/v3/projects/5f95307582374302a3632bd00efa5a75/groups/cae904455ede418fa1cc578d3df1c794/roles/43fe0942f9c9486ca3e7c83be55eb915` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:25.738571 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ce39c9-9e2d-4682-b48b-b67e8ff87b5b None admin] RBAC: Authorizing `identity:create_grant(project_id=5f95307582374302a3632bd00efa5a75, group_id=cae904455ede418fa1cc578d3df1c794, role_id=43fe0942f9c9486ca3e7c83be55eb915)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:25.740310 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44196d4-fab9-4f07-8d81-995552348e7e None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:25.741037 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ce39c9-9e2d-4682-b48b-b67e8ff87b5b None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:25.764345 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 191/389] 10.222.0.66 () {58 vars in 1442 bytes} [Mon Sep 19 10:13:25 2022] PUT /identity/v3/projects/5f95307582374302a3632bd00efa5a75/groups/cae904455ede418fa1cc578d3df1c794/roles/43fe0942f9c9486ca3e7c83be55eb915 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 10:13:25.800828 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f302593-69e6-418b-b89e-a7dcc8172f67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:25.801842 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f302593-69e6-418b-b89e-a7dcc8172f67 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:25.802972 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f302593-69e6-418b-b89e-a7dcc8172f67 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:25.803421 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f302593-69e6-418b-b89e-a7dcc8172f67 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:25.815915 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:25.822951 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f302593-69e6-418b-b89e-a7dcc8172f67 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 10:13:25.828393 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-2f302593-69e6-418b-b89e-a7dcc8172f67 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 19 10:13:25.828393 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:13:25.828393 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:13:25.828393 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:13:25.828393 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:13:25.828393 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:13:25.828393 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:13:25.828393 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:13:25.828393 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:13:25.828393 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:13:25.828393 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:13:25.828393 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:13:25.828393 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 10:13:25.828393 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 10:13:25.828393 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 10:13:25.828393 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 10:13:25.829353 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 10:13:25.829353 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 10:13:25.829353 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 10:13:25.829353 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 10:13:25.829353 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:13:25.829353 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:13:25.829353 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:13:25.829353 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:13:25.829353 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:13:25.829353 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:13:25.829353 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:13:25.829353 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 19 10:13:25.829353 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:13:25.829353 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:13:25.829353 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:13:25.829353 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:13:25.830543 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:13:25.830543 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:13:25.830543 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:13:25.830543 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:13:25.830543 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 10:13:25.830543 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 10:13:25.830543 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 10:13:25.830543 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 10:13:25.830543 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 10:13:25.830543 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 10:13:25.830543 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 19 10:13:25.830543 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 19 10:13:25.830543 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 199/390] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Sep 19 10:13:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 10:13:25.838488 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ce39c9-9e2d-4682-b48b-b67e8ff87b5b None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:25.904579 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:25.961606 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ce39c9-9e2d-4682-b48b-b67e8ff87b5b None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:26.010190 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8008dbdf-339b-4a41-8d32-3d4863c1277d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:26.011402 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8008dbdf-339b-4a41-8d32-3d4863c1277d None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:26.011914 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8008dbdf-339b-4a41-8d32-3d4863c1277d None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:26.012431 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8008dbdf-339b-4a41-8d32-3d4863c1277d None admin] PATH_INFO: `/v3/roles` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:26.013570 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8008dbdf-339b-4a41-8d32-3d4863c1277d None admin] RBAC: Adding query filter params (name=member) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:13:26.014108 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8008dbdf-339b-4a41-8d32-3d4863c1277d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:26.016707 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8008dbdf-339b-4a41-8d32-3d4863c1277d None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:26.034096 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 192/391] 10.222.0.66 () {56 vars in 1101 bytes} [Mon Sep 19 10:13:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:13:26.040550 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f302593-69e6-418b-b89e-a7dcc8172f67 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:26.139328 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b88b9d-20bb-48aa-a635-4e6aad44ab44 None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:26.139818 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b88b9d-20bb-48aa-a635-4e6aad44ab44 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:26.140323 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b88b9d-20bb-48aa-a635-4e6aad44ab44 None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:26.147814 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 193/392] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:13:26 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 10:13:26.149988 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a78c41f-ae6c-4bcf-83a4-c445d6c52180 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:26.150443 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a78c41f-ae6c-4bcf-83a4-c445d6c52180 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:26.150930 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a78c41f-ae6c-4bcf-83a4-c445d6c52180 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:26.177900 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f302593-69e6-418b-b89e-a7dcc8172f67 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:26.194035 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-9a78c41f-ae6c-4bcf-83a4-c445d6c52180 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:13:26.195257 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-9a78c41f-ae6c-4bcf-83a4-c445d6c52180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:13:26.248936 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0313c66-2c84-4e7a-8336-d8e7cf404472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:26.249467 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0313c66-2c84-4e7a-8336-d8e7cf404472 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:26.249751 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0313c66-2c84-4e7a-8336-d8e7cf404472 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:26.250030 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0313c66-2c84-4e7a-8336-d8e7cf404472 None admin] PATH_INFO: `/v3/groups/cae904455ede418fa1cc578d3df1c794` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:26.251637 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0313c66-2c84-4e7a-8336-d8e7cf404472 None admin] RBAC: Authorizing `identity:get_group(group_id=cae904455ede418fa1cc578d3df1c794)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:26.256485 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0313c66-2c84-4e7a-8336-d8e7cf404472 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:26.263069 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 200/393] 10.222.0.66 () {56 vars in 1180 bytes} [Mon Sep 19 10:13:26 2022] GET /identity/v3/groups/cae904455ede418fa1cc578d3df1c794 => generated 226 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:13:26.269892 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0313c66-2c84-4e7a-8336-d8e7cf404472 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:26.313599 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 194/394] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:13:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 10:13:26.316310 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989766ac-2cd8-4925-a574-d2aaeca47783 None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:26.316595 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989766ac-2cd8-4925-a574-d2aaeca47783 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:26.316871 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989766ac-2cd8-4925-a574-d2aaeca47783 None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:26.318839 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 195/395] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:13:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:13:26.324760 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e239ecc8-c05b-42f5-b574-b10b15d0bbb1 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:26.325518 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e239ecc8-c05b-42f5-b574-b10b15d0bbb1 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:26.325808 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e239ecc8-c05b-42f5-b574-b10b15d0bbb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:26.349812 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-e239ecc8-c05b-42f5-b574-b10b15d0bbb1 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:13:26.351006 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:26.352339 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-e239ecc8-c05b-42f5-b574-b10b15d0bbb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:13:26.388642 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0313c66-2c84-4e7a-8336-d8e7cf404472 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:26.410213 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:26.424457 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4fddec-58ef-4cc4-a98d-068edb146318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:26.425095 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4fddec-58ef-4cc4-a98d-068edb146318 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:26.425379 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4fddec-58ef-4cc4-a98d-068edb146318 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:26.425657 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4fddec-58ef-4cc4-a98d-068edb146318 None admin] PATH_INFO: `/v3/projects/42b2443f228149a79b5bc408193a96bb` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:26.428254 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4fddec-58ef-4cc4-a98d-068edb146318 None admin] RBAC: Authorizing `identity:get_project(project_id=42b2443f228149a79b5bc408193a96bb)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:26.429747 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4fddec-58ef-4cc4-a98d-068edb146318 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:26.431723 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 201/396] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Sep 19 10:13:26 2022] GET /identity/v3/projects/42b2443f228149a79b5bc408193a96bb => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 10:13:26.439820 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4fddec-58ef-4cc4-a98d-068edb146318 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:26.461426 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 196/397] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:13:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 10:13:26.576808 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4fddec-58ef-4cc4-a98d-068edb146318 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:26.611904 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127477ac-3284-4c73-8cb8-a8fae1a7752e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:26.612595 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127477ac-3284-4c73-8cb8-a8fae1a7752e None admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:26.612878 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127477ac-3284-4c73-8cb8-a8fae1a7752e None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:26.613154 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127477ac-3284-4c73-8cb8-a8fae1a7752e None admin] PATH_INFO: `/v3/projects/42b2443f228149a79b5bc408193a96bb/groups/cae904455ede418fa1cc578d3df1c794/roles/cd5b42ed3b754b58817a62bbe74651b4` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:26.615839 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127477ac-3284-4c73-8cb8-a8fae1a7752e None admin] RBAC: Authorizing `identity:create_grant(project_id=42b2443f228149a79b5bc408193a96bb, group_id=cae904455ede418fa1cc578d3df1c794, role_id=cd5b42ed3b754b58817a62bbe74651b4)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:26.617434 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127477ac-3284-4c73-8cb8-a8fae1a7752e None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:26.623510 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:26.632484 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e239ecc8-c05b-42f5-b574-b10b15d0bbb1 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:26.634998 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 202/398] 10.222.0.66 () {58 vars in 1442 bytes} [Mon Sep 19 10:13:26 2022] PUT /identity/v3/projects/42b2443f228149a79b5bc408193a96bb/groups/cae904455ede418fa1cc578d3df1c794/roles/cd5b42ed3b754b58817a62bbe74651b4 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 10:13:26.804361 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e239ecc8-c05b-42f5-b574-b10b15d0bbb1 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:26.849990 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e866aed-2d2e-4f56-9699-4bfddf553a7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:26.850549 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e866aed-2d2e-4f56-9699-4bfddf553a7e None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:26.850830 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e866aed-2d2e-4f56-9699-4bfddf553a7e None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:26.851101 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e866aed-2d2e-4f56-9699-4bfddf553a7e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:26.862041 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e866aed-2d2e-4f56-9699-4bfddf553a7e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 10:13:26.868511 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-0e866aed-2d2e-4f56-9699-4bfddf553a7e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 19 10:13:26.868511 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:13:26.868511 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:13:26.868511 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:13:26.868511 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:13:26.868511 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:13:26.868511 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:13:26.868511 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:13:26.868511 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:13:26.868511 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:13:26.868511 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:13:26.868511 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:13:26.868511 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 10:13:26.868511 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 10:13:26.868511 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 10:13:26.868511 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 10:13:26.869443 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 10:13:26.869443 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 10:13:26.869443 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 10:13:26.869443 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 10:13:26.869443 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:13:26.869443 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:13:26.869443 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:13:26.869443 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:13:26.869443 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:13:26.869443 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:13:26.869443 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:13:26.869443 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Sep 19 10:13:26.869443 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:13:26.869443 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:13:26.869443 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:13:26.869443 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:13:26.870221 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:13:26.870221 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:13:26.870221 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:13:26.870221 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:13:26.870221 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 10:13:26.870221 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 10:13:26.870221 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 10:13:26.870221 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 10:13:26.870221 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 10:13:26.870221 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 10:13:26.870221 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 19 10:13:26.870221 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Sep 19 10:13:26.870221 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 197/399] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Sep 19 10:13:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:13:26.875973 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127477ac-3284-4c73-8cb8-a8fae1a7752e None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:26.920337 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e866aed-2d2e-4f56-9699-4bfddf553a7e None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:26.965311 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:27.020543 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127477ac-3284-4c73-8cb8-a8fae1a7752e None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:27.063408 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ad6fcd-371e-458a-92f0-ba866cce288b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:27.065104 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ad6fcd-371e-458a-92f0-ba866cce288b None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:27.065750 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ad6fcd-371e-458a-92f0-ba866cce288b None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:27.068716 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ad6fcd-371e-458a-92f0-ba866cce288b None admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:27.069621 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ad6fcd-371e-458a-92f0-ba866cce288b None admin] RBAC: Adding query filter params (name=member) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:13:27.070130 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ad6fcd-371e-458a-92f0-ba866cce288b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:27.072951 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ad6fcd-371e-458a-92f0-ba866cce288b None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:27.083704 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e866aed-2d2e-4f56-9699-4bfddf553a7e None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:27.094918 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 203/400] 10.222.0.66 () {56 vars in 1101 bytes} [Mon Sep 19 10:13:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 10:13:27.100388 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ad6fcd-371e-458a-92f0-ba866cce288b None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:27.159921 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfacc6b-18eb-4ee3-9622-934914126baf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:27.160602 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfacc6b-18eb-4ee3-9622-934914126baf None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:27.160891 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfacc6b-18eb-4ee3-9622-934914126baf None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:27.161168 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfacc6b-18eb-4ee3-9622-934914126baf None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:27.179621 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:27.183333 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfacc6b-18eb-4ee3-9622-934914126baf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 10:13:27.189710 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-abfacc6b-18eb-4ee3-9622-934914126baf None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 10:13:27.189710 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:13:27.189710 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:13:27.189710 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:13:27.189710 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:13:27.189710 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:13:27.189710 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:13:27.189710 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:13:27.189710 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:13:27.189710 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:13:27.189710 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:13:27.189710 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:13:27.189710 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 10:13:27.189710 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 10:13:27.189710 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 10:13:27.189710 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 10:13:27.190611 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 10:13:27.190611 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 10:13:27.190611 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 10:13:27.190611 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 10:13:27.190611 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:13:27.190611 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:13:27.190611 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:13:27.190611 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:13:27.190611 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:13:27.190611 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:13:27.190611 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:13:27.190611 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Sep 19 10:13:27.190611 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:13:27.190611 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:13:27.190611 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:13:27.190611 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:13:27.191398 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:13:27.191398 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:13:27.191398 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:13:27.191398 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:13:27.191398 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 10:13:27.191398 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 10:13:27.191398 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 10:13:27.191398 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 10:13:27.191398 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 10:13:27.191398 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 10:13:27.191398 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 10:13:27.191398 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Sep 19 10:13:27.194158 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 198/401] 10.222.0.66 () {56 vars in 1114 bytes} [Mon Sep 19 10:13:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 10:13:27.202430 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfacc6b-18eb-4ee3-9622-934914126baf None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:27.273528 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ad6fcd-371e-458a-92f0-ba866cce288b None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:27.350081 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd32682-5ced-41c8-af8c-efd45007622b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:27.350816 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd32682-5ced-41c8-af8c-efd45007622b None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:27.351041 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd32682-5ced-41c8-af8c-efd45007622b None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:27.351319 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd32682-5ced-41c8-af8c-efd45007622b None admin] PATH_INFO: `/v3/groups/cae904455ede418fa1cc578d3df1c794` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:27.352503 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd32682-5ced-41c8-af8c-efd45007622b None admin] RBAC: Authorizing `identity:get_group(group_id=cae904455ede418fa1cc578d3df1c794)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:27.353919 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd32682-5ced-41c8-af8c-efd45007622b None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:27.356288 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 204/402] 10.222.0.66 () {56 vars in 1180 bytes} [Mon Sep 19 10:13:27 2022] GET /identity/v3/groups/cae904455ede418fa1cc578d3df1c794 => generated 226 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 10:13:27.357454 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b73892-903c-4206-adde-28e0e2ca5c75 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:27.357736 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b73892-903c-4206-adde-28e0e2ca5c75 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:27.358009 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b73892-903c-4206-adde-28e0e2ca5c75 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:27.359225 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 205/403] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:13:27 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:13:27.363877 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b73892-903c-4206-adde-28e0e2ca5c75 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:27.367558 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:27.380016 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfacc6b-18eb-4ee3-9622-934914126baf None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:27.429993 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baa6038-6331-40ef-a579-c6ba13ac1518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:27.430795 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baa6038-6331-40ef-a579-c6ba13ac1518 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:27.431121 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baa6038-6331-40ef-a579-c6ba13ac1518 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:27.431392 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baa6038-6331-40ef-a579-c6ba13ac1518 None admin] PATH_INFO: `/v3/roles` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:27.432049 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baa6038-6331-40ef-a579-c6ba13ac1518 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:13:27.434895 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baa6038-6331-40ef-a579-c6ba13ac1518 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:27.437386 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baa6038-6331-40ef-a579-c6ba13ac1518 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:27.455322 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 199/404] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Sep 19 10:13:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:13:27.455322 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda7f6bf-c3f1-452c-b5b6-281ee2c8144c None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:27.455322 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda7f6bf-c3f1-452c-b5b6-281ee2c8144c None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:27.455322 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda7f6bf-c3f1-452c-b5b6-281ee2c8144c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:27.473912 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-bda7f6bf-c3f1-452c-b5b6-281ee2c8144c None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:13:27.475352 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-bda7f6bf-c3f1-452c-b5b6-281ee2c8144c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:13:27.498545 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b73892-903c-4206-adde-28e0e2ca5c75 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:27.530451 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:27.542020 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b94c90-d932-4fc5-a261-1d9614d1987f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:27.543278 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b94c90-d932-4fc5-a261-1d9614d1987f None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:27.543766 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b94c90-d932-4fc5-a261-1d9614d1987f None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:27.544537 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b94c90-d932-4fc5-a261-1d9614d1987f None admin] PATH_INFO: `/v3/projects/5f95307582374302a3632bd00efa5a75` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:27.545949 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b94c90-d932-4fc5-a261-1d9614d1987f None admin] RBAC: Authorizing `identity:get_project(project_id=5f95307582374302a3632bd00efa5a75)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:27.547819 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b94c90-d932-4fc5-a261-1d9614d1987f None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:27.556198 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 206/406] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Sep 19 10:13:27 2022] GET /identity/v3/projects/5f95307582374302a3632bd00efa5a75 => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:13:27.556565 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 200/406] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:13:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 10:13:27.556565 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda7f6bf-c3f1-452c-b5b6-281ee2c8144c None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:27.557897 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b94c90-d932-4fc5-a261-1d9614d1987f None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:27.726078 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:27.758939 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda7f6bf-c3f1-452c-b5b6-281ee2c8144c None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:27.791152 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b94c90-d932-4fc5-a261-1d9614d1987f None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:27.812116 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f25797f-1151-4a3a-a088-1bed2e74b727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:27.820210 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f25797f-1151-4a3a-a088-1bed2e74b727 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:27.820784 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f25797f-1151-4a3a-a088-1bed2e74b727 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:27.821271 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f25797f-1151-4a3a-a088-1bed2e74b727 None admin] PATH_INFO: `/v3/groups/cae904455ede418fa1cc578d3df1c794` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:27.822714 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f25797f-1151-4a3a-a088-1bed2e74b727 None admin] RBAC: Authorizing `identity:get_group(group_id=cae904455ede418fa1cc578d3df1c794)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:27.824407 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f25797f-1151-4a3a-a088-1bed2e74b727 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:27.826630 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 201/407] 10.222.0.66 () {56 vars in 1180 bytes} [Mon Sep 19 10:13:27 2022] GET /identity/v3/groups/cae904455ede418fa1cc578d3df1c794 => generated 226 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:13:27.832573 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f25797f-1151-4a3a-a088-1bed2e74b727 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:27.838797 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747789ac-7bea-451a-94b6-3daaba038148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:27.840552 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747789ac-7bea-451a-94b6-3daaba038148 None admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:27.845390 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747789ac-7bea-451a-94b6-3daaba038148 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:27.845916 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747789ac-7bea-451a-94b6-3daaba038148 None admin] PATH_INFO: `/v3/projects/5f95307582374302a3632bd00efa5a75/groups/cae904455ede418fa1cc578d3df1c794/roles/cd5b42ed3b754b58817a62bbe74651b4` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:27.848102 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747789ac-7bea-451a-94b6-3daaba038148 None admin] RBAC: Authorizing `identity:create_grant(project_id=5f95307582374302a3632bd00efa5a75, group_id=cae904455ede418fa1cc578d3df1c794, role_id=cd5b42ed3b754b58817a62bbe74651b4)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:27.850391 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747789ac-7bea-451a-94b6-3daaba038148 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:27.872814 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 207/408] 10.222.0.66 () {58 vars in 1442 bytes} [Mon Sep 19 10:13:27 2022] PUT /identity/v3/projects/5f95307582374302a3632bd00efa5a75/groups/cae904455ede418fa1cc578d3df1c794/roles/cd5b42ed3b754b58817a62bbe74651b4 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:13:27.900737 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747789ac-7bea-451a-94b6-3daaba038148 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:27.964695 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:28.034257 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747789ac-7bea-451a-94b6-3daaba038148 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:28.055608 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f25797f-1151-4a3a-a088-1bed2e74b727 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:28.107406 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105fd28b-d4aa-48c4-b962-25e9dc27d15b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:28.107406 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105fd28b-d4aa-48c4-b962-25e9dc27d15b None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:28.107708 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105fd28b-d4aa-48c4-b962-25e9dc27d15b None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:28.107942 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105fd28b-d4aa-48c4-b962-25e9dc27d15b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:28.122476 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cf0889-3afe-4126-8142-f085bbf5a79b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:28.123037 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105fd28b-d4aa-48c4-b962-25e9dc27d15b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 10:13:28.123147 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cf0889-3afe-4126-8142-f085bbf5a79b None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:28.123389 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cf0889-3afe-4126-8142-f085bbf5a79b None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:28.123662 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cf0889-3afe-4126-8142-f085bbf5a79b None admin] PATH_INFO: `/v3/projects/42b2443f228149a79b5bc408193a96bb` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:28.124829 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cf0889-3afe-4126-8142-f085bbf5a79b None admin] RBAC: Authorizing `identity:get_project(project_id=42b2443f228149a79b5bc408193a96bb)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:28.126746 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cf0889-3afe-4126-8142-f085bbf5a79b None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:28.127901 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 202/409] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Sep 19 10:13:27 2022] GET /identity/v3/projects/42b2443f228149a79b5bc408193a96bb => generated 302 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:13:28.135842 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-105fd28b-d4aa-48c4-b962-25e9dc27d15b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 10:13:28.135842 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:13:28.135842 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:13:28.135842 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:13:28.135842 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:13:28.135842 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:13:28.135842 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:13:28.135842 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:13:28.135842 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:13:28.135842 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:13:28.135842 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:13:28.135842 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:13:28.135842 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 10:13:28.135842 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 10:13:28.135842 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 10:13:28.135842 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 10:13:28.136805 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 10:13:28.136805 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 10:13:28.136805 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 10:13:28.136805 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 10:13:28.136805 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:13:28.136805 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:13:28.136805 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:13:28.136805 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:13:28.136805 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:13:28.136805 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:13:28.136805 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:13:28.136805 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 19 10:13:28.136805 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:13:28.136805 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:13:28.136805 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:13:28.136805 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:13:28.137661 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:13:28.137661 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:13:28.137661 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:13:28.137661 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:13:28.137661 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 10:13:28.137661 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 10:13:28.137661 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 10:13:28.137661 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 10:13:28.137661 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 10:13:28.137661 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 10:13:28.137661 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 10:13:28.137661 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 19 10:13:28.138249 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cf0889-3afe-4126-8142-f085bbf5a79b None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:28.140426 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 208/410] 10.222.0.66 () {56 vars in 1096 bytes} [Mon Sep 19 10:13:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 10:13:28.147212 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105fd28b-d4aa-48c4-b962-25e9dc27d15b None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:28.162651 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:28.256520 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105fd28b-d4aa-48c4-b962-25e9dc27d15b None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:28.272545 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cf0889-3afe-4126-8142-f085bbf5a79b None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:28.276233 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:28.299924 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf07cb59-bd95-4e27-9d58-19b0dd365a66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:28.300954 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf07cb59-bd95-4e27-9d58-19b0dd365a66 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:28.301459 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf07cb59-bd95-4e27-9d58-19b0dd365a66 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:28.301948 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf07cb59-bd95-4e27-9d58-19b0dd365a66 None admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:28.303522 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf07cb59-bd95-4e27-9d58-19b0dd365a66 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:13:28.304040 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf07cb59-bd95-4e27-9d58-19b0dd365a66 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:28.305638 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf07cb59-bd95-4e27-9d58-19b0dd365a66 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:28.315064 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 209/411] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Sep 19 10:13:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:13:28.331452 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf07cb59-bd95-4e27-9d58-19b0dd365a66 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:28.341416 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e0b5ad-9fa7-4125-b03f-09bfa312ccff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:28.342245 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e0b5ad-9fa7-4125-b03f-09bfa312ccff None admin] REQUEST_METHOD: `PUT` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:28.342441 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e0b5ad-9fa7-4125-b03f-09bfa312ccff None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:28.342652 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e0b5ad-9fa7-4125-b03f-09bfa312ccff None admin] PATH_INFO: `/v3/projects/42b2443f228149a79b5bc408193a96bb/groups/cae904455ede418fa1cc578d3df1c794/roles/43fe0942f9c9486ca3e7c83be55eb915` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:28.348043 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e0b5ad-9fa7-4125-b03f-09bfa312ccff None admin] RBAC: Authorizing `identity:create_grant(project_id=42b2443f228149a79b5bc408193a96bb, group_id=cae904455ede418fa1cc578d3df1c794, role_id=43fe0942f9c9486ca3e7c83be55eb915)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:28.350097 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e0b5ad-9fa7-4125-b03f-09bfa312ccff None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:28.374477 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 203/412] 10.222.0.66 () {58 vars in 1442 bytes} [Mon Sep 19 10:13:28 2022] PUT /identity/v3/projects/42b2443f228149a79b5bc408193a96bb/groups/cae904455ede418fa1cc578d3df1c794/roles/43fe0942f9c9486ca3e7c83be55eb915 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:13:28.455245 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf07cb59-bd95-4e27-9d58-19b0dd365a66 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:28.492968 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938a156e-ca2b-4972-8815-6bdaef096fd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:28.494005 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938a156e-ca2b-4972-8815-6bdaef096fd0 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:28.494539 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938a156e-ca2b-4972-8815-6bdaef096fd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:28.495020 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938a156e-ca2b-4972-8815-6bdaef096fd0 None admin] PATH_INFO: `/v3/groups/0a72c1459f3f4be68569c6d81df4c53a` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:28.496719 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938a156e-ca2b-4972-8815-6bdaef096fd0 None admin] RBAC: Authorizing `identity:get_group(group_id=0a72c1459f3f4be68569c6d81df4c53a)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:28.498438 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938a156e-ca2b-4972-8815-6bdaef096fd0 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:28.500332 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 210/413] 10.222.0.66 () {56 vars in 1180 bytes} [Mon Sep 19 10:13:28 2022] GET /identity/v3/groups/0a72c1459f3f4be68569c6d81df4c53a => generated 229 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 10:13:28.509438 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e0b5ad-9fa7-4125-b03f-09bfa312ccff None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:28.520127 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c401c014-28e6-42ee-9eb1-7560010bfc05 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:28.520847 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c401c014-28e6-42ee-9eb1-7560010bfc05 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:28.521322 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c401c014-28e6-42ee-9eb1-7560010bfc05 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:28.522862 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 211/414] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:13:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 10:13:28.529089 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d871ffbe-d43e-4fdc-9ebd-c4b8b7dc33cc None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:28.529716 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d871ffbe-d43e-4fdc-9ebd-c4b8b7dc33cc None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:28.530186 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d871ffbe-d43e-4fdc-9ebd-c4b8b7dc33cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:28.555734 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-d871ffbe-d43e-4fdc-9ebd-c4b8b7dc33cc None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:13:28.557975 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-d871ffbe-d43e-4fdc-9ebd-c4b8b7dc33cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:13:28.652603 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:28.674963 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:28.707336 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 212/415] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:13:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 10:13:28.716504 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e0b5ad-9fa7-4125-b03f-09bfa312ccff None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:28.759707 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c11da55-6f41-415b-a3f9-b4ab9193221e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:28.760673 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c11da55-6f41-415b-a3f9-b4ab9193221e None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:28.761153 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c11da55-6f41-415b-a3f9-b4ab9193221e None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:28.761602 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c11da55-6f41-415b-a3f9-b4ab9193221e None admin] PATH_INFO: `/v3/projects/3c18c45cef234ea9b13f7b650328fff6` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:28.766794 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c11da55-6f41-415b-a3f9-b4ab9193221e None admin] RBAC: Authorizing `identity:get_project(project_id=3c18c45cef234ea9b13f7b650328fff6)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:28.768513 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c11da55-6f41-415b-a3f9-b4ab9193221e None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:28.771214 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 204/416] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Sep 19 10:13:28 2022] GET /identity/v3/projects/3c18c45cef234ea9b13f7b650328fff6 => generated 344 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:13:28.776888 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d871ffbe-d43e-4fdc-9ebd-c4b8b7dc33cc None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:28.922490 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d871ffbe-d43e-4fdc-9ebd-c4b8b7dc33cc None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:28.959444 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a2fcb6-9d3e-49de-9703-4cb30f1d2717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:28.960102 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a2fcb6-9d3e-49de-9703-4cb30f1d2717 None admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:28.960403 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a2fcb6-9d3e-49de-9703-4cb30f1d2717 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:28.960678 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a2fcb6-9d3e-49de-9703-4cb30f1d2717 None admin] PATH_INFO: `/v3/projects/3c18c45cef234ea9b13f7b650328fff6/groups/0a72c1459f3f4be68569c6d81df4c53a/roles/5c8b89fae4fa45bd944cbeaf442136e1` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:28.962697 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a2fcb6-9d3e-49de-9703-4cb30f1d2717 None admin] RBAC: Authorizing `identity:create_grant(project_id=3c18c45cef234ea9b13f7b650328fff6, group_id=0a72c1459f3f4be68569c6d81df4c53a, role_id=5c8b89fae4fa45bd944cbeaf442136e1)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:28.964203 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a2fcb6-9d3e-49de-9703-4cb30f1d2717 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:28.983909 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 213/417] 10.222.0.66 () {58 vars in 1442 bytes} [Mon Sep 19 10:13:28 2022] PUT /identity/v3/projects/3c18c45cef234ea9b13f7b650328fff6/groups/0a72c1459f3f4be68569c6d81df4c53a/roles/5c8b89fae4fa45bd944cbeaf442136e1 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:13:29.016401 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c11da55-6f41-415b-a3f9-b4ab9193221e None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:29.161956 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c11da55-6f41-415b-a3f9-b4ab9193221e None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:29.207944 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdaa7b8-8b2a-449d-a692-b3582357d4f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:29.208689 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdaa7b8-8b2a-449d-a692-b3582357d4f1 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:29.208975 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdaa7b8-8b2a-449d-a692-b3582357d4f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:29.209249 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdaa7b8-8b2a-449d-a692-b3582357d4f1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:29.226845 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdaa7b8-8b2a-449d-a692-b3582357d4f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 10:13:29.233174 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-7bdaa7b8-8b2a-449d-a692-b3582357d4f1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 10:13:29.233174 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:13:29.233174 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:13:29.233174 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:13:29.233174 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:13:29.233174 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:13:29.233174 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:13:29.233174 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:13:29.233174 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:13:29.233174 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:13:29.233174 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:13:29.233174 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:13:29.233174 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 10:13:29.233174 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 10:13:29.233174 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 10:13:29.233174 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 10:13:29.234131 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 10:13:29.234131 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 10:13:29.234131 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 10:13:29.234131 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 10:13:29.234131 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:13:29.234131 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:13:29.234131 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:13:29.234131 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:13:29.234131 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:13:29.234131 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:13:29.234131 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:13:29.234131 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Sep 19 10:13:29.234131 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:13:29.234131 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:13:29.234131 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:13:29.234131 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:13:29.234925 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:13:29.234925 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:13:29.234925 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:13:29.234925 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:13:29.234925 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 10:13:29.234925 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 10:13:29.234925 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 10:13:29.234925 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 10:13:29.234925 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 10:13:29.234925 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 10:13:29.234925 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 10:13:29.234925 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Sep 19 10:13:29.234925 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 205/418] 10.222.0.66 () {56 vars in 1114 bytes} [Mon Sep 19 10:13:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:13:29.242685 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a2fcb6-9d3e-49de-9703-4cb30f1d2717 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:29.283532 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:29.357952 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b40aeda-ccf1-4dab-befe-c6262cae5016 None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:29.358256 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b40aeda-ccf1-4dab-befe-c6262cae5016 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:29.358514 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b40aeda-ccf1-4dab-befe-c6262cae5016 None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:29.360460 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a2fcb6-9d3e-49de-9703-4cb30f1d2717 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:29.361239 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 206/419] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:13:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:13:29.365705 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf344098-3acb-4c37-99fc-1b65ef8d12b3 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:29.365987 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf344098-3acb-4c37-99fc-1b65ef8d12b3 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:29.366288 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf344098-3acb-4c37-99fc-1b65ef8d12b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:29.387968 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:29.400056 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-cf344098-3acb-4c37-99fc-1b65ef8d12b3 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:13:29.402108 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-cf344098-3acb-4c37-99fc-1b65ef8d12b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:13:29.407429 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcf4656-f59d-4522-96df-79d8a8e8403a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:29.408346 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcf4656-f59d-4522-96df-79d8a8e8403a None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:29.408829 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcf4656-f59d-4522-96df-79d8a8e8403a None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:29.409296 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcf4656-f59d-4522-96df-79d8a8e8403a None admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:29.410168 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcf4656-f59d-4522-96df-79d8a8e8403a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:13:29.410729 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcf4656-f59d-4522-96df-79d8a8e8403a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:29.412927 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcf4656-f59d-4522-96df-79d8a8e8403a None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:29.422393 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 214/420] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Sep 19 10:13:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:13:29.428989 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcf4656-f59d-4522-96df-79d8a8e8403a None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:29.529595 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:29.537099 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcf4656-f59d-4522-96df-79d8a8e8403a None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:29.567505 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 207/421] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:13:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 10:13:29.588504 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daaf56f-1999-48bc-9355-a1fb140c1434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:29.589316 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daaf56f-1999-48bc-9355-a1fb140c1434 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:29.589603 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daaf56f-1999-48bc-9355-a1fb140c1434 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:29.589881 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daaf56f-1999-48bc-9355-a1fb140c1434 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:29.680917 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0daaf56f-1999-48bc-9355-a1fb140c1434 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:29.682369 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0daaf56f-1999-48bc-9355-a1fb140c1434 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:29.788980 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:29.797883 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 215/422] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Sep 19 10:13:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 19 10:13:29.803906 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf344098-3acb-4c37-99fc-1b65ef8d12b3 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:29.934800 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf344098-3acb-4c37-99fc-1b65ef8d12b3 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:29.966118 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daaf56f-1999-48bc-9355-a1fb140c1434 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:29.978080 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a0b62f-e104-476d-95c9-f05ebc276a92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:29.979032 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a0b62f-e104-476d-95c9-f05ebc276a92 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:29.979486 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a0b62f-e104-476d-95c9-f05ebc276a92 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:29.979908 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a0b62f-e104-476d-95c9-f05ebc276a92 None admin] PATH_INFO: `/v3/projects/5f95307582374302a3632bd00efa5a75` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:29.986972 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a0b62f-e104-476d-95c9-f05ebc276a92 None admin] RBAC: Authorizing `identity:get_project(project_id=5f95307582374302a3632bd00efa5a75)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:29.988824 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a0b62f-e104-476d-95c9-f05ebc276a92 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:29.993394 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 208/423] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Sep 19 10:13:29 2022] GET /identity/v3/projects/5f95307582374302a3632bd00efa5a75 => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:13:30.001157 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a0b62f-e104-476d-95c9-f05ebc276a92 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:30.005803 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:30.090283 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daaf56f-1999-48bc-9355-a1fb140c1434 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:30.129923 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479f1e98-a751-4fb5-aa83-2ca3367343a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:30.131102 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479f1e98-a751-4fb5-aa83-2ca3367343a1 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:30.131380 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479f1e98-a751-4fb5-aa83-2ca3367343a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:30.131649 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479f1e98-a751-4fb5-aa83-2ca3367343a1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:30.152880 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479f1e98-a751-4fb5-aa83-2ca3367343a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 10:13:30.165137 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-479f1e98-a751-4fb5-aa83-2ca3367343a1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 19 10:13:30.165137 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:13:30.165137 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:13:30.165137 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:13:30.165137 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:13:30.165137 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:13:30.165137 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:13:30.165137 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:13:30.165137 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:13:30.165137 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:13:30.165137 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:13:30.165137 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:13:30.165137 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 10:13:30.165137 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 10:13:30.165137 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 10:13:30.165137 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 10:13:30.166069 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 10:13:30.166069 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 10:13:30.166069 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 10:13:30.166069 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 10:13:30.166069 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:13:30.166069 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:13:30.166069 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:13:30.166069 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:13:30.166069 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:13:30.166069 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:13:30.166069 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:13:30.166069 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 19 10:13:30.166069 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:13:30.166069 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:13:30.166069 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:13:30.166069 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:13:30.167492 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:13:30.167492 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:13:30.167492 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:13:30.167492 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:13:30.167492 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 10:13:30.167492 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 10:13:30.167492 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 10:13:30.167492 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 10:13:30.167492 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 10:13:30.167492 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 10:13:30.167492 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 19 10:13:30.167492 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 19 10:13:30.167492 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 216/424] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Sep 19 10:13:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:13:30.175356 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479f1e98-a751-4fb5-aa83-2ca3367343a1 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:30.203137 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a0b62f-e104-476d-95c9-f05ebc276a92 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:30.240335 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:30.264020 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ead9f8-a0a9-4c3f-af0f-23ac1452cc2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:30.264427 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ead9f8-a0a9-4c3f-af0f-23ac1452cc2c None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:30.264787 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ead9f8-a0a9-4c3f-af0f-23ac1452cc2c None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:30.265067 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ead9f8-a0a9-4c3f-af0f-23ac1452cc2c None admin] PATH_INFO: `/v3/groups/cae904455ede418fa1cc578d3df1c794` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:30.267485 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ead9f8-a0a9-4c3f-af0f-23ac1452cc2c None admin] RBAC: Authorizing `identity:get_group(group_id=cae904455ede418fa1cc578d3df1c794)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:30.268994 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ead9f8-a0a9-4c3f-af0f-23ac1452cc2c None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:30.276189 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 209/425] 10.222.0.66 () {56 vars in 1180 bytes} [Mon Sep 19 10:13:30 2022] GET /identity/v3/groups/cae904455ede418fa1cc578d3df1c794 => generated 226 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:13:30.288257 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ead9f8-a0a9-4c3f-af0f-23ac1452cc2c None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:30.304264 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479f1e98-a751-4fb5-aa83-2ca3367343a1 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:30.345036 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e3bb60-87b5-46f0-82a4-bfe847c9b24f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:30.346195 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e3bb60-87b5-46f0-82a4-bfe847c9b24f None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:30.349503 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e3bb60-87b5-46f0-82a4-bfe847c9b24f None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:30.350014 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e3bb60-87b5-46f0-82a4-bfe847c9b24f None admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:30.350889 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e3bb60-87b5-46f0-82a4-bfe847c9b24f None admin] RBAC: Adding query filter params (name=member) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:13:30.351390 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e3bb60-87b5-46f0-82a4-bfe847c9b24f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:30.353012 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e3bb60-87b5-46f0-82a4-bfe847c9b24f None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:30.369889 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 217/426] 10.222.0.66 () {56 vars in 1101 bytes} [Mon Sep 19 10:13:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:13:30.379510 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e3bb60-87b5-46f0-82a4-bfe847c9b24f None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:30.441318 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:30.477808 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ead9f8-a0a9-4c3f-af0f-23ac1452cc2c None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:30.515698 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3708b17-2d3d-4ae1-a88c-a96fa98ea9e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:30.516648 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3708b17-2d3d-4ae1-a88c-a96fa98ea9e9 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:30.517135 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3708b17-2d3d-4ae1-a88c-a96fa98ea9e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:30.517830 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3708b17-2d3d-4ae1-a88c-a96fa98ea9e9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:30.519016 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3708b17-2d3d-4ae1-a88c-a96fa98ea9e9 None admin] RBAC: Adding query filter params (group.id=cae904455ede418fa1cc578d3df1c794, role.id=43fe0942f9c9486ca3e7c83be55eb915, scope.project.id=5f95307582374302a3632bd00efa5a75) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:13:30.519526 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3708b17-2d3d-4ae1-a88c-a96fa98ea9e9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:30.522160 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3708b17-2d3d-4ae1-a88c-a96fa98ea9e9 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:30.530883 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 210/427] 10.222.0.66 () {56 vars in 1376 bytes} [Mon Sep 19 10:13:30 2022] GET /identity/v3/role_assignments?group.id=cae904455ede418fa1cc578d3df1c794&scope.project.id=5f95307582374302a3632bd00efa5a75&role.id=43fe0942f9c9486ca3e7c83be55eb915 => generated 611 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 10:13:30.532426 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978576ad-9a87-4f3f-89bb-a2baace047bf None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:30.532911 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978576ad-9a87-4f3f-89bb-a2baace047bf None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:30.533377 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978576ad-9a87-4f3f-89bb-a2baace047bf None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:30.535872 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 211/428] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:13:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:13:30.543800 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abc409d-14ec-4cbb-b087-d0b12c059b15 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:30.548632 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abc409d-14ec-4cbb-b087-d0b12c059b15 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:30.548632 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abc409d-14ec-4cbb-b087-d0b12c059b15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:30.577642 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-1abc409d-14ec-4cbb-b087-d0b12c059b15 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:13:30.578904 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-1abc409d-14ec-4cbb-b087-d0b12c059b15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:13:30.593010 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e3bb60-87b5-46f0-82a4-bfe847c9b24f None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:30.624764 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:30.656876 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11db7e36-37f5-4e6b-9ef3-f431976b1311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:30.657506 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11db7e36-37f5-4e6b-9ef3-f431976b1311 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:30.657784 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11db7e36-37f5-4e6b-9ef3-f431976b1311 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:30.658055 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11db7e36-37f5-4e6b-9ef3-f431976b1311 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:30.726397 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 212/429] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:13:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 10:13:30.784909 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11db7e36-37f5-4e6b-9ef3-f431976b1311 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:30.787020 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11db7e36-37f5-4e6b-9ef3-f431976b1311 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:30.893626 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 218/430] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Sep 19 10:13:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 515 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 10:13:30.900021 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abc409d-14ec-4cbb-b087-d0b12c059b15 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:30.991235 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:31.033086 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abc409d-14ec-4cbb-b087-d0b12c059b15 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:31.037018 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11db7e36-37f5-4e6b-9ef3-f431976b1311 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:31.058962 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:31.069857 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58a7cc0-ecf7-4048-aa7a-11539c0b65f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:31.070503 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58a7cc0-ecf7-4048-aa7a-11539c0b65f0 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:31.070787 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58a7cc0-ecf7-4048-aa7a-11539c0b65f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:31.071065 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58a7cc0-ecf7-4048-aa7a-11539c0b65f0 None admin] PATH_INFO: `/v3/projects/42b2443f228149a79b5bc408193a96bb` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:31.072220 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58a7cc0-ecf7-4048-aa7a-11539c0b65f0 None admin] RBAC: Authorizing `identity:get_project(project_id=42b2443f228149a79b5bc408193a96bb)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:31.073970 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58a7cc0-ecf7-4048-aa7a-11539c0b65f0 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:31.075952 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 213/431] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Sep 19 10:13:30 2022] GET /identity/v3/projects/42b2443f228149a79b5bc408193a96bb => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:13:31.081145 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58a7cc0-ecf7-4048-aa7a-11539c0b65f0 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:31.141333 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11db7e36-37f5-4e6b-9ef3-f431976b1311 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:31.177747 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5a44d3-ec10-4fc0-9ff6-7ad14d47d005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:31.178315 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5a44d3-ec10-4fc0-9ff6-7ad14d47d005 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:31.178592 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5a44d3-ec10-4fc0-9ff6-7ad14d47d005 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:31.178864 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5a44d3-ec10-4fc0-9ff6-7ad14d47d005 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:31.188981 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5a44d3-ec10-4fc0-9ff6-7ad14d47d005 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 10:13:31.194391 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58a7cc0-ecf7-4048-aa7a-11539c0b65f0 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:31.196029 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-bf5a44d3-ec10-4fc0-9ff6-7ad14d47d005 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 19 10:13:31.196029 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:13:31.196029 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:13:31.196029 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:13:31.196029 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:13:31.196029 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:13:31.196029 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:13:31.196029 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:13:31.196029 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:13:31.196029 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:13:31.196029 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:13:31.196029 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:13:31.196029 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 10:13:31.196029 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 10:13:31.196029 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 10:13:31.196029 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 10:13:31.196943 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 10:13:31.196943 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 10:13:31.196943 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 10:13:31.196943 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 10:13:31.196943 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:13:31.196943 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:13:31.196943 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:13:31.196943 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:13:31.196943 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:13:31.196943 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:13:31.196943 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:13:31.196943 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 19 10:13:31.196943 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:13:31.196943 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:13:31.196943 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:13:31.196943 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:13:31.197725 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:13:31.197725 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:13:31.197725 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:13:31.197725 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:13:31.197725 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 10:13:31.197725 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 10:13:31.197725 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 10:13:31.197725 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 10:13:31.197725 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 10:13:31.197725 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 10:13:31.197725 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 19 10:13:31.197725 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 19 10:13:31.197725 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 219/432] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Sep 19 10:13:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 10:13:31.198361 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00da4f1-6a7c-4bf9-8009-b7c178ac308b None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:31.199732 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00da4f1-6a7c-4bf9-8009-b7c178ac308b None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:31.199732 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00da4f1-6a7c-4bf9-8009-b7c178ac308b None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:31.200442 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 220/433] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:13:31 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:13:31.202648 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00da4f1-6a7c-4bf9-8009-b7c178ac308b None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:31.238805 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c61cddd-24df-46ae-a5d6-b19d6b0297ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:31.240094 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c61cddd-24df-46ae-a5d6-b19d6b0297ef None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:31.240616 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c61cddd-24df-46ae-a5d6-b19d6b0297ef None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:31.241310 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c61cddd-24df-46ae-a5d6-b19d6b0297ef None admin] PATH_INFO: `/v3/groups/cae904455ede418fa1cc578d3df1c794` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:31.242781 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c61cddd-24df-46ae-a5d6-b19d6b0297ef None admin] RBAC: Authorizing `identity:get_group(group_id=cae904455ede418fa1cc578d3df1c794)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:31.244441 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c61cddd-24df-46ae-a5d6-b19d6b0297ef None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:31.246328 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 214/434] 10.222.0.66 () {56 vars in 1180 bytes} [Mon Sep 19 10:13:31 2022] GET /identity/v3/groups/cae904455ede418fa1cc578d3df1c794 => generated 226 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 10:13:31.247484 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc36714-a4b5-4198-8691-b9f9cd3258bf None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:31.247768 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc36714-a4b5-4198-8691-b9f9cd3258bf None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:31.248046 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc36714-a4b5-4198-8691-b9f9cd3258bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:31.254798 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:31.267968 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-7dc36714-a4b5-4198-8691-b9f9cd3258bf None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:13:31.269235 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-7dc36714-a4b5-4198-8691-b9f9cd3258bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:13:31.299664 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:31.324265 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00da4f1-6a7c-4bf9-8009-b7c178ac308b None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:31.352205 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 215/435] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:13:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 10:13:31.352205 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc36714-a4b5-4198-8691-b9f9cd3258bf None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:31.370937 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c7ebe3-d964-44d9-9083-f0608264b7f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:31.371549 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c7ebe3-d964-44d9-9083-f0608264b7f1 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:31.371830 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c7ebe3-d964-44d9-9083-f0608264b7f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:31.372144 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c7ebe3-d964-44d9-9083-f0608264b7f1 None admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:31.372836 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c7ebe3-d964-44d9-9083-f0608264b7f1 None admin] RBAC: Adding query filter params (name=member) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:13:31.373130 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c7ebe3-d964-44d9-9083-f0608264b7f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:31.374652 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c7ebe3-d964-44d9-9083-f0608264b7f1 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:31.383763 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 221/436] 10.222.0.66 () {56 vars in 1101 bytes} [Mon Sep 19 10:13:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 10:13:31.389123 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c7ebe3-d964-44d9-9083-f0608264b7f1 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:31.465478 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc36714-a4b5-4198-8691-b9f9cd3258bf None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:31.495028 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c7ebe3-d964-44d9-9083-f0608264b7f1 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:31.498435 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:31.505397 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c82485-fe30-4066-93b4-5cb8a6e1066c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:31.506290 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c82485-fe30-4066-93b4-5cb8a6e1066c None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:31.506764 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c82485-fe30-4066-93b4-5cb8a6e1066c None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:31.507230 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c82485-fe30-4066-93b4-5cb8a6e1066c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:31.508260 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c82485-fe30-4066-93b4-5cb8a6e1066c None admin] RBAC: Adding query filter params (group.id=cae904455ede418fa1cc578d3df1c794, role.id=cd5b42ed3b754b58817a62bbe74651b4, scope.project.id=42b2443f228149a79b5bc408193a96bb) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:13:31.508886 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c82485-fe30-4066-93b4-5cb8a6e1066c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:31.510516 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c82485-fe30-4066-93b4-5cb8a6e1066c None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:31.517399 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 216/437] 10.222.0.66 () {56 vars in 1376 bytes} [Mon Sep 19 10:13:31 2022] GET /identity/v3/role_assignments?group.id=cae904455ede418fa1cc578d3df1c794&scope.project.id=42b2443f228149a79b5bc408193a96bb&role.id=cd5b42ed3b754b58817a62bbe74651b4 => generated 611 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:13:31.537654 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6c49fd-6ad8-483f-a32b-70b2d153b74c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:31.538681 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6c49fd-6ad8-483f-a32b-70b2d153b74c None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:31.539186 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6c49fd-6ad8-483f-a32b-70b2d153b74c None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:31.539647 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6c49fd-6ad8-483f-a32b-70b2d153b74c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:31.553686 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:31.619668 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6c49fd-6ad8-483f-a32b-70b2d153b74c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:31.621390 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c82485-fe30-4066-93b4-5cb8a6e1066c None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:31.621951 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6c49fd-6ad8-483f-a32b-70b2d153b74c None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:31.759023 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 222/438] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Sep 19 10:13:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 10:13:31.766065 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6c49fd-6ad8-483f-a32b-70b2d153b74c None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:31.770175 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c82485-fe30-4066-93b4-5cb8a6e1066c None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:31.817192 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db3fb09-03f2-4584-9666-3693b2b2dfbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:31.818390 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db3fb09-03f2-4584-9666-3693b2b2dfbb None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:31.818668 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db3fb09-03f2-4584-9666-3693b2b2dfbb None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:31.818941 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db3fb09-03f2-4584-9666-3693b2b2dfbb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:31.819764 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:31.833820 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db3fb09-03f2-4584-9666-3693b2b2dfbb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 10:13:31.841000 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-8db3fb09-03f2-4584-9666-3693b2b2dfbb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 10:13:31.841000 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:13:31.841000 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:13:31.841000 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:13:31.841000 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:13:31.841000 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:13:31.841000 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:13:31.841000 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:13:31.841000 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:13:31.841000 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:13:31.841000 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:13:31.841000 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:13:31.841000 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 10:13:31.841000 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 10:13:31.841000 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 10:13:31.841000 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 10:13:31.841883 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 10:13:31.841883 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 10:13:31.841883 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 10:13:31.841883 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 10:13:31.841883 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:13:31.841883 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:13:31.841883 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:13:31.841883 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:13:31.841883 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:13:31.841883 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:13:31.841883 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:13:31.841883 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Sep 19 10:13:31.841883 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:13:31.841883 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:13:31.841883 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:13:31.841883 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:13:31.845046 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:13:31.845046 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:13:31.845046 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:13:31.845046 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:13:31.845046 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 10:13:31.845046 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 10:13:31.845046 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 10:13:31.845046 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 10:13:31.845046 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 10:13:31.845046 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 10:13:31.845046 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 10:13:31.845046 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Sep 19 10:13:31.845046 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 217/439] 10.222.0.66 () {56 vars in 1114 bytes} [Mon Sep 19 10:13:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 10:13:31.847698 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db3fb09-03f2-4584-9666-3693b2b2dfbb None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:31.878708 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6c49fd-6ad8-483f-a32b-70b2d153b74c None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:31.906952 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:31.917192 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9740d520-05ab-46e5-a99a-099fe08cf936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:31.917832 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9740d520-05ab-46e5-a99a-099fe08cf936 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:31.918115 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9740d520-05ab-46e5-a99a-099fe08cf936 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:31.918387 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9740d520-05ab-46e5-a99a-099fe08cf936 None admin] PATH_INFO: `/v3/projects/5f95307582374302a3632bd00efa5a75` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:31.919802 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9740d520-05ab-46e5-a99a-099fe08cf936 None admin] RBAC: Authorizing `identity:get_project(project_id=5f95307582374302a3632bd00efa5a75)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:31.921272 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9740d520-05ab-46e5-a99a-099fe08cf936 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:31.923491 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 223/440] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Sep 19 10:13:31 2022] GET /identity/v3/projects/5f95307582374302a3632bd00efa5a75 => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:13:31.924322 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a2126d-e437-4133-aec7-8cf3ebc24ae2 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:31.924606 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a2126d-e437-4133-aec7-8cf3ebc24ae2 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:31.924881 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a2126d-e437-4133-aec7-8cf3ebc24ae2 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:31.928301 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 224/441] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:13:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:13:31.929760 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a2126d-e437-4133-aec7-8cf3ebc24ae2 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:31.953216 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db3fb09-03f2-4584-9666-3693b2b2dfbb None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:31.985921 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd60e3fd-35c6-4fd7-bd7d-24064017721a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:31.986525 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd60e3fd-35c6-4fd7-bd7d-24064017721a None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:31.986801 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd60e3fd-35c6-4fd7-bd7d-24064017721a None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:31.987072 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd60e3fd-35c6-4fd7-bd7d-24064017721a None admin] PATH_INFO: `/v3/roles` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:31.987729 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd60e3fd-35c6-4fd7-bd7d-24064017721a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:13:31.988038 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd60e3fd-35c6-4fd7-bd7d-24064017721a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:31.989484 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd60e3fd-35c6-4fd7-bd7d-24064017721a None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:31.997196 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 218/442] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Sep 19 10:13:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 10:13:31.998346 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec0ee16-68df-458a-a49b-394f0719361e None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:31.998609 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec0ee16-68df-458a-a49b-394f0719361e None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:31.998889 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec0ee16-68df-458a-a49b-394f0719361e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:32.017140 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-6ec0ee16-68df-458a-a49b-394f0719361e None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:13:32.018207 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-6ec0ee16-68df-458a-a49b-394f0719361e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:13:32.032318 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a2126d-e437-4133-aec7-8cf3ebc24ae2 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:32.042619 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:32.069152 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4b736c-437b-4050-8b56-85454c4cfc78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:32.069775 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4b736c-437b-4050-8b56-85454c4cfc78 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:32.070053 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4b736c-437b-4050-8b56-85454c4cfc78 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:32.070358 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4b736c-437b-4050-8b56-85454c4cfc78 None admin] PATH_INFO: `/v3/groups/cae904455ede418fa1cc578d3df1c794` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:32.071444 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4b736c-437b-4050-8b56-85454c4cfc78 None admin] RBAC: Authorizing `identity:get_group(group_id=cae904455ede418fa1cc578d3df1c794)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:32.072891 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4b736c-437b-4050-8b56-85454c4cfc78 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:32.074646 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 225/443] 10.222.0.66 () {56 vars in 1180 bytes} [Mon Sep 19 10:13:31 2022] GET /identity/v3/groups/cae904455ede418fa1cc578d3df1c794 => generated 226 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:13:32.075222 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4b736c-437b-4050-8b56-85454c4cfc78 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:32.092032 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 219/444] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:13:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 10:13:32.093206 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec0ee16-68df-458a-a49b-394f0719361e None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:32.154933 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:32.184958 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4b736c-437b-4050-8b56-85454c4cfc78 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:32.210452 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec0ee16-68df-458a-a49b-394f0719361e None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:32.220215 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9c356a-b038-4ebc-9692-7a11862557de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:32.220778 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9c356a-b038-4ebc-9692-7a11862557de None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:32.221055 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9c356a-b038-4ebc-9692-7a11862557de None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:32.221328 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9c356a-b038-4ebc-9692-7a11862557de None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:32.245131 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8e0809-a166-462e-bac5-ac424e71bef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:32.245739 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8e0809-a166-462e-bac5-ac424e71bef5 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:32.246024 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8e0809-a166-462e-bac5-ac424e71bef5 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:32.246303 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8e0809-a166-462e-bac5-ac424e71bef5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:32.247014 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8e0809-a166-462e-bac5-ac424e71bef5 None admin] RBAC: Adding query filter params (group.id=cae904455ede418fa1cc578d3df1c794, role.id=cd5b42ed3b754b58817a62bbe74651b4, scope.project.id=5f95307582374302a3632bd00efa5a75) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:13:32.247325 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8e0809-a166-462e-bac5-ac424e71bef5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:32.248800 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8e0809-a166-462e-bac5-ac424e71bef5 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:32.264201 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 220/445] 10.222.0.66 () {56 vars in 1376 bytes} [Mon Sep 19 10:13:32 2022] GET /identity/v3/role_assignments?group.id=cae904455ede418fa1cc578d3df1c794&scope.project.id=5f95307582374302a3632bd00efa5a75&role.id=cd5b42ed3b754b58817a62bbe74651b4 => generated 611 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:13:32.278698 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:32.309383 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9c356a-b038-4ebc-9692-7a11862557de None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:32.311265 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9c356a-b038-4ebc-9692-7a11862557de None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:32.367012 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8e0809-a166-462e-bac5-ac424e71bef5 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:32.425289 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 226/446] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Sep 19 10:13:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 10:13:32.431203 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9c356a-b038-4ebc-9692-7a11862557de None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:32.486171 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8e0809-a166-462e-bac5-ac424e71bef5 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:32.499567 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:32.523414 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:32.526316 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288ecabb-42d8-419f-83f6-731957debc77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:32.526919 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288ecabb-42d8-419f-83f6-731957debc77 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:32.527192 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288ecabb-42d8-419f-83f6-731957debc77 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:32.527459 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288ecabb-42d8-419f-83f6-731957debc77 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:32.539188 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288ecabb-42d8-419f-83f6-731957debc77 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 10:13:32.544769 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-288ecabb-42d8-419f-83f6-731957debc77 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 10:13:32.544769 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:13:32.544769 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:13:32.544769 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:13:32.544769 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:13:32.544769 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:13:32.544769 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:13:32.544769 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:13:32.544769 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:13:32.544769 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:13:32.544769 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:13:32.544769 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:13:32.544769 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 10:13:32.544769 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 10:13:32.544769 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 10:13:32.544769 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 10:13:32.545640 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 10:13:32.545640 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 10:13:32.545640 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 10:13:32.545640 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 10:13:32.545640 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:13:32.545640 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:13:32.545640 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:13:32.545640 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:13:32.545640 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:13:32.545640 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:13:32.545640 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:13:32.545640 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Sep 19 10:13:32.545640 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:13:32.545640 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:13:32.545640 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:13:32.545640 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:13:32.546428 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:13:32.546428 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:13:32.546428 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:13:32.546428 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:13:32.546428 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 10:13:32.546428 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 10:13:32.546428 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 10:13:32.546428 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 10:13:32.546428 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 10:13:32.546428 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 10:13:32.546428 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 10:13:32.546428 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Sep 19 10:13:32.546428 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 221/447] 10.222.0.66 () {56 vars in 1096 bytes} [Mon Sep 19 10:13:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 10:13:32.553221 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288ecabb-42d8-419f-83f6-731957debc77 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:32.553369 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9c356a-b038-4ebc-9692-7a11862557de None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:32.598481 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a26977-d5f6-4a59-b80a-216ce956ccfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:32.599317 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a26977-d5f6-4a59-b80a-216ce956ccfa None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:32.599497 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a26977-d5f6-4a59-b80a-216ce956ccfa None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:32.599752 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a26977-d5f6-4a59-b80a-216ce956ccfa None admin] PATH_INFO: `/v3/projects/42b2443f228149a79b5bc408193a96bb` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:32.601193 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a26977-d5f6-4a59-b80a-216ce956ccfa None admin] RBAC: Authorizing `identity:get_project(project_id=42b2443f228149a79b5bc408193a96bb)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:32.602737 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a26977-d5f6-4a59-b80a-216ce956ccfa None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:32.605305 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 227/448] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Sep 19 10:13:32 2022] GET /identity/v3/projects/42b2443f228149a79b5bc408193a96bb => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 10:13:32.609584 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a26977-d5f6-4a59-b80a-216ce956ccfa None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:32.672614 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288ecabb-42d8-419f-83f6-731957debc77 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:32.713634 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb1af8b-a250-464b-ad80-938e8c18e46c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:32.714252 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb1af8b-a250-464b-ad80-938e8c18e46c None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:32.714538 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb1af8b-a250-464b-ad80-938e8c18e46c None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:32.714816 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb1af8b-a250-464b-ad80-938e8c18e46c None admin] PATH_INFO: `/v3/roles` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:32.715481 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb1af8b-a250-464b-ad80-938e8c18e46c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:13:32.715788 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb1af8b-a250-464b-ad80-938e8c18e46c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:32.717239 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb1af8b-a250-464b-ad80-938e8c18e46c None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:32.726970 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 222/449] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Sep 19 10:13:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:13:32.731725 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a26977-d5f6-4a59-b80a-216ce956ccfa None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:32.732841 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb1af8b-a250-464b-ad80-938e8c18e46c None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:32.768630 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:32.774232 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f873412a-3416-49b9-b6c8-1b670b671128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:32.775222 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f873412a-3416-49b9-b6c8-1b670b671128 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:32.775503 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f873412a-3416-49b9-b6c8-1b670b671128 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:32.775771 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f873412a-3416-49b9-b6c8-1b670b671128 None admin] PATH_INFO: `/v3/groups/cae904455ede418fa1cc578d3df1c794` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:32.776949 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f873412a-3416-49b9-b6c8-1b670b671128 None admin] RBAC: Authorizing `identity:get_group(group_id=cae904455ede418fa1cc578d3df1c794)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:32.778877 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f873412a-3416-49b9-b6c8-1b670b671128 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:32.781219 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 228/450] 10.222.0.66 () {56 vars in 1180 bytes} [Mon Sep 19 10:13:32 2022] GET /identity/v3/groups/cae904455ede418fa1cc578d3df1c794 => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 10:13:32.787539 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f873412a-3416-49b9-b6c8-1b670b671128 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:32.805407 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:32.858553 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb1af8b-a250-464b-ad80-938e8c18e46c None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:32.898250 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9031b921-0bfc-4668-9458-cb9d1dcdedeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:32.898877 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9031b921-0bfc-4668-9458-cb9d1dcdedeb None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:32.899160 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9031b921-0bfc-4668-9458-cb9d1dcdedeb None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:32.899438 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9031b921-0bfc-4668-9458-cb9d1dcdedeb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:32.915526 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f873412a-3416-49b9-b6c8-1b670b671128 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:32.960994 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70a3b91-f3ba-48a7-881e-353739240071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:32.961606 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70a3b91-f3ba-48a7-881e-353739240071 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:32.961887 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70a3b91-f3ba-48a7-881e-353739240071 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:32.962161 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70a3b91-f3ba-48a7-881e-353739240071 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:32.963388 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70a3b91-f3ba-48a7-881e-353739240071 None admin] RBAC: Adding query filter params (group.id=cae904455ede418fa1cc578d3df1c794, role.id=43fe0942f9c9486ca3e7c83be55eb915, scope.project.id=42b2443f228149a79b5bc408193a96bb) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:13:32.963693 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70a3b91-f3ba-48a7-881e-353739240071 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:32.965317 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70a3b91-f3ba-48a7-881e-353739240071 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:32.971932 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 229/451] 10.222.0.66 () {56 vars in 1376 bytes} [Mon Sep 19 10:13:32 2022] GET /identity/v3/role_assignments?group.id=cae904455ede418fa1cc578d3df1c794&scope.project.id=42b2443f228149a79b5bc408193a96bb&role.id=43fe0942f9c9486ca3e7c83be55eb915 => generated 611 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:13:32.980355 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9031b921-0bfc-4668-9458-cb9d1dcdedeb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:32.981862 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9031b921-0bfc-4668-9458-cb9d1dcdedeb None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:33.017515 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:33.088103 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 223/452] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Sep 19 10:13:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 19 10:13:33.094031 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70a3b91-f3ba-48a7-881e-353739240071 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:33.175537 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:33.199521 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70a3b91-f3ba-48a7-881e-353739240071 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:33.235046 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7400a53-301a-4d4c-bdce-be68a2b65f3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:33.235689 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7400a53-301a-4d4c-bdce-be68a2b65f3a None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:33.235968 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7400a53-301a-4d4c-bdce-be68a2b65f3a None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:33.236279 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7400a53-301a-4d4c-bdce-be68a2b65f3a None admin] PATH_INFO: `/v3/projects/3c18c45cef234ea9b13f7b650328fff6` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:33.237397 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7400a53-301a-4d4c-bdce-be68a2b65f3a None admin] RBAC: Authorizing `identity:get_project(project_id=3c18c45cef234ea9b13f7b650328fff6)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:33.238837 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7400a53-301a-4d4c-bdce-be68a2b65f3a None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:33.241019 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 230/453] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Sep 19 10:13:33 2022] GET /identity/v3/projects/3c18c45cef234ea9b13f7b650328fff6 => generated 344 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:13:33.246596 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9031b921-0bfc-4668-9458-cb9d1dcdedeb None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:33.351141 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9031b921-0bfc-4668-9458-cb9d1dcdedeb None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:33.383943 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502c4424-0960-424f-995e-17acea8f1dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:33.384595 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502c4424-0960-424f-995e-17acea8f1dd6 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:33.384875 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502c4424-0960-424f-995e-17acea8f1dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:33.385145 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502c4424-0960-424f-995e-17acea8f1dd6 None admin] PATH_INFO: `/v3/groups/0a72c1459f3f4be68569c6d81df4c53a` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:33.386234 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502c4424-0960-424f-995e-17acea8f1dd6 None admin] RBAC: Authorizing `identity:get_group(group_id=0a72c1459f3f4be68569c6d81df4c53a)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:33.387693 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502c4424-0960-424f-995e-17acea8f1dd6 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:33.389298 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 224/454] 10.222.0.66 () {56 vars in 1180 bytes} [Mon Sep 19 10:13:33 2022] GET /identity/v3/groups/0a72c1459f3f4be68569c6d81df4c53a => generated 229 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:13:33.395233 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7400a53-301a-4d4c-bdce-be68a2b65f3a None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:33.495845 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7400a53-301a-4d4c-bdce-be68a2b65f3a None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:33.527620 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53708be-297b-40da-95c6-367e6c267481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:33.528241 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53708be-297b-40da-95c6-367e6c267481 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:33.528522 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53708be-297b-40da-95c6-367e6c267481 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:33.528794 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53708be-297b-40da-95c6-367e6c267481 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:33.529506 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53708be-297b-40da-95c6-367e6c267481 None admin] RBAC: Adding query filter params (group.id=0a72c1459f3f4be68569c6d81df4c53a, role.id=5c8b89fae4fa45bd944cbeaf442136e1, scope.project.id=3c18c45cef234ea9b13f7b650328fff6) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:13:33.529810 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53708be-297b-40da-95c6-367e6c267481 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:33.531233 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53708be-297b-40da-95c6-367e6c267481 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:33.537300 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 231/455] 10.222.0.66 () {56 vars in 1376 bytes} [Mon Sep 19 10:13:33 2022] GET /identity/v3/role_assignments?group.id=0a72c1459f3f4be68569c6d81df4c53a&scope.project.id=3c18c45cef234ea9b13f7b650328fff6&role.id=5c8b89fae4fa45bd944cbeaf442136e1 => generated 611 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:13:36.122795 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc8e7d5-4a3b-4b7b-9dae-3becfde30857 None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:36.123345 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc8e7d5-4a3b-4b7b-9dae-3becfde30857 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:36.123614 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc8e7d5-4a3b-4b7b-9dae-3becfde30857 None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:36.125150 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 225/456] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:13:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:13:36.131245 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31896f70-a734-42d7-93f6-3362b3d41781 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:36.132088 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31896f70-a734-42d7-93f6-3362b3d41781 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:36.132615 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31896f70-a734-42d7-93f6-3362b3d41781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:36.161794 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-31896f70-a734-42d7-93f6-3362b3d41781 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:13:36.163372 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-31896f70-a734-42d7-93f6-3362b3d41781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:13:36.165788 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:36.257939 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 232/457] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:13:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 10:13:36.380367 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342af0b5-fb7e-4aa0-b7c3-f9cd9a386434 None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:36.381000 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342af0b5-fb7e-4aa0-b7c3-f9cd9a386434 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:36.381477 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342af0b5-fb7e-4aa0-b7c3-f9cd9a386434 None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:36.383265 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 226/458] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:13:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:13:36.388434 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ee3f3c-8e0d-4e76-8f3f-6e418c4a7e78 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:36.388952 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ee3f3c-8e0d-4e76-8f3f-6e418c4a7e78 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:36.389442 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ee3f3c-8e0d-4e76-8f3f-6e418c4a7e78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:36.413155 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-37ee3f3c-8e0d-4e76-8f3f-6e418c4a7e78 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:13:36.414767 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-37ee3f3c-8e0d-4e76-8f3f-6e418c4a7e78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:13:36.501806 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 233/459] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:13:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 10:13:36.619705 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342af0b5-fb7e-4aa0-b7c3-f9cd9a386434 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:36.623084 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:36.757831 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342af0b5-fb7e-4aa0-b7c3-f9cd9a386434 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:36.763963 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a804e92-0742-4c61-8951-4c0fded38fac None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:36.764286 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a804e92-0742-4c61-8951-4c0fded38fac None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:36.764564 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a804e92-0742-4c61-8951-4c0fded38fac None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:36.766154 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 234/460] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:13:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:13:36.771388 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9be5241-c6fc-4dca-98d9-8f3ef1de981a None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:36.771668 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9be5241-c6fc-4dca-98d9-8f3ef1de981a None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:36.771944 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9be5241-c6fc-4dca-98d9-8f3ef1de981a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:36.790354 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-d9be5241-c6fc-4dca-98d9-8f3ef1de981a None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:13:36.791581 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-d9be5241-c6fc-4dca-98d9-8f3ef1de981a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:13:36.807494 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c48af69-a115-42a5-99f3-6ca0cb1e79e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:36.808277 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c48af69-a115-42a5-99f3-6ca0cb1e79e4 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:36.808556 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c48af69-a115-42a5-99f3-6ca0cb1e79e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:36.808827 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c48af69-a115-42a5-99f3-6ca0cb1e79e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:36.823981 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c48af69-a115-42a5-99f3-6ca0cb1e79e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:36.825698 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c48af69-a115-42a5-99f3-6ca0cb1e79e4 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:36.858770 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-2c48af69-a115-42a5-99f3-6ca0cb1e79e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 10:13:36.858770 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:13:36.858770 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:13:36.858770 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:13:36.858770 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:13:36.858770 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:13:36.858770 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:13:36.858770 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:13:36.858770 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:13:36.858770 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:13:36.858770 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:13:36.858770 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:13:36.858770 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 10:13:36.858770 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 10:13:36.858770 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 10:13:36.858770 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 10:13:36.859962 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:13:36.859962 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:13:36.859962 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:13:36.859962 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:13:36.859962 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:13:36.859962 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:13:36.859962 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:13:36.859962 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Sep 19 10:13:36.859962 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:13:36.859962 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:13:36.859962 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:13:36.859962 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:13:36.859962 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:13:36.859962 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:13:36.859962 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:13:36.859962 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:13:36.859962 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 10:13:36.861049 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 10:13:36.861049 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 10:13:36.861049 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Sep 19 10:13:36.861049 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 227/461] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 19 10:13:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:13:36.864210 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c48af69-a115-42a5-99f3-6ca0cb1e79e4 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:36.883598 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:36.896649 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 235/462] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:13:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 10:13:36.897815 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9be5241-c6fc-4dca-98d9-8f3ef1de981a None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:36.987834 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:37.060805 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c48af69-a115-42a5-99f3-6ca0cb1e79e4 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:37.080051 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9be5241-c6fc-4dca-98d9-8f3ef1de981a None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:37.101476 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0bd2b9-04f3-4621-a65e-8db92ec25052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:37.102412 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0bd2b9-04f3-4621-a65e-8db92ec25052 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:37.102914 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0bd2b9-04f3-4621-a65e-8db92ec25052 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:37.103832 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0bd2b9-04f3-4621-a65e-8db92ec25052 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:37.117360 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c6cff3-aeab-4ab5-8a12-22ecb821726c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:37.117821 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0bd2b9-04f3-4621-a65e-8db92ec25052 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:37.117996 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c6cff3-aeab-4ab5-8a12-22ecb821726c None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:37.118245 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c6cff3-aeab-4ab5-8a12-22ecb821726c None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:37.118572 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c6cff3-aeab-4ab5-8a12-22ecb821726c None admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:37.119275 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c6cff3-aeab-4ab5-8a12-22ecb821726c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:13:37.119586 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c6cff3-aeab-4ab5-8a12-22ecb821726c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:37.120537 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0bd2b9-04f3-4621-a65e-8db92ec25052 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:37.121031 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c6cff3-aeab-4ab5-8a12-22ecb821726c None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:37.138737 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-5e0bd2b9-04f3-4621-a65e-8db92ec25052 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 10:13:37.138737 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:13:37.138737 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:13:37.138737 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:13:37.138737 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:13:37.138737 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:13:37.138737 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:13:37.138737 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:13:37.138737 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:13:37.138737 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:13:37.138737 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:13:37.138737 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:13:37.138737 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 10:13:37.138737 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 10:13:37.138737 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 10:13:37.138737 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 10:13:37.140008 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:13:37.140008 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:13:37.140008 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:13:37.140008 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:13:37.140008 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:13:37.140008 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:13:37.140008 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:13:37.140008 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Sep 19 10:13:37.140008 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:13:37.140008 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:13:37.140008 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:13:37.140008 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:13:37.140008 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:13:37.140008 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:13:37.140008 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:13:37.140008 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:13:37.140008 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 10:13:37.141210 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 10:13:37.141210 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 10:13:37.141210 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Sep 19 10:13:37.141371 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 236/463] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Sep 19 10:13:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:13:37.142322 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c289352-b036-487c-b481-11fea1418c37 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:37.142617 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c289352-b036-487c-b481-11fea1418c37 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:37.142894 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c289352-b036-487c-b481-11fea1418c37 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:37.143954 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 228/464] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 19 10:13:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:13:37.149337 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0bd2b9-04f3-4621-a65e-8db92ec25052 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:37.149473 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 237/465] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:13:37 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:13:37.151515 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c67bff9-9b86-4ca2-ac8b-6047563471dd None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:37.151807 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c67bff9-9b86-4ca2-ac8b-6047563471dd None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:37.152088 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c67bff9-9b86-4ca2-ac8b-6047563471dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:37.172592 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-9c67bff9-9b86-4ca2-ac8b-6047563471dd None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:13:37.173854 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-9c67bff9-9b86-4ca2-ac8b-6047563471dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:13:37.234087 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:37.250200 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 238/466] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:13:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 10:13:37.250980 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c67bff9-9b86-4ca2-ac8b-6047563471dd None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:37.275477 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0bd2b9-04f3-4621-a65e-8db92ec25052 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:37.283756 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:37.323723 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7848ab6d-4a0e-4c14-abaf-4ca48330b0c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:37.324775 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7848ab6d-4a0e-4c14-abaf-4ca48330b0c7 None admin] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:37.325255 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7848ab6d-4a0e-4c14-abaf-4ca48330b0c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:37.325811 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7848ab6d-4a0e-4c14-abaf-4ca48330b0c7 None admin] PATH_INFO: `/v3/users` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:37.326850 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7848ab6d-4a0e-4c14-abaf-4ca48330b0c7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:37.328804 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7848ab6d-4a0e-4c14-abaf-4ca48330b0c7 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:37.354699 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 229/467] 10.222.0.66 () {60 vars in 1132 bytes} [Mon Sep 19 10:13:37 2022] POST /identity/v3/users => generated 246 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:13:37.356129 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7848ab6d-4a0e-4c14-abaf-4ca48330b0c7 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:37.378429 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c67bff9-9b86-4ca2-ac8b-6047563471dd None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:37.450687 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acd1cc7-0f42-4979-a540-c8ec33dcb27a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:37.451330 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acd1cc7-0f42-4979-a540-c8ec33dcb27a None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:37.451588 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acd1cc7-0f42-4979-a540-c8ec33dcb27a None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:37.451867 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acd1cc7-0f42-4979-a540-c8ec33dcb27a None admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:37.452541 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acd1cc7-0f42-4979-a540-c8ec33dcb27a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:13:37.452897 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acd1cc7-0f42-4979-a540-c8ec33dcb27a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:37.456217 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acd1cc7-0f42-4979-a540-c8ec33dcb27a None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:37.467765 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 239/468] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Sep 19 10:13:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:13:37.472683 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acd1cc7-0f42-4979-a540-c8ec33dcb27a None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:37.564541 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7848ab6d-4a0e-4c14-abaf-4ca48330b0c7 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:37.592747 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:37.610815 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5aad44-0c60-4a1c-8591-c30e01f922ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:37.611588 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5aad44-0c60-4a1c-8591-c30e01f922ca None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:37.611961 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5aad44-0c60-4a1c-8591-c30e01f922ca None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:37.612417 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5aad44-0c60-4a1c-8591-c30e01f922ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:37.627080 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5aad44-0c60-4a1c-8591-c30e01f922ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:37.629016 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5aad44-0c60-4a1c-8591-c30e01f922ca None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:37.638327 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acd1cc7-0f42-4979-a540-c8ec33dcb27a None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:37.646531 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-7c5aad44-0c60-4a1c-8591-c30e01f922ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 10:13:37.646531 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:13:37.646531 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:13:37.646531 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:13:37.646531 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:13:37.646531 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:13:37.646531 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:13:37.646531 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:13:37.646531 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:13:37.646531 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:13:37.646531 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:13:37.646531 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:13:37.646531 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 10:13:37.646531 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 10:13:37.646531 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 10:13:37.646531 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 10:13:37.647419 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:13:37.647419 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:13:37.647419 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:13:37.647419 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:13:37.647419 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:13:37.647419 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:13:37.647419 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:13:37.647419 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Sep 19 10:13:37.647419 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:13:37.647419 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:13:37.647419 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:13:37.647419 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:13:37.647419 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:13:37.647419 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:13:37.647419 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:13:37.647419 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:13:37.647419 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 10:13:37.648277 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 10:13:37.648277 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 10:13:37.648277 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Sep 19 10:13:37.648277 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 230/469] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 19 10:13:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:13:37.648716 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5aad44-0c60-4a1c-8591-c30e01f922ca None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:37.671303 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:37.699149 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdd4bb2-0a05-407a-9c24-7b2445d0946b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:37.699786 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdd4bb2-0a05-407a-9c24-7b2445d0946b None admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:37.700071 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdd4bb2-0a05-407a-9c24-7b2445d0946b None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:37.700375 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdd4bb2-0a05-407a-9c24-7b2445d0946b None admin] PATH_INFO: `/v3/users` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:37.701041 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdd4bb2-0a05-407a-9c24-7b2445d0946b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:37.703108 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdd4bb2-0a05-407a-9c24-7b2445d0946b None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:37.731373 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 240/470] 10.222.0.66 () {60 vars in 1132 bytes} [Mon Sep 19 10:13:37 2022] POST /identity/v3/users => generated 248 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 10:13:37.733450 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdd4bb2-0a05-407a-9c24-7b2445d0946b None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:37.800794 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5aad44-0c60-4a1c-8591-c30e01f922ca None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:37.841344 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fb6a80-1534-4b49-9c4b-acafc54f9c07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:37.841940 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fb6a80-1534-4b49-9c4b-acafc54f9c07 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:37.842204 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fb6a80-1534-4b49-9c4b-acafc54f9c07 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:37.842469 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fb6a80-1534-4b49-9c4b-acafc54f9c07 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:37.854912 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fb6a80-1534-4b49-9c4b-acafc54f9c07 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:37.856489 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fb6a80-1534-4b49-9c4b-acafc54f9c07 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:37.874864 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-e9fb6a80-1534-4b49-9c4b-acafc54f9c07 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 10:13:37.874864 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:13:37.874864 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:13:37.874864 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:13:37.874864 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:13:37.874864 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:13:37.874864 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:13:37.874864 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:13:37.874864 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:13:37.874864 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:13:37.874864 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:13:37.874864 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:13:37.874864 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 10:13:37.874864 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 10:13:37.874864 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 10:13:37.874864 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 10:13:37.876025 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:13:37.876025 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:13:37.876025 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:13:37.876025 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:13:37.876025 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:13:37.876025 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:13:37.876025 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:13:37.876025 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Sep 19 10:13:37.876025 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:13:37.876025 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:13:37.876025 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:13:37.876025 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:13:37.876025 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:13:37.876025 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:13:37.876025 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:13:37.876025 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:13:37.876025 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 10:13:37.877553 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 10:13:37.877553 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 10:13:37.877553 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Sep 19 10:13:37.877553 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 231/471] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 19 10:13:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:13:37.877553 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd9e608-e227-43cc-a6aa-2608138fdb41 None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:37.877553 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd9e608-e227-43cc-a6aa-2608138fdb41 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:37.877895 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd9e608-e227-43cc-a6aa-2608138fdb41 None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:37.883929 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 232/472] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:13:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:13:37.885183 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3193d22a-a857-4ec4-a0a2-9af549bfeb4f None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:37.885463 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3193d22a-a857-4ec4-a0a2-9af549bfeb4f None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:37.885737 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3193d22a-a857-4ec4-a0a2-9af549bfeb4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:37.906219 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-3193d22a-a857-4ec4-a0a2-9af549bfeb4f None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:13:37.907584 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-3193d22a-a857-4ec4-a0a2-9af549bfeb4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:13:37.917609 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdd4bb2-0a05-407a-9c24-7b2445d0946b None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:37.921994 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:37.972804 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb11697-2a76-4195-8749-e535c59bb256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:37.974698 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb11697-2a76-4195-8749-e535c59bb256 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:37.975139 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb11697-2a76-4195-8749-e535c59bb256 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:37.975588 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb11697-2a76-4195-8749-e535c59bb256 None admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:37.976446 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb11697-2a76-4195-8749-e535c59bb256 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:13:37.976901 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb11697-2a76-4195-8749-e535c59bb256 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:37.977739 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:37.978597 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb11697-2a76-4195-8749-e535c59bb256 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:37.987666 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 233/473] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:13:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 10:13:37.988554 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3193d22a-a857-4ec4-a0a2-9af549bfeb4f None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:37.992908 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 241/474] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Sep 19 10:13:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:13:37.998449 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb11697-2a76-4195-8749-e535c59bb256 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:38.113730 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb11697-2a76-4195-8749-e535c59bb256 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:38.119270 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3193d22a-a857-4ec4-a0a2-9af549bfeb4f None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:38.165051 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8368b4c7-88e4-41ac-8c9e-9169c74a7503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:38.165666 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8368b4c7-88e4-41ac-8c9e-9169c74a7503 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:38.168185 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8368b4c7-88e4-41ac-8c9e-9169c74a7503 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:38.168185 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8368b4c7-88e4-41ac-8c9e-9169c74a7503 None admin] PATH_INFO: `/v3/domains` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:38.168677 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8368b4c7-88e4-41ac-8c9e-9169c74a7503 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:13:38.169239 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8368b4c7-88e4-41ac-8c9e-9169c74a7503 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:38.170621 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8368b4c7-88e4-41ac-8c9e-9169c74a7503 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:38.172833 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e51231-1d32-493a-88e6-c14fc85e89c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:38.173436 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e51231-1d32-493a-88e6-c14fc85e89c1 None admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:38.173709 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e51231-1d32-493a-88e6-c14fc85e89c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:38.173973 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e51231-1d32-493a-88e6-c14fc85e89c1 None admin] PATH_INFO: `/v3/users` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:38.174651 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e51231-1d32-493a-88e6-c14fc85e89c1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:38.176107 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e51231-1d32-493a-88e6-c14fc85e89c1 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:38.213252 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 234/475] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Sep 19 10:13:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:13:38.220941 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 242/476] 10.222.0.66 () {60 vars in 1132 bytes} [Mon Sep 19 10:13:37 2022] POST /identity/v3/users => generated 248 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 10:13:38.221903 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8368b4c7-88e4-41ac-8c9e-9169c74a7503 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:38.289178 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:38.328694 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e51231-1d32-493a-88e6-c14fc85e89c1 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:38.364451 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:38.366408 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8368b4c7-88e4-41ac-8c9e-9169c74a7503 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:38.443143 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5695d0a-1d36-41e1-a821-272ad664a06a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:38.445047 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5695d0a-1d36-41e1-a821-272ad664a06a None admin] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:38.446322 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5695d0a-1d36-41e1-a821-272ad664a06a None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:38.447125 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5695d0a-1d36-41e1-a821-272ad664a06a None admin] PATH_INFO: `/v3/users` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:38.448019 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5695d0a-1d36-41e1-a821-272ad664a06a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:38.449756 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5695d0a-1d36-41e1-a821-272ad664a06a None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:38.481493 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 235/477] 10.222.0.66 () {60 vars in 1132 bytes} [Mon Sep 19 10:13:38 2022] POST /identity/v3/users => generated 249 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:13:38.516491 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e51231-1d32-493a-88e6-c14fc85e89c1 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:38.557294 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10edaa9f-9cb6-48f0-907c-c0a9c1b5aec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:38.557921 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10edaa9f-9cb6-48f0-907c-c0a9c1b5aec3 None admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:38.558200 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10edaa9f-9cb6-48f0-907c-c0a9c1b5aec3 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:38.558472 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10edaa9f-9cb6-48f0-907c-c0a9c1b5aec3 None admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:38.559161 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10edaa9f-9cb6-48f0-907c-c0a9c1b5aec3 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:38.560646 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10edaa9f-9cb6-48f0-907c-c0a9c1b5aec3 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:38.569793 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.sql.core [None req-10edaa9f-9cb6-48f0-907c-c0a9c1b5aec3 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 19 10:13:38.569793 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 19 10:13:38.569793 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [parameters: {'id': '6c074b3d517c498aaeec34761d55f8c9', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 19 10:13:38.569793 dv-cinder-858275-1-smb devstack@keystone.service[81351]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81351) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 19 10:13:38.587335 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-10edaa9f-9cb6-48f0-907c-c0a9c1b5aec3 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 19 10:13:38.587335 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:13:38.587335 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 19 10:13:38.587335 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 19 10:13:38.587335 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 19 10:13:38.587335 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 19 10:13:38.587335 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 19 10:13:38.587335 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application result = self._query(query) Sep 19 10:13:38.587335 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 19 10:13:38.587335 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application conn.query(q) Sep 19 10:13:38.587335 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 19 10:13:38.587335 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 19 10:13:38.587335 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 19 10:13:38.587335 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application result.read() Sep 19 10:13:38.587335 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 19 10:13:38.588301 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 19 10:13:38.588301 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 19 10:13:38.588301 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 19 10:13:38.588301 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 19 10:13:38.588301 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 19 10:13:38.588301 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 19 10:13:38.588301 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 19 10:13:38.588301 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 19 10:13:38.588301 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 19 10:13:38.588301 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 19 10:13:38.588301 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 19 10:13:38.588301 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:13:38.588301 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 19 10:13:38.588301 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 19 10:13:38.588301 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Sep 19 10:13:38.588301 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return ref.to_dict() Sep 19 10:13:38.588301 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 19 10:13:38.588301 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application next(self.gen) Sep 19 10:13:38.589434 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 19 10:13:38.589434 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application yield resource Sep 19 10:13:38.589434 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 19 10:13:38.589434 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application next(self.gen) Sep 19 10:13:38.589434 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 19 10:13:38.589434 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application self.session.rollback() Sep 19 10:13:38.589434 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 19 10:13:38.589434 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application self.force_reraise() Sep 19 10:13:38.589434 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 19 10:13:38.589434 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise self.value Sep 19 10:13:38.589434 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 19 10:13:38.589434 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 19 10:13:38.589434 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 19 10:13:38.589434 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application session.commit() Sep 19 10:13:38.589434 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 19 10:13:38.589434 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 19 10:13:38.589434 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 19 10:13:38.590438 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application self._prepare_impl() Sep 19 10:13:38.590438 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 19 10:13:38.590438 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application self.session.flush() Sep 19 10:13:38.590438 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 19 10:13:38.590438 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application self._flush(objects) Sep 19 10:13:38.590438 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 19 10:13:38.590438 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 19 10:13:38.590438 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 19 10:13:38.590438 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application compat.raise_( Sep 19 10:13:38.590438 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 19 10:13:38.590438 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception Sep 19 10:13:38.590438 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 19 10:13:38.590438 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application flush_context.execute() Sep 19 10:13:38.590438 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 19 10:13:38.590438 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rec.execute(self) Sep 19 10:13:38.590438 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 19 10:13:38.590438 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 19 10:13:38.591255 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 19 10:13:38.591255 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 19 10:13:38.591255 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 19 10:13:38.591255 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 19 10:13:38.591255 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 19 10:13:38.591255 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 19 10:13:38.591255 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 19 10:13:38.591255 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 19 10:13:38.591255 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 19 10:13:38.591255 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 19 10:13:38.591255 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 19 10:13:38.591255 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 19 10:13:38.591255 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 19 10:13:38.591255 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 19 10:13:38.591255 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 19 10:13:38.591255 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception Sep 19 10:13:38.592020 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 19 10:13:38.592020 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 19 10:13:38.592020 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 19 10:13:38.592020 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 19 10:13:38.592020 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 19 10:13:38.592020 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application result = self._query(query) Sep 19 10:13:38.592020 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 19 10:13:38.592020 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application conn.query(q) Sep 19 10:13:38.592020 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 19 10:13:38.592020 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 19 10:13:38.592020 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 19 10:13:38.592020 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application result.read() Sep 19 10:13:38.592020 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 19 10:13:38.592020 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 19 10:13:38.592020 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 19 10:13:38.592020 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 19 10:13:38.593818 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 19 10:13:38.593818 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 19 10:13:38.593818 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 19 10:13:38.593818 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 19 10:13:38.593818 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 19 10:13:38.593818 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 19 10:13:38.593818 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [parameters: {'id': '6c074b3d517c498aaeec34761d55f8c9', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 19 10:13:38.593818 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 19 10:13:38.593818 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 19 10:13:38.593818 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 10:13:38.593818 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 19 10:13:38.593818 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:13:38.593818 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:13:38.593818 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:13:38.593818 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:13:38.593818 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:13:38.594791 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:13:38.594791 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:13:38.594791 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:13:38.594791 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:13:38.594791 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:13:38.594791 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:13:38.594791 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Sep 19 10:13:38.594791 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Sep 19 10:13:38.594791 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:13:38.594791 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:13:38.594791 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Sep 19 10:13:38.594791 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Sep 19 10:13:38.594791 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 19 10:13:38.594791 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 19 10:13:38.594791 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 19 10:13:38.594791 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 19 10:13:38.595841 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 243/478] 10.222.0.66 () {60 vars in 1131 bytes} [Mon Sep 19 10:13:38 2022] POST /identity/v3/roles => generated 144 bytes in 261 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:13:38.595916 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5695d0a-1d36-41e1-a821-272ad664a06a None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:38.731627 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5695d0a-1d36-41e1-a821-272ad664a06a None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:38.747375 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:38.771531 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f54b8e6-a646-4118-9e80-7850400c83a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:38.772187 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f54b8e6-a646-4118-9e80-7850400c83a7 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:38.772475 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f54b8e6-a646-4118-9e80-7850400c83a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:38.772750 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f54b8e6-a646-4118-9e80-7850400c83a7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:38.783833 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f54b8e6-a646-4118-9e80-7850400c83a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 10:13:38.789276 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-6f54b8e6-a646-4118-9e80-7850400c83a7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 10:13:38.789276 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:13:38.789276 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:13:38.789276 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:13:38.789276 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:13:38.789276 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:13:38.789276 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:13:38.789276 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:13:38.789276 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:13:38.789276 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:13:38.789276 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:13:38.789276 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:13:38.789276 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 10:13:38.789276 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 10:13:38.789276 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 10:13:38.789276 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 10:13:38.790156 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 10:13:38.790156 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 10:13:38.790156 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 10:13:38.790156 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 10:13:38.790156 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:13:38.790156 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:13:38.790156 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:13:38.790156 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:13:38.790156 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:13:38.790156 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:13:38.790156 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:13:38.790156 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Sep 19 10:13:38.790156 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:13:38.790156 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:13:38.790156 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:13:38.790156 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:13:38.791356 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:13:38.791356 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:13:38.791356 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:13:38.791356 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:13:38.791356 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 10:13:38.791356 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 10:13:38.791356 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 10:13:38.791356 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 10:13:38.791356 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 10:13:38.791356 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 10:13:38.791356 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 10:13:38.791356 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Sep 19 10:13:38.791356 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 236/479] 10.222.0.66 () {56 vars in 1114 bytes} [Mon Sep 19 10:13:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:13:38.801262 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10edaa9f-9cb6-48f0-907c-c0a9c1b5aec3 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:38.893496 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:38.912742 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10edaa9f-9cb6-48f0-907c-c0a9c1b5aec3 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:38.948293 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8ef0b8-9261-43ec-88d1-a053c2dc13f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:38.948842 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8ef0b8-9261-43ec-88d1-a053c2dc13f5 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:38.949123 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8ef0b8-9261-43ec-88d1-a053c2dc13f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:38.949401 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8ef0b8-9261-43ec-88d1-a053c2dc13f5 None admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:38.950079 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8ef0b8-9261-43ec-88d1-a053c2dc13f5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:13:38.950386 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8ef0b8-9261-43ec-88d1-a053c2dc13f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:38.951802 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8ef0b8-9261-43ec-88d1-a053c2dc13f5 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:38.962412 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 244/480] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Sep 19 10:13:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:13:40.174983 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aae121c-774b-4e3b-b931-dde156b83208 None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:40.175492 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aae121c-774b-4e3b-b931-dde156b83208 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:40.175569 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aae121c-774b-4e3b-b931-dde156b83208 None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:40.177319 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 237/481] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:13:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:13:40.182854 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954b8125-e3b6-443b-a170-2d238621dcbf None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:40.183304 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954b8125-e3b6-443b-a170-2d238621dcbf None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:40.183448 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954b8125-e3b6-443b-a170-2d238621dcbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:40.208702 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-954b8125-e3b6-443b-a170-2d238621dcbf None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:13:40.209987 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-954b8125-e3b6-443b-a170-2d238621dcbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:13:40.306250 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 245/482] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:13:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 10:13:40.397124 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa106ff-11ce-4745-a8a3-6b688d8df0ed None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:40.397476 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa106ff-11ce-4745-a8a3-6b688d8df0ed None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:40.397754 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa106ff-11ce-4745-a8a3-6b688d8df0ed None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:40.399423 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 238/483] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:13:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:13:40.404904 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3c8cfa-13e5-435a-9c18-b45f72057264 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:40.405191 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3c8cfa-13e5-435a-9c18-b45f72057264 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:40.405469 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3c8cfa-13e5-435a-9c18-b45f72057264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:40.430305 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-de3c8cfa-13e5-435a-9c18-b45f72057264 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:13:40.431434 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-de3c8cfa-13e5-435a-9c18-b45f72057264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:13:40.516210 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 246/484] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:13:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 10:13:40.639922 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa106ff-11ce-4745-a8a3-6b688d8df0ed None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:40.790740 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa106ff-11ce-4745-a8a3-6b688d8df0ed None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:40.854856 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3c8cfa-13e5-435a-9c18-b45f72057264 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:40.856472 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f043bbe9-4f53-46f6-a973-316b63c26580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:40.857458 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f043bbe9-4f53-46f6-a973-316b63c26580 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:40.857813 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f043bbe9-4f53-46f6-a973-316b63c26580 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:40.858195 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f043bbe9-4f53-46f6-a973-316b63c26580 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:40.864985 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:40.880767 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f043bbe9-4f53-46f6-a973-316b63c26580 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 10:13:40.889897 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-f043bbe9-4f53-46f6-a973-316b63c26580 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 10:13:40.889897 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:13:40.889897 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:13:40.889897 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:13:40.889897 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:13:40.889897 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:13:40.889897 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:13:40.889897 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:13:40.889897 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:13:40.889897 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:13:40.889897 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:13:40.889897 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:13:40.889897 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 10:13:40.889897 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 10:13:40.889897 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 10:13:40.889897 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 10:13:40.890798 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 10:13:40.890798 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 10:13:40.890798 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 10:13:40.890798 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 10:13:40.890798 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:13:40.890798 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:13:40.890798 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:13:40.890798 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:13:40.890798 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:13:40.890798 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:13:40.890798 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:13:40.890798 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Sep 19 10:13:40.890798 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:13:40.890798 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:13:40.890798 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:13:40.890798 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:13:40.891623 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:13:40.891623 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:13:40.891623 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:13:40.891623 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:13:40.891623 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 10:13:40.891623 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 10:13:40.891623 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 10:13:40.891623 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 10:13:40.891623 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 10:13:40.891623 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 10:13:40.891623 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 10:13:40.891623 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Sep 19 10:13:40.896641 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 239/485] 10.222.0.66 () {56 vars in 1102 bytes} [Mon Sep 19 10:13:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:13:40.899924 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f043bbe9-4f53-46f6-a973-316b63c26580 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:40.959198 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:41.046759 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f043bbe9-4f53-46f6-a973-316b63c26580 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:41.054547 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3c8cfa-13e5-435a-9c18-b45f72057264 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:41.109695 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e382292e-ae5b-429d-8e83-03969580fa39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:41.111541 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e382292e-ae5b-429d-8e83-03969580fa39 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:41.112935 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4821fa-28e5-4727-a40c-22232d6ec67a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:41.113443 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e382292e-ae5b-429d-8e83-03969580fa39 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:41.113918 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e382292e-ae5b-429d-8e83-03969580fa39 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:41.117505 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4821fa-28e5-4727-a40c-22232d6ec67a None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:41.118011 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4821fa-28e5-4727-a40c-22232d6ec67a None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:41.118505 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4821fa-28e5-4727-a40c-22232d6ec67a None admin] PATH_INFO: `/v3/roles` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:41.119370 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4821fa-28e5-4727-a40c-22232d6ec67a None admin] RBAC: Adding query filter params (name=service) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:13:41.120609 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4821fa-28e5-4727-a40c-22232d6ec67a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:41.122411 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4821fa-28e5-4727-a40c-22232d6ec67a None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:41.137078 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e382292e-ae5b-429d-8e83-03969580fa39 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 10:13:41.142265 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-e382292e-ae5b-429d-8e83-03969580fa39 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 10:13:41.142265 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:13:41.142265 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:13:41.142265 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:13:41.142265 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:13:41.142265 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:13:41.142265 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:13:41.142265 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:13:41.142265 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:13:41.142265 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:13:41.142265 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:13:41.142265 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:13:41.142265 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 10:13:41.142265 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 10:13:41.142265 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 10:13:41.142265 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 10:13:41.143122 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 10:13:41.143122 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 10:13:41.143122 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 10:13:41.143122 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 10:13:41.143122 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:13:41.143122 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:13:41.143122 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:13:41.143122 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:13:41.143122 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:13:41.143122 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:13:41.143122 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:13:41.143122 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 19 10:13:41.143122 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:13:41.143122 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:13:41.143122 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:13:41.143122 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:13:41.143912 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:13:41.143912 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:13:41.143912 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:13:41.143912 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:13:41.143912 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 10:13:41.143912 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 10:13:41.143912 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 10:13:41.143912 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 10:13:41.143912 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 10:13:41.143912 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 10:13:41.143912 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 10:13:41.143912 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 19 10:13:41.148052 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 240/486] 10.222.0.66 () {56 vars in 1103 bytes} [Mon Sep 19 10:13:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:13:41.149719 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 247/487] 10.222.0.66 () {56 vars in 1102 bytes} [Mon Sep 19 10:13:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 10:13:41.155531 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4821fa-28e5-4727-a40c-22232d6ec67a None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:41.161024 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e382292e-ae5b-429d-8e83-03969580fa39 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:41.251919 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:41.290698 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:41.297230 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e382292e-ae5b-429d-8e83-03969580fa39 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:41.302584 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4821fa-28e5-4727-a40c-22232d6ec67a None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:41.335996 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b7f222-a0e2-461c-97f1-cdcf2ec3c353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:41.336792 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b7f222-a0e2-461c-97f1-cdcf2ec3c353 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:41.337221 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b7f222-a0e2-461c-97f1-cdcf2ec3c353 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:41.337590 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b7f222-a0e2-461c-97f1-cdcf2ec3c353 None admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:41.338460 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b7f222-a0e2-461c-97f1-cdcf2ec3c353 None admin] RBAC: Adding query filter params (name=service) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:13:41.338731 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b7f222-a0e2-461c-97f1-cdcf2ec3c353 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:41.340217 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b7f222-a0e2-461c-97f1-cdcf2ec3c353 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:41.347638 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bda1df7-2a42-4294-9cf8-8093dd5d6458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:41.349131 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bda1df7-2a42-4294-9cf8-8093dd5d6458 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:41.349840 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bda1df7-2a42-4294-9cf8-8093dd5d6458 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:41.350423 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bda1df7-2a42-4294-9cf8-8093dd5d6458 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:41.350672 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 248/488] 10.222.0.66 () {56 vars in 1103 bytes} [Mon Sep 19 10:13:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:13:41.352120 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6d440c-0a2e-4ab5-af87-1f3a0c38561d None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:41.352543 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6d440c-0a2e-4ab5-af87-1f3a0c38561d None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:41.352907 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6d440c-0a2e-4ab5-af87-1f3a0c38561d None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:41.358668 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 249/489] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:13:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:13:41.358668 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6d440c-0a2e-4ab5-af87-1f3a0c38561d None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:41.373152 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bda1df7-2a42-4294-9cf8-8093dd5d6458 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:41.376140 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bda1df7-2a42-4294-9cf8-8093dd5d6458 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:41.396293 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-9bda1df7-2a42-4294-9cf8-8093dd5d6458 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 10:13:41.396293 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:13:41.396293 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:13:41.396293 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:13:41.396293 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:13:41.396293 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:13:41.396293 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:13:41.396293 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:13:41.396293 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:13:41.396293 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:13:41.396293 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:13:41.396293 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:13:41.396293 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 10:13:41.396293 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 10:13:41.396293 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 10:13:41.396293 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 10:13:41.397449 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:13:41.397449 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:13:41.397449 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:13:41.397449 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:13:41.397449 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:13:41.397449 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:13:41.397449 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:13:41.397449 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Sep 19 10:13:41.397449 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:13:41.397449 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:13:41.397449 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:13:41.397449 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:13:41.397449 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:13:41.397449 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:13:41.397449 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:13:41.397449 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:13:41.397449 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 10:13:41.398471 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 10:13:41.398471 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 10:13:41.398471 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Sep 19 10:13:41.405357 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 241/490] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 19 10:13:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:13:41.405651 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5149b9-ba29-4b7a-8a97-b68cd5bfff6a None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:41.405847 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5149b9-ba29-4b7a-8a97-b68cd5bfff6a None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:41.406250 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5149b9-ba29-4b7a-8a97-b68cd5bfff6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:41.426052 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-fa5149b9-ba29-4b7a-8a97-b68cd5bfff6a None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:13:41.427844 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-fa5149b9-ba29-4b7a-8a97-b68cd5bfff6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:13:41.500486 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6d440c-0a2e-4ab5-af87-1f3a0c38561d None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:41.508551 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 242/491] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:13:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 10:13:41.508551 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5149b9-ba29-4b7a-8a97-b68cd5bfff6a None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:41.540133 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:41.552995 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74aaa9e-14fb-4995-a843-0dc4babdd203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:41.554336 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74aaa9e-14fb-4995-a843-0dc4babdd203 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:41.554802 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74aaa9e-14fb-4995-a843-0dc4babdd203 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:41.555255 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74aaa9e-14fb-4995-a843-0dc4babdd203 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:41.570638 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74aaa9e-14fb-4995-a843-0dc4babdd203 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:41.572806 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74aaa9e-14fb-4995-a843-0dc4babdd203 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:41.592286 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-e74aaa9e-14fb-4995-a843-0dc4babdd203 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 10:13:41.592286 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:13:41.592286 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:13:41.592286 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:13:41.592286 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:13:41.592286 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:13:41.592286 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:13:41.592286 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:13:41.592286 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:13:41.592286 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:13:41.592286 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:13:41.592286 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:13:41.592286 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 10:13:41.592286 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 10:13:41.592286 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 10:13:41.592286 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 10:13:41.593239 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:13:41.593239 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:13:41.593239 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:13:41.593239 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:13:41.593239 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:13:41.593239 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:13:41.593239 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:13:41.593239 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 19 10:13:41.593239 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:13:41.593239 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:13:41.593239 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:13:41.593239 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:13:41.593239 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:13:41.593239 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:13:41.593239 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:13:41.593239 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:13:41.593239 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 10:13:41.594096 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 10:13:41.594096 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 10:13:41.594096 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 19 10:13:41.594264 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:41.596376 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 250/492] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 19 10:13:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:13:41.598916 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21988bb4-65e5-4f39-893a-8e405b0f3990 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:41.599358 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21988bb4-65e5-4f39-893a-8e405b0f3990 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:41.599951 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21988bb4-65e5-4f39-893a-8e405b0f3990 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:41.601812 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 251/493] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:13:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:13:41.602978 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21988bb4-65e5-4f39-893a-8e405b0f3990 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:41.624424 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5149b9-ba29-4b7a-8a97-b68cd5bfff6a None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:41.677891 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae0d7ff-268d-4218-bc38-34940603499d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:41.678816 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae0d7ff-268d-4218-bc38-34940603499d None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:41.679527 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae0d7ff-268d-4218-bc38-34940603499d None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:41.680011 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae0d7ff-268d-4218-bc38-34940603499d None admin] PATH_INFO: `/v3/domains` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:41.681500 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae0d7ff-268d-4218-bc38-34940603499d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:13:41.682042 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae0d7ff-268d-4218-bc38-34940603499d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:41.687740 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae0d7ff-268d-4218-bc38-34940603499d None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:41.704104 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 243/494] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Sep 19 10:13:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:13:41.705729 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef838e6e-7fe8-4fd2-92f6-ff787f996669 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:41.706183 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef838e6e-7fe8-4fd2-92f6-ff787f996669 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:41.706623 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef838e6e-7fe8-4fd2-92f6-ff787f996669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:41.733069 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-ef838e6e-7fe8-4fd2-92f6-ff787f996669 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:13:41.735228 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-ef838e6e-7fe8-4fd2-92f6-ff787f996669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:13:41.738687 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21988bb4-65e5-4f39-893a-8e405b0f3990 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:41.776452 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de71dbcd-916c-416b-831d-ae41d350d7ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:41.780956 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de71dbcd-916c-416b-831d-ae41d350d7ad None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:41.781121 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de71dbcd-916c-416b-831d-ae41d350d7ad None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:41.781515 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de71dbcd-916c-416b-831d-ae41d350d7ad None admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:41.783090 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de71dbcd-916c-416b-831d-ae41d350d7ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:13:41.783090 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de71dbcd-916c-416b-831d-ae41d350d7ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:41.784414 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de71dbcd-916c-416b-831d-ae41d350d7ad None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:41.798375 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 252/495] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Sep 19 10:13:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:13:41.800365 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de71dbcd-916c-416b-831d-ae41d350d7ad None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:41.818785 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 244/496] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:13:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 10:13:41.819858 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef838e6e-7fe8-4fd2-92f6-ff787f996669 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:41.858251 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:41.906525 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:41.945178 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef838e6e-7fe8-4fd2-92f6-ff787f996669 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:41.951508 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de71dbcd-916c-416b-831d-ae41d350d7ad None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:41.987246 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec231302-68e2-4402-882f-53c2b6f0264e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:41.987634 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10feddf-5f8d-43bb-b15b-27f74898eb39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:41.988135 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec231302-68e2-4402-882f-53c2b6f0264e None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:41.988287 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10feddf-5f8d-43bb-b15b-27f74898eb39 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:41.988445 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec231302-68e2-4402-882f-53c2b6f0264e None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:41.988597 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10feddf-5f8d-43bb-b15b-27f74898eb39 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:41.988761 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec231302-68e2-4402-882f-53c2b6f0264e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:41.988850 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10feddf-5f8d-43bb-b15b-27f74898eb39 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:41.996502 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10feddf-5f8d-43bb-b15b-27f74898eb39 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:41.997949 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10feddf-5f8d-43bb-b15b-27f74898eb39 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:42.001171 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec231302-68e2-4402-882f-53c2b6f0264e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 10:13:42.006635 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-ec231302-68e2-4402-882f-53c2b6f0264e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 10:13:42.006635 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:13:42.006635 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:13:42.006635 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:13:42.006635 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:13:42.006635 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:13:42.006635 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:13:42.006635 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:13:42.006635 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:13:42.006635 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:13:42.006635 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:13:42.006635 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:13:42.006635 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 10:13:42.006635 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 10:13:42.006635 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 10:13:42.006635 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 10:13:42.007508 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 10:13:42.007508 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 10:13:42.007508 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 10:13:42.007508 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 10:13:42.007508 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:13:42.007508 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:13:42.007508 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:13:42.007508 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:13:42.007508 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:13:42.007508 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:13:42.007508 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:13:42.007508 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Sep 19 10:13:42.007508 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:13:42.007508 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:13:42.007508 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:13:42.007508 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:13:42.008685 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:13:42.008685 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:13:42.008685 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:13:42.008685 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:13:42.008685 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 10:13:42.008685 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 10:13:42.008685 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 10:13:42.008685 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 10:13:42.008685 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 10:13:42.008685 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 10:13:42.008685 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 10:13:42.008685 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Sep 19 10:13:42.008685 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 245/497] 10.222.0.66 () {56 vars in 1102 bytes} [Mon Sep 19 10:13:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:13:42.008685 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec231302-68e2-4402-882f-53c2b6f0264e None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:42.015544 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-e10feddf-5f8d-43bb-b15b-27f74898eb39 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 19 10:13:42.015544 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:13:42.015544 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:13:42.015544 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:13:42.015544 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:13:42.015544 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:13:42.015544 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:13:42.015544 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:13:42.015544 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:13:42.015544 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:13:42.015544 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:13:42.015544 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:13:42.015544 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 10:13:42.015544 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 10:13:42.015544 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 10:13:42.015544 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 10:13:42.016775 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:13:42.016775 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:13:42.016775 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 10:13:42.016775 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 10:13:42.016775 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 10:13:42.016775 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 10:13:42.016775 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:13:42.016775 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:13:42.016775 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:13:42.016775 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:13:42.016775 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:13:42.016775 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 19 10:13:42.016775 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:13:42.016775 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:13:42.016775 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:13:42.016775 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:13:42.016775 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:13:42.016775 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:13:42.017693 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:13:42.017693 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:13:42.017693 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 10:13:42.017693 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 10:13:42.017693 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 10:13:42.017693 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 10:13:42.017693 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 10:13:42.017693 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 10:13:42.017693 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 19 10:13:42.017693 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 19 10:13:42.017693 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 253/498] 10.222.0.66 () {56 vars in 1093 bytes} [Mon Sep 19 10:13:41 2022] GET /identity/v3/users/nova => generated 82 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:13:42.018725 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f3ffde-60f5-463a-9a0e-1bee1eb235f6 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:42.018725 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f3ffde-60f5-463a-9a0e-1bee1eb235f6 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:42.018887 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f3ffde-60f5-463a-9a0e-1bee1eb235f6 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:42.020226 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 254/499] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:13:42 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:13:42.020869 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f3ffde-60f5-463a-9a0e-1bee1eb235f6 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:42.116196 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec231302-68e2-4402-882f-53c2b6f0264e None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:42.125681 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:42.129604 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f3ffde-60f5-463a-9a0e-1bee1eb235f6 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:42.142345 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:42.152087 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ff5bf7-5400-4b99-80df-cb34ac69bd23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:42.152739 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ff5bf7-5400-4b99-80df-cb34ac69bd23 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:42.153013 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ff5bf7-5400-4b99-80df-cb34ac69bd23 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:42.153280 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ff5bf7-5400-4b99-80df-cb34ac69bd23 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:42.160119 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ff5bf7-5400-4b99-80df-cb34ac69bd23 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:42.161613 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ff5bf7-5400-4b99-80df-cb34ac69bd23 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:42.164732 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006f4a85-935d-4d31-a922-f590c810b1a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:42.165334 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006f4a85-935d-4d31-a922-f590c810b1a9 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:42.165617 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006f4a85-935d-4d31-a922-f590c810b1a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:42.165893 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006f4a85-935d-4d31-a922-f590c810b1a9 None admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:42.166550 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006f4a85-935d-4d31-a922-f590c810b1a9 None admin] RBAC: Adding query filter params (name=service) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:13:42.166854 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006f4a85-935d-4d31-a922-f590c810b1a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:42.168260 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006f4a85-935d-4d31-a922-f590c810b1a9 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:42.174357 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-f6ff5bf7-5400-4b99-80df-cb34ac69bd23 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 19 10:13:42.174357 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:13:42.174357 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:13:42.174357 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:13:42.174357 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:13:42.174357 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:13:42.174357 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:13:42.174357 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:13:42.174357 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:13:42.174357 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:13:42.174357 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:13:42.174357 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:13:42.174357 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 10:13:42.174357 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 10:13:42.174357 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 10:13:42.174357 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 10:13:42.175343 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:13:42.175343 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:13:42.175343 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 10:13:42.175343 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 10:13:42.175343 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 10:13:42.175343 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 10:13:42.175343 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:13:42.175343 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:13:42.175343 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:13:42.175343 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:13:42.175343 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:13:42.175343 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Sep 19 10:13:42.175343 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:13:42.175343 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:13:42.175343 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:13:42.175343 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:13:42.175343 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:13:42.175343 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:13:42.176259 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:13:42.176259 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:13:42.176259 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 10:13:42.176259 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 10:13:42.176259 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 10:13:42.176259 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 10:13:42.176259 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 10:13:42.176259 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 10:13:42.176259 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 19 10:13:42.176259 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Sep 19 10:13:42.176259 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 246/500] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Sep 19 10:13:42 2022] GET /identity/v3/users/glance => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:13:42.176259 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ff5bf7-5400-4b99-80df-cb34ac69bd23 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:42.177855 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 255/501] 10.222.0.66 () {56 vars in 1103 bytes} [Mon Sep 19 10:13:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:13:42.178856 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb685b6-e26c-4ecb-a20a-b50dd0eb872b None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:42.179148 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb685b6-e26c-4ecb-a20a-b50dd0eb872b None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:42.179427 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb685b6-e26c-4ecb-a20a-b50dd0eb872b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:42.198769 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-7cb685b6-e26c-4ecb-a20a-b50dd0eb872b None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:13:42.199981 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-7cb685b6-e26c-4ecb-a20a-b50dd0eb872b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:13:42.265625 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 256/502] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:13:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 10:13:42.266373 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb685b6-e26c-4ecb-a20a-b50dd0eb872b None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:42.276221 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ff5bf7-5400-4b99-80df-cb34ac69bd23 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:42.312054 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbcb8c4-aa26-4726-adf9-ca8cc75df072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:42.312715 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbcb8c4-aa26-4726-adf9-ca8cc75df072 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:42.312969 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbcb8c4-aa26-4726-adf9-ca8cc75df072 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:42.313226 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbcb8c4-aa26-4726-adf9-ca8cc75df072 None admin] PATH_INFO: `/v3/users` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:42.313941 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbcb8c4-aa26-4726-adf9-ca8cc75df072 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:13:42.314246 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbcb8c4-aa26-4726-adf9-ca8cc75df072 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:42.315691 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbcb8c4-aa26-4726-adf9-ca8cc75df072 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:42.357494 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 247/503] 10.222.0.66 () {56 vars in 1133 bytes} [Mon Sep 19 10:13:42 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:13:42.357494 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbcb8c4-aa26-4726-adf9-ca8cc75df072 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:42.373830 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:42.384563 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb685b6-e26c-4ecb-a20a-b50dd0eb872b None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:42.402746 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:42.427918 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1a1e7e-09fc-4ac4-914a-e570f2e3595c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:42.428732 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1a1e7e-09fc-4ac4-914a-e570f2e3595c None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:42.429111 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1a1e7e-09fc-4ac4-914a-e570f2e3595c None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:42.429516 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1a1e7e-09fc-4ac4-914a-e570f2e3595c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:42.440683 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1a1e7e-09fc-4ac4-914a-e570f2e3595c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 10:13:42.445885 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-4a1a1e7e-09fc-4ac4-914a-e570f2e3595c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 10:13:42.445885 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:13:42.445885 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:13:42.445885 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:13:42.445885 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:13:42.445885 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:13:42.445885 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:13:42.445885 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:13:42.445885 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:13:42.445885 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:13:42.445885 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:13:42.445885 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:13:42.445885 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 10:13:42.445885 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 10:13:42.445885 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 10:13:42.445885 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 10:13:42.447153 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 10:13:42.447153 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 10:13:42.447153 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 10:13:42.447153 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 10:13:42.447153 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:13:42.447153 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:13:42.447153 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:13:42.447153 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:13:42.447153 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:13:42.447153 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:13:42.447153 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:13:42.447153 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 19 10:13:42.447153 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:13:42.447153 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:13:42.447153 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:13:42.447153 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:13:42.448903 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:13:42.448903 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:13:42.448903 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:13:42.448903 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:13:42.448903 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 10:13:42.448903 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 10:13:42.448903 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 10:13:42.448903 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 10:13:42.448903 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 10:13:42.448903 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 10:13:42.448903 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 10:13:42.448903 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 19 10:13:42.448903 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 257/504] 10.222.0.66 () {56 vars in 1102 bytes} [Mon Sep 19 10:13:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:13:42.449701 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1a1e7e-09fc-4ac4-914a-e570f2e3595c None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:42.472703 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbcb8c4-aa26-4726-adf9-ca8cc75df072 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:42.512251 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa11215-f858-42d1-8574-1aa932e9f114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:42.512251 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa11215-f858-42d1-8574-1aa932e9f114 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:42.512251 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa11215-f858-42d1-8574-1aa932e9f114 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:42.512251 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa11215-f858-42d1-8574-1aa932e9f114 None admin] PATH_INFO: `/v3/users` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:42.513469 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa11215-f858-42d1-8574-1aa932e9f114 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:13:42.514143 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa11215-f858-42d1-8574-1aa932e9f114 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:42.515656 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa11215-f858-42d1-8574-1aa932e9f114 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:42.539628 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 248/505] 10.222.0.66 () {56 vars in 1137 bytes} [Mon Sep 19 10:13:42 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:13:42.540610 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa11215-f858-42d1-8574-1aa932e9f114 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:42.574578 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1a1e7e-09fc-4ac4-914a-e570f2e3595c None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:42.610226 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f717417-a5b7-4880-b192-f4977961c897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:42.610855 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f717417-a5b7-4880-b192-f4977961c897 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:42.611127 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f717417-a5b7-4880-b192-f4977961c897 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:42.611395 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f717417-a5b7-4880-b192-f4977961c897 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:42.621688 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f717417-a5b7-4880-b192-f4977961c897 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:42.623125 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f717417-a5b7-4880-b192-f4977961c897 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:42.638409 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-7f717417-a5b7-4880-b192-f4977961c897 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 10:13:42.638409 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:13:42.638409 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:13:42.638409 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:13:42.638409 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:13:42.638409 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:13:42.638409 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:13:42.638409 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:13:42.638409 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:13:42.638409 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:13:42.638409 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:13:42.638409 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:13:42.638409 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 10:13:42.638409 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 10:13:42.638409 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 10:13:42.638409 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 10:13:42.639512 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:13:42.639512 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:13:42.639512 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:13:42.639512 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:13:42.639512 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:13:42.639512 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:13:42.639512 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:13:42.639512 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 19 10:13:42.639512 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:13:42.639512 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:13:42.639512 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:13:42.639512 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:13:42.639512 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:13:42.639512 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:13:42.639512 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:13:42.639512 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:13:42.639512 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 10:13:42.640589 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 10:13:42.640589 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 10:13:42.640589 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 19 10:13:42.641111 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 258/506] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 19 10:13:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:13:42.641968 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f717417-a5b7-4880-b192-f4977961c897 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:42.646722 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:42.649080 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa11215-f858-42d1-8574-1aa932e9f114 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:42.650708 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:42.688716 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195b6d7e-a8ff-475d-acd3-6e62566943f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:42.689432 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195b6d7e-a8ff-475d-acd3-6e62566943f6 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:42.689709 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195b6d7e-a8ff-475d-acd3-6e62566943f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:42.690328 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195b6d7e-a8ff-475d-acd3-6e62566943f6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:42.747600 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f717417-a5b7-4880-b192-f4977961c897 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:42.757374 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195b6d7e-a8ff-475d-acd3-6e62566943f6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:42.758851 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195b6d7e-a8ff-475d-acd3-6e62566943f6 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:42.781559 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29206fcb-9e41-4596-986b-178f6681b398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:42.782113 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29206fcb-9e41-4596-986b-178f6681b398 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:42.782395 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29206fcb-9e41-4596-986b-178f6681b398 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:42.782666 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29206fcb-9e41-4596-986b-178f6681b398 None admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:42.783318 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29206fcb-9e41-4596-986b-178f6681b398 None admin] RBAC: Adding query filter params (name=service) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:13:42.783621 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29206fcb-9e41-4596-986b-178f6681b398 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:42.785041 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29206fcb-9e41-4596-986b-178f6681b398 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:42.792958 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 259/507] 10.222.0.66 () {56 vars in 1103 bytes} [Mon Sep 19 10:13:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:13:42.793746 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29206fcb-9e41-4596-986b-178f6681b398 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:42.872444 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:42.873040 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 249/508] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Sep 19 10:13:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 10:13:42.873912 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195b6d7e-a8ff-475d-acd3-6e62566943f6 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:42.877496 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:42.918865 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29206fcb-9e41-4596-986b-178f6681b398 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:42.954350 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e434f880-e621-4e11-be3e-43bc96f602bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:42.954987 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e434f880-e621-4e11-be3e-43bc96f602bd None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:42.955270 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e434f880-e621-4e11-be3e-43bc96f602bd None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:42.955548 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e434f880-e621-4e11-be3e-43bc96f602bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:42.966144 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e434f880-e621-4e11-be3e-43bc96f602bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:42.967599 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e434f880-e621-4e11-be3e-43bc96f602bd None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:42.980869 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195b6d7e-a8ff-475d-acd3-6e62566943f6 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:42.981717 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-e434f880-e621-4e11-be3e-43bc96f602bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 10:13:42.981717 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:13:42.981717 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:13:42.981717 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:13:42.981717 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:13:42.981717 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:13:42.981717 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:13:42.981717 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:13:42.981717 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:13:42.981717 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:13:42.981717 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:13:42.981717 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:13:42.981717 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 10:13:42.981717 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 10:13:42.981717 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 10:13:42.981717 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 10:13:42.982657 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:13:42.982657 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:13:42.982657 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:13:42.982657 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:13:42.982657 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:13:42.982657 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:13:42.982657 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:13:42.982657 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 19 10:13:42.982657 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:13:42.982657 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:13:42.982657 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:13:42.982657 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:13:42.982657 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:13:42.982657 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:13:42.982657 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:13:42.982657 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:13:42.982657 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 10:13:42.983479 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 10:13:42.983479 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 10:13:42.983479 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 19 10:13:42.983479 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 260/509] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 19 10:13:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:13:42.983685 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e434f880-e621-4e11-be3e-43bc96f602bd None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:43.019470 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2aff96-2b26-4e1f-be78-8c4a1013ac67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:43.020077 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2aff96-2b26-4e1f-be78-8c4a1013ac67 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:43.020418 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2aff96-2b26-4e1f-be78-8c4a1013ac67 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:43.020695 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2aff96-2b26-4e1f-be78-8c4a1013ac67 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:43.085976 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e434f880-e621-4e11-be3e-43bc96f602bd None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:43.091230 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2aff96-2b26-4e1f-be78-8c4a1013ac67 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:43.093033 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2aff96-2b26-4e1f-be78-8c4a1013ac67 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:43.095116 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:43.104885 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:43.122950 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6db4dbe-c392-4a6a-ae8a-8ae29d6c286a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:43.123548 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6db4dbe-c392-4a6a-ae8a-8ae29d6c286a None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:43.123824 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6db4dbe-c392-4a6a-ae8a-8ae29d6c286a None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:43.124091 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6db4dbe-c392-4a6a-ae8a-8ae29d6c286a None admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:43.124756 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6db4dbe-c392-4a6a-ae8a-8ae29d6c286a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:13:43.125052 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6db4dbe-c392-4a6a-ae8a-8ae29d6c286a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:43.126432 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6db4dbe-c392-4a6a-ae8a-8ae29d6c286a None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:43.138532 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 261/510] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Sep 19 10:13:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:13:43.139520 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6db4dbe-c392-4a6a-ae8a-8ae29d6c286a None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:43.198048 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 250/511] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Sep 19 10:13:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 10:13:43.199695 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2aff96-2b26-4e1f-be78-8c4a1013ac67 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:43.245664 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6db4dbe-c392-4a6a-ae8a-8ae29d6c286a None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:43.282030 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095669c1-a7d4-4ca6-963d-3d00ebd56ddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:43.283210 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095669c1-a7d4-4ca6-963d-3d00ebd56ddd None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:43.283513 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095669c1-a7d4-4ca6-963d-3d00ebd56ddd None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:43.283790 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095669c1-a7d4-4ca6-963d-3d00ebd56ddd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:43.296883 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095669c1-a7d4-4ca6-963d-3d00ebd56ddd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:43.298433 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095669c1-a7d4-4ca6-963d-3d00ebd56ddd None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:43.310780 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2aff96-2b26-4e1f-be78-8c4a1013ac67 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:43.312385 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:43.314410 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-095669c1-a7d4-4ca6-963d-3d00ebd56ddd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 10:13:43.314410 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:13:43.314410 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:13:43.314410 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:13:43.314410 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:13:43.314410 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:13:43.314410 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:13:43.314410 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:13:43.314410 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:13:43.314410 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:13:43.314410 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:13:43.314410 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:13:43.314410 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 10:13:43.314410 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 10:13:43.314410 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 10:13:43.314410 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 10:13:43.315364 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:13:43.315364 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:13:43.315364 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:13:43.315364 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:13:43.315364 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:13:43.315364 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:13:43.315364 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:13:43.315364 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 19 10:13:43.315364 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:13:43.315364 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:13:43.315364 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:13:43.315364 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:13:43.315364 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:13:43.315364 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:13:43.315364 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:13:43.315364 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:13:43.315364 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 10:13:43.316337 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 10:13:43.316337 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 10:13:43.316337 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 19 10:13:43.316337 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 262/512] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 19 10:13:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:13:43.316733 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095669c1-a7d4-4ca6-963d-3d00ebd56ddd None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:43.347367 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:43.352446 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815fd64a-3c07-414a-9ad2-8572c0114928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:43.353085 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815fd64a-3c07-414a-9ad2-8572c0114928 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:43.353368 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815fd64a-3c07-414a-9ad2-8572c0114928 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:43.353638 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815fd64a-3c07-414a-9ad2-8572c0114928 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:43.363767 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815fd64a-3c07-414a-9ad2-8572c0114928 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:43.365875 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815fd64a-3c07-414a-9ad2-8572c0114928 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:43.380450 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-815fd64a-3c07-414a-9ad2-8572c0114928 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 10:13:43.380450 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:13:43.380450 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:13:43.380450 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:13:43.380450 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:13:43.380450 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:13:43.380450 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:13:43.380450 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:13:43.380450 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:13:43.380450 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:13:43.380450 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:13:43.380450 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:13:43.380450 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 10:13:43.380450 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 10:13:43.380450 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 10:13:43.380450 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 10:13:43.381574 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:13:43.381574 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:13:43.381574 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:13:43.381574 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:13:43.381574 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:13:43.381574 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:13:43.381574 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:13:43.381574 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Sep 19 10:13:43.381574 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:13:43.381574 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:13:43.381574 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:13:43.381574 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:13:43.381574 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:13:43.381574 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:13:43.381574 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:13:43.381574 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:13:43.381574 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 10:13:43.382522 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 10:13:43.382522 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 10:13:43.382522 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Sep 19 10:13:43.382522 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 251/513] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 19 10:13:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:13:43.382522 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815fd64a-3c07-414a-9ad2-8572c0114928 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:43.420944 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095669c1-a7d4-4ca6-963d-3d00ebd56ddd None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:43.453785 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb1f4ca-afff-42a4-bd7f-7cfaec64651c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:43.454311 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb1f4ca-afff-42a4-bd7f-7cfaec64651c None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:43.454594 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb1f4ca-afff-42a4-bd7f-7cfaec64651c None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:43.454870 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb1f4ca-afff-42a4-bd7f-7cfaec64651c None admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:43.455512 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb1f4ca-afff-42a4-bd7f-7cfaec64651c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:13:43.455813 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb1f4ca-afff-42a4-bd7f-7cfaec64651c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:43.457334 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb1f4ca-afff-42a4-bd7f-7cfaec64651c None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:43.469834 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 263/514] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Sep 19 10:13:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:13:43.470681 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb1f4ca-afff-42a4-bd7f-7cfaec64651c None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:43.494638 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815fd64a-3c07-414a-9ad2-8572c0114928 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:43.526681 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e50297-c8f6-4bc0-bacd-95f1e94d4339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:43.527330 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e50297-c8f6-4bc0-bacd-95f1e94d4339 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:43.527605 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e50297-c8f6-4bc0-bacd-95f1e94d4339 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:43.527872 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e50297-c8f6-4bc0-bacd-95f1e94d4339 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:43.537181 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e50297-c8f6-4bc0-bacd-95f1e94d4339 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:43.538696 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e50297-c8f6-4bc0-bacd-95f1e94d4339 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:43.551125 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-24e50297-c8f6-4bc0-bacd-95f1e94d4339 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 19 10:13:43.551125 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:13:43.551125 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:13:43.551125 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:13:43.551125 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:13:43.551125 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:13:43.551125 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:13:43.551125 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:13:43.551125 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:13:43.551125 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:13:43.551125 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:13:43.551125 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:13:43.551125 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 10:13:43.551125 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 10:13:43.551125 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 10:13:43.551125 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 10:13:43.552108 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:13:43.552108 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:13:43.552108 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 10:13:43.552108 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 10:13:43.552108 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 10:13:43.552108 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 10:13:43.552108 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:13:43.552108 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:13:43.552108 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:13:43.552108 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:13:43.552108 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:13:43.552108 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Sep 19 10:13:43.552108 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:13:43.552108 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:13:43.552108 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:13:43.552108 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:13:43.552108 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:13:43.552108 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:13:43.553015 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:13:43.553015 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:13:43.553015 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 10:13:43.553015 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 10:13:43.553015 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 10:13:43.553015 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 10:13:43.553015 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 10:13:43.553015 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 10:13:43.553015 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 19 10:13:43.553015 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Sep 19 10:13:43.553015 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 252/515] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Sep 19 10:13:43 2022] GET /identity/v3/users/cinder => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:13:43.554066 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e50297-c8f6-4bc0-bacd-95f1e94d4339 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:43.571749 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:43.572872 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:43.584878 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb1f4ca-afff-42a4-bd7f-7cfaec64651c None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:43.621682 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009e2920-034c-4b85-a299-9ba2df2efddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:43.622325 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009e2920-034c-4b85-a299-9ba2df2efddc None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:43.622603 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009e2920-034c-4b85-a299-9ba2df2efddc None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:43.622874 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009e2920-034c-4b85-a299-9ba2df2efddc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:43.633797 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009e2920-034c-4b85-a299-9ba2df2efddc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:43.635263 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009e2920-034c-4b85-a299-9ba2df2efddc None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:43.651108 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-009e2920-034c-4b85-a299-9ba2df2efddc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 10:13:43.651108 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:13:43.651108 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:13:43.651108 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:13:43.651108 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:13:43.651108 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:13:43.651108 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:13:43.651108 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:13:43.651108 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:13:43.651108 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:13:43.651108 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:13:43.651108 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:13:43.651108 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 10:13:43.651108 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 10:13:43.651108 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 10:13:43.651108 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 10:13:43.652395 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:13:43.652395 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:13:43.652395 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:13:43.652395 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:13:43.652395 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:13:43.652395 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:13:43.652395 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:13:43.652395 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 19 10:13:43.652395 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:13:43.652395 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:13:43.652395 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:13:43.652395 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:13:43.652395 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:13:43.652395 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:13:43.652395 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:13:43.652395 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:13:43.652395 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 10:13:43.653262 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 10:13:43.653262 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 10:13:43.653262 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 19 10:13:43.653262 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 264/516] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 19 10:13:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:13:43.653262 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009e2920-034c-4b85-a299-9ba2df2efddc None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:43.669941 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e50297-c8f6-4bc0-bacd-95f1e94d4339 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:43.711161 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09052596-9d51-4562-af19-ced18f54543b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:43.711666 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09052596-9d51-4562-af19-ced18f54543b None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:43.711947 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09052596-9d51-4562-af19-ced18f54543b None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:43.712246 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09052596-9d51-4562-af19-ced18f54543b None admin] PATH_INFO: `/v3/domains` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:43.712901 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09052596-9d51-4562-af19-ced18f54543b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:13:43.713202 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09052596-9d51-4562-af19-ced18f54543b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:43.714624 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09052596-9d51-4562-af19-ced18f54543b None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:43.736024 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 253/517] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Sep 19 10:13:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:13:43.736024 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09052596-9d51-4562-af19-ced18f54543b None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:43.763922 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009e2920-034c-4b85-a299-9ba2df2efddc None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:43.798884 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072248d4-8046-4d43-bbd9-3d3bdbb3e6dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:43.799487 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072248d4-8046-4d43-bbd9-3d3bdbb3e6dc None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:43.799768 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072248d4-8046-4d43-bbd9-3d3bdbb3e6dc None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:43.800116 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072248d4-8046-4d43-bbd9-3d3bdbb3e6dc None admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:43.800783 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072248d4-8046-4d43-bbd9-3d3bdbb3e6dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:13:43.801096 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072248d4-8046-4d43-bbd9-3d3bdbb3e6dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:43.802571 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072248d4-8046-4d43-bbd9-3d3bdbb3e6dc None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:43.811264 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:43.815885 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 265/518] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Sep 19 10:13:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:13:43.815885 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072248d4-8046-4d43-bbd9-3d3bdbb3e6dc None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:43.820722 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:43.837689 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09052596-9d51-4562-af19-ced18f54543b None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:43.871659 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4949dd-6bf7-4f27-8a6b-8c91a7658fea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:43.872289 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4949dd-6bf7-4f27-8a6b-8c91a7658fea None admin] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:43.872575 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4949dd-6bf7-4f27-8a6b-8c91a7658fea None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:43.872847 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4949dd-6bf7-4f27-8a6b-8c91a7658fea None admin] PATH_INFO: `/v3/users` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:43.873487 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4949dd-6bf7-4f27-8a6b-8c91a7658fea None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:43.874934 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4949dd-6bf7-4f27-8a6b-8c91a7658fea None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:43.900579 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 254/519] 10.222.0.66 () {60 vars in 1132 bytes} [Mon Sep 19 10:13:43 2022] POST /identity/v3/users => generated 247 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:13:43.902288 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4949dd-6bf7-4f27-8a6b-8c91a7658fea None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:43.949981 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072248d4-8046-4d43-bbd9-3d3bdbb3e6dc None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:43.997190 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fee58fe-57fc-4bb1-bf54-0e32c83f4053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:43.998295 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fee58fe-57fc-4bb1-bf54-0e32c83f4053 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:43.998805 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fee58fe-57fc-4bb1-bf54-0e32c83f4053 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:43.999259 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fee58fe-57fc-4bb1-bf54-0e32c83f4053 None admin] PATH_INFO: `/v3/users` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:44.000246 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fee58fe-57fc-4bb1-bf54-0e32c83f4053 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:13:44.001011 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fee58fe-57fc-4bb1-bf54-0e32c83f4053 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:44.003520 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fee58fe-57fc-4bb1-bf54-0e32c83f4053 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:44.021681 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4949dd-6bf7-4f27-8a6b-8c91a7658fea None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:44.052341 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 266/520] 10.222.0.66 () {56 vars in 1137 bytes} [Mon Sep 19 10:13:43 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:13:44.052341 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fee58fe-57fc-4bb1-bf54-0e32c83f4053 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:44.060203 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:44.067251 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dcca55-9354-4935-8b68-4500b4c862e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:44.068478 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dcca55-9354-4935-8b68-4500b4c862e7 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:44.068699 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dcca55-9354-4935-8b68-4500b4c862e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:44.068976 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dcca55-9354-4935-8b68-4500b4c862e7 None admin] PATH_INFO: `/v3/domains` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:44.069995 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dcca55-9354-4935-8b68-4500b4c862e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:13:44.070695 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dcca55-9354-4935-8b68-4500b4c862e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:44.072309 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dcca55-9354-4935-8b68-4500b4c862e7 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:44.087092 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 255/521] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Sep 19 10:13:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:13:44.087955 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dcca55-9354-4935-8b68-4500b4c862e7 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:44.126237 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:44.175285 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fee58fe-57fc-4bb1-bf54-0e32c83f4053 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:44.203590 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dcca55-9354-4935-8b68-4500b4c862e7 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:44.215979 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e901f62-1fe1-43d4-a412-49a45ca62e82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:44.216686 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e901f62-1fe1-43d4-a412-49a45ca62e82 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:44.216967 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e901f62-1fe1-43d4-a412-49a45ca62e82 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:44.217232 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e901f62-1fe1-43d4-a412-49a45ca62e82 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:44.225461 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e901f62-1fe1-43d4-a412-49a45ca62e82 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:44.226938 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e901f62-1fe1-43d4-a412-49a45ca62e82 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:44.239335 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-5e901f62-1fe1-43d4-a412-49a45ca62e82 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 19 10:13:44.239335 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:13:44.239335 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:13:44.239335 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:13:44.239335 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:13:44.239335 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:13:44.239335 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:13:44.239335 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:13:44.239335 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:13:44.239335 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:13:44.239335 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:13:44.239335 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:13:44.239335 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 10:13:44.239335 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 10:13:44.239335 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 10:13:44.239335 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 10:13:44.240344 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:13:44.240344 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:13:44.240344 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 10:13:44.240344 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 10:13:44.240344 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 10:13:44.240344 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 10:13:44.240344 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:13:44.240344 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:13:44.240344 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:13:44.240344 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:13:44.240344 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:13:44.240344 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 19 10:13:44.240344 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:13:44.240344 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:13:44.240344 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:13:44.240344 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:13:44.240344 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:13:44.240344 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:13:44.241259 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:13:44.241259 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:13:44.241259 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 10:13:44.241259 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 10:13:44.241259 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 10:13:44.241259 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 10:13:44.241259 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 10:13:44.241259 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 10:13:44.241259 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 19 10:13:44.241259 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 19 10:13:44.241259 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 267/522] 10.222.0.66 () {56 vars in 1102 bytes} [Mon Sep 19 10:13:44 2022] GET /identity/v3/users/neutron => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:13:44.241826 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e901f62-1fe1-43d4-a412-49a45ca62e82 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:44.242947 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1347a5f1-0c80-49f0-ab1e-56208c125131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:44.243596 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1347a5f1-0c80-49f0-ab1e-56208c125131 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:44.243897 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1347a5f1-0c80-49f0-ab1e-56208c125131 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:44.244145 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1347a5f1-0c80-49f0-ab1e-56208c125131 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:44.253723 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1347a5f1-0c80-49f0-ab1e-56208c125131 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:44.255452 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1347a5f1-0c80-49f0-ab1e-56208c125131 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:44.267820 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-1347a5f1-0c80-49f0-ab1e-56208c125131 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 10:13:44.267820 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:13:44.267820 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:13:44.267820 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:13:44.267820 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:13:44.267820 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:13:44.267820 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:13:44.267820 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:13:44.267820 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:13:44.267820 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:13:44.267820 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:13:44.267820 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:13:44.267820 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 10:13:44.267820 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 10:13:44.267820 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 10:13:44.268880 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 10:13:44.268880 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:13:44.268880 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:13:44.268880 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:13:44.268880 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:13:44.268880 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:13:44.268880 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:13:44.268880 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:13:44.268880 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Sep 19 10:13:44.268880 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:13:44.268880 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:13:44.268880 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:13:44.268880 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:13:44.268880 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:13:44.268880 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:13:44.268880 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:13:44.268880 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:13:44.269737 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 10:13:44.269737 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 10:13:44.269737 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 10:13:44.269737 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 10:13:44.269737 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 10:13:44.269737 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 10:13:44.269737 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 10:13:44.269737 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Sep 19 10:13:44.269737 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 256/523] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Sep 19 10:13:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:13:44.269737 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1347a5f1-0c80-49f0-ab1e-56208c125131 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:44.326100 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:44.367424 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e901f62-1fe1-43d4-a412-49a45ca62e82 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:44.381708 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1347a5f1-0c80-49f0-ab1e-56208c125131 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:44.391643 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:44.409752 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0028a49f-6060-4209-ae8c-20676982764c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:44.410374 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0028a49f-6060-4209-ae8c-20676982764c None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:44.410663 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0028a49f-6060-4209-ae8c-20676982764c None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:44.411132 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0028a49f-6060-4209-ae8c-20676982764c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:44.420055 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0791fa85-a97b-4ae9-9519-a8637189df75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:44.420735 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0791fa85-a97b-4ae9-9519-a8637189df75 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:44.421015 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0791fa85-a97b-4ae9-9519-a8637189df75 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:44.421285 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0791fa85-a97b-4ae9-9519-a8637189df75 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:44.429806 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0791fa85-a97b-4ae9-9519-a8637189df75 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:44.431301 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0791fa85-a97b-4ae9-9519-a8637189df75 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:44.444491 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-0791fa85-a97b-4ae9-9519-a8637189df75 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 10:13:44.444491 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:13:44.444491 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:13:44.444491 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:13:44.444491 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:13:44.444491 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:13:44.444491 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:13:44.444491 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:13:44.444491 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:13:44.444491 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:13:44.444491 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:13:44.444491 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:13:44.444491 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 10:13:44.444491 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 10:13:44.444491 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 10:13:44.445413 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 10:13:44.445413 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:13:44.445413 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:13:44.445413 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:13:44.445413 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:13:44.445413 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:13:44.445413 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:13:44.445413 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:13:44.445413 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Sep 19 10:13:44.445413 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:13:44.445413 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:13:44.445413 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:13:44.445413 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:13:44.445413 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:13:44.445413 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:13:44.445413 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:13:44.445413 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:13:44.446221 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 10:13:44.446221 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 10:13:44.446221 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 10:13:44.446221 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 10:13:44.446221 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 10:13:44.446221 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 10:13:44.446221 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 10:13:44.446221 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Sep 19 10:13:44.446221 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 257/524] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Sep 19 10:13:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:13:44.446678 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0791fa85-a97b-4ae9-9519-a8637189df75 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:44.502263 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0028a49f-6060-4209-ae8c-20676982764c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:44.504107 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0028a49f-6060-4209-ae8c-20676982764c None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:44.565156 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0791fa85-a97b-4ae9-9519-a8637189df75 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:44.579722 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:44.606773 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c27afd4-773e-46d9-881f-43a52fbab4a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:44.607379 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c27afd4-773e-46d9-881f-43a52fbab4a8 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:44.607658 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c27afd4-773e-46d9-881f-43a52fbab4a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:44.607928 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c27afd4-773e-46d9-881f-43a52fbab4a8 None admin] PATH_INFO: `/v3/users` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:44.608684 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c27afd4-773e-46d9-881f-43a52fbab4a8 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:13:44.608987 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c27afd4-773e-46d9-881f-43a52fbab4a8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:44.610438 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c27afd4-773e-46d9-881f-43a52fbab4a8 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:44.633584 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 258/525] 10.222.0.66 () {56 vars in 1139 bytes} [Mon Sep 19 10:13:44 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:13:44.633584 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c27afd4-773e-46d9-881f-43a52fbab4a8 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:44.638722 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 268/526] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Sep 19 10:13:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 10:13:44.643124 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0028a49f-6060-4209-ae8c-20676982764c None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:44.663733 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:44.748832 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c27afd4-773e-46d9-881f-43a52fbab4a8 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:44.760615 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0028a49f-6060-4209-ae8c-20676982764c None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:44.793111 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b089505d-5a48-4f8e-bfc9-f08941bc6c4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:44.793728 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b089505d-5a48-4f8e-bfc9-f08941bc6c4e None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:44.794259 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b089505d-5a48-4f8e-bfc9-f08941bc6c4e None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:44.794531 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b089505d-5a48-4f8e-bfc9-f08941bc6c4e None admin] PATH_INFO: `/v3/projects` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:44.795225 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b089505d-5a48-4f8e-bfc9-f08941bc6c4e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:13:44.795525 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b089505d-5a48-4f8e-bfc9-f08941bc6c4e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:44.797009 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b089505d-5a48-4f8e-bfc9-f08941bc6c4e None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:44.804944 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0074885-ffcb-4102-992a-d52334a7f2d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:44.805925 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0074885-ffcb-4102-992a-d52334a7f2d6 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:44.806402 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0074885-ffcb-4102-992a-d52334a7f2d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:44.806926 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0074885-ffcb-4102-992a-d52334a7f2d6 None admin] PATH_INFO: `/v3/projects` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:44.807863 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0074885-ffcb-4102-992a-d52334a7f2d6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:13:44.808378 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0074885-ffcb-4102-992a-d52334a7f2d6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:44.809830 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0074885-ffcb-4102-992a-d52334a7f2d6 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:44.815920 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 259/527] 10.222.0.66 () {56 vars in 1148 bytes} [Mon Sep 19 10:13:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:13:44.816809 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b089505d-5a48-4f8e-bfc9-f08941bc6c4e None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:44.829777 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 269/528] 10.222.0.66 () {56 vars in 1148 bytes} [Mon Sep 19 10:13:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:13:44.830974 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0074885-ffcb-4102-992a-d52334a7f2d6 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:44.851036 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:44.927964 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:44.934918 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b089505d-5a48-4f8e-bfc9-f08941bc6c4e None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:44.949834 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0074885-ffcb-4102-992a-d52334a7f2d6 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:44.970696 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0f02ff-a089-49dc-abbd-8767652f7167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:44.971602 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0f02ff-a089-49dc-abbd-8767652f7167 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:44.971602 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0f02ff-a089-49dc-abbd-8767652f7167 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:44.971828 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0f02ff-a089-49dc-abbd-8767652f7167 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:44.987311 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8384a4-3c36-49cd-8f64-ab2d0710bfd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:44.988159 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8384a4-3c36-49cd-8f64-ab2d0710bfd4 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:44.988677 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8384a4-3c36-49cd-8f64-ab2d0710bfd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:44.989500 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8384a4-3c36-49cd-8f64-ab2d0710bfd4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:44.999509 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8384a4-3c36-49cd-8f64-ab2d0710bfd4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:45.000977 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8384a4-3c36-49cd-8f64-ab2d0710bfd4 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:45.016905 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-1c8384a4-3c36-49cd-8f64-ab2d0710bfd4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 10:13:45.016905 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:13:45.016905 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:13:45.016905 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:13:45.016905 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:13:45.016905 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:13:45.016905 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:13:45.016905 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:13:45.016905 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:13:45.016905 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:13:45.016905 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:13:45.016905 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:13:45.016905 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 10:13:45.016905 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 10:13:45.016905 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 10:13:45.016905 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 10:13:45.017828 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:13:45.017828 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:13:45.017828 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:13:45.017828 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:13:45.017828 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:13:45.017828 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:13:45.017828 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:13:45.017828 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 19 10:13:45.017828 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:13:45.017828 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:13:45.017828 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:13:45.017828 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:13:45.017828 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:13:45.017828 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:13:45.017828 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:13:45.017828 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:13:45.017828 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 10:13:45.018679 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 10:13:45.018679 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 10:13:45.018679 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 19 10:13:45.018679 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 270/529] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 19 10:13:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:13:45.018679 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8384a4-3c36-49cd-8f64-ab2d0710bfd4 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:45.050563 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0f02ff-a089-49dc-abbd-8767652f7167 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:45.052876 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0f02ff-a089-49dc-abbd-8767652f7167 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:45.081131 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:45.123327 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8384a4-3c36-49cd-8f64-ab2d0710bfd4 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:45.156273 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:45.162611 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f8878e-12e4-4965-add7-e51fdfb28d60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:45.164755 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 260/530] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Sep 19 10:13:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 10:13:45.164890 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f8878e-12e4-4965-add7-e51fdfb28d60 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:45.164890 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f8878e-12e4-4965-add7-e51fdfb28d60 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:45.164890 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f8878e-12e4-4965-add7-e51fdfb28d60 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:45.165099 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0f02ff-a089-49dc-abbd-8767652f7167 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:45.165172 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f8878e-12e4-4965-add7-e51fdfb28d60 None admin] RBAC: Adding query filter params (role.id=75952bc2767d49c1a6e49840d8a8f349, scope.project.id=be6b93ef3359434d9c776343f0aea333, user.id=15c70bfb085a44e9b84942b480ff22f1) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:13:45.165172 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f8878e-12e4-4965-add7-e51fdfb28d60 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:45.166479 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f8878e-12e4-4965-add7-e51fdfb28d60 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:45.173309 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 271/531] 10.222.0.66 () {56 vars in 1374 bytes} [Mon Sep 19 10:13:45 2022] GET /identity/v3/role_assignments?user.id=15c70bfb085a44e9b84942b480ff22f1&scope.project.id=be6b93ef3359434d9c776343f0aea333&role.id=75952bc2767d49c1a6e49840d8a8f349 => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:13:45.174184 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f8878e-12e4-4965-add7-e51fdfb28d60 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:45.295682 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f8878e-12e4-4965-add7-e51fdfb28d60 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:45.302312 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0f02ff-a089-49dc-abbd-8767652f7167 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:45.339438 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:45.343168 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857e3a71-4d75-49de-a89c-96c46cdd421d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:45.344070 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857e3a71-4d75-49de-a89c-96c46cdd421d None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:45.344536 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857e3a71-4d75-49de-a89c-96c46cdd421d None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:45.344997 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857e3a71-4d75-49de-a89c-96c46cdd421d None admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:45.346655 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857e3a71-4d75-49de-a89c-96c46cdd421d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:13:45.347331 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857e3a71-4d75-49de-a89c-96c46cdd421d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:45.349051 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857e3a71-4d75-49de-a89c-96c46cdd421d None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:45.349614 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009c0f93-5a30-4c39-991a-506106a3c06a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:45.350351 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009c0f93-5a30-4c39-991a-506106a3c06a None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:45.350723 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009c0f93-5a30-4c39-991a-506106a3c06a None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:45.351097 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009c0f93-5a30-4c39-991a-506106a3c06a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:45.352076 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009c0f93-5a30-4c39-991a-506106a3c06a None admin] RBAC: Adding query filter params (role.id=75952bc2767d49c1a6e49840d8a8f349, scope.project.id=be6b93ef3359434d9c776343f0aea333, user.id=2f95c0d9f2414f3ca2fa2d1546d47f1b) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:13:45.352570 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009c0f93-5a30-4c39-991a-506106a3c06a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:45.354231 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009c0f93-5a30-4c39-991a-506106a3c06a None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:45.362792 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 261/532] 10.222.0.66 () {56 vars in 1374 bytes} [Mon Sep 19 10:13:45 2022] GET /identity/v3/role_assignments?user.id=2f95c0d9f2414f3ca2fa2d1546d47f1b&scope.project.id=be6b93ef3359434d9c776343f0aea333&role.id=75952bc2767d49c1a6e49840d8a8f349 => generated 259 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:13:45.363886 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009c0f93-5a30-4c39-991a-506106a3c06a None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:45.369185 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 272/533] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Sep 19 10:13:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:13:45.371219 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857e3a71-4d75-49de-a89c-96c46cdd421d None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:45.440194 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:45.485293 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009c0f93-5a30-4c39-991a-506106a3c06a None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:45.493221 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857e3a71-4d75-49de-a89c-96c46cdd421d None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:45.525443 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3d0153-6487-4ecc-8865-11133821c19b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:45.526259 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3d0153-6487-4ecc-8865-11133821c19b None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:45.526637 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3d0153-6487-4ecc-8865-11133821c19b None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:45.527029 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3d0153-6487-4ecc-8865-11133821c19b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:45.533688 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed07f2a-88fd-4778-a3ac-c7bf4e6f2eb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:45.534611 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed07f2a-88fd-4778-a3ac-c7bf4e6f2eb3 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:45.535037 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed07f2a-88fd-4778-a3ac-c7bf4e6f2eb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:45.535452 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed07f2a-88fd-4778-a3ac-c7bf4e6f2eb3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:45.541419 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3d0153-6487-4ecc-8865-11133821c19b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:45.543036 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3d0153-6487-4ecc-8865-11133821c19b None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:45.545070 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed07f2a-88fd-4778-a3ac-c7bf4e6f2eb3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:45.546959 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed07f2a-88fd-4778-a3ac-c7bf4e6f2eb3 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:45.565991 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-7e3d0153-6487-4ecc-8865-11133821c19b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 10:13:45.565991 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:13:45.565991 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:13:45.565991 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:13:45.565991 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:13:45.565991 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:13:45.565991 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:13:45.565991 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:13:45.565991 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:13:45.565991 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:13:45.565991 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:13:45.565991 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:13:45.565991 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 10:13:45.565991 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 10:13:45.565991 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 10:13:45.565991 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 10:13:45.571369 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:13:45.571369 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:13:45.571369 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:13:45.571369 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:13:45.571369 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:13:45.571369 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:13:45.571369 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:13:45.571369 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Sep 19 10:13:45.571369 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:13:45.571369 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:13:45.571369 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:13:45.571369 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:13:45.571369 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:13:45.571369 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:13:45.571369 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:13:45.571369 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:13:45.571369 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 10:13:45.572436 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 10:13:45.572436 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 10:13:45.572436 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Sep 19 10:13:45.572436 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 262/534] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 19 10:13:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:13:45.573533 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3d0153-6487-4ecc-8865-11133821c19b None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:45.574186 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-0ed07f2a-88fd-4778-a3ac-c7bf4e6f2eb3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 10:13:45.574186 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:13:45.574186 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:13:45.574186 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:13:45.574186 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:13:45.574186 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:13:45.574186 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:13:45.574186 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:13:45.574186 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:13:45.574186 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:13:45.574186 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:13:45.574186 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:13:45.574186 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 10:13:45.574186 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 10:13:45.574186 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 10:13:45.575171 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 10:13:45.575171 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:13:45.575171 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:13:45.575171 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:13:45.575171 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:13:45.575171 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:13:45.575171 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:13:45.575171 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:13:45.575171 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 19 10:13:45.575171 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:13:45.575171 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:13:45.575171 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:13:45.575171 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:13:45.575171 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:13:45.575171 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:13:45.575171 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:13:45.575171 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:13:45.576137 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 10:13:45.576137 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 10:13:45.576137 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 10:13:45.576137 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 10:13:45.576137 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 10:13:45.576137 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 10:13:45.576137 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 10:13:45.576137 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 19 10:13:45.585471 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 273/535] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Sep 19 10:13:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 10:13:45.591784 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed07f2a-88fd-4778-a3ac-c7bf4e6f2eb3 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:45.628601 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:45.695116 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3d0153-6487-4ecc-8865-11133821c19b None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:45.733329 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cd7b35-b5c8-497b-a1ea-3c953d4bd717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:45.733676 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed07f2a-88fd-4778-a3ac-c7bf4e6f2eb3 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:45.734206 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cd7b35-b5c8-497b-a1ea-3c953d4bd717 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:45.734581 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cd7b35-b5c8-497b-a1ea-3c953d4bd717 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:45.734952 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cd7b35-b5c8-497b-a1ea-3c953d4bd717 None admin] PATH_INFO: `/v3/domains` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:45.735712 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cd7b35-b5c8-497b-a1ea-3c953d4bd717 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:13:45.736228 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cd7b35-b5c8-497b-a1ea-3c953d4bd717 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:45.737807 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cd7b35-b5c8-497b-a1ea-3c953d4bd717 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:45.751206 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 263/536] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Sep 19 10:13:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:13:45.756721 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cd7b35-b5c8-497b-a1ea-3c953d4bd717 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:45.757578 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:45.775291 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ee2bb9-3b92-4689-b94f-77ff45b2c231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:45.776001 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ee2bb9-3b92-4689-b94f-77ff45b2c231 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:45.776628 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ee2bb9-3b92-4689-b94f-77ff45b2c231 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:45.776762 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ee2bb9-3b92-4689-b94f-77ff45b2c231 None admin] PATH_INFO: `/v3/projects` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:45.777369 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ee2bb9-3b92-4689-b94f-77ff45b2c231 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:13:45.777679 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ee2bb9-3b92-4689-b94f-77ff45b2c231 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:45.779138 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ee2bb9-3b92-4689-b94f-77ff45b2c231 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:45.796380 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 274/537] 10.222.0.66 () {56 vars in 1148 bytes} [Mon Sep 19 10:13:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 10:13:45.799826 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ee2bb9-3b92-4689-b94f-77ff45b2c231 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:45.909906 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cd7b35-b5c8-497b-a1ea-3c953d4bd717 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:45.914061 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:45.943564 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ee2bb9-3b92-4689-b94f-77ff45b2c231 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:45.956077 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d63304-92f8-47b5-a297-20b9ca3d0026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:45.957088 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d63304-92f8-47b5-a297-20b9ca3d0026 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:45.957590 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d63304-92f8-47b5-a297-20b9ca3d0026 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:45.960271 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d63304-92f8-47b5-a297-20b9ca3d0026 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:45.970184 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d63304-92f8-47b5-a297-20b9ca3d0026 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:45.974191 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d63304-92f8-47b5-a297-20b9ca3d0026 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:45.996371 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-13d63304-92f8-47b5-a297-20b9ca3d0026 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 10:13:45.996371 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:13:45.996371 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:13:45.996371 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:13:45.996371 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:13:45.996371 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:13:45.996371 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:13:45.996371 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:13:45.996371 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:13:45.996371 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:13:45.996371 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:13:45.996371 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:13:45.996371 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 10:13:45.996371 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 10:13:45.996371 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 10:13:45.997287 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 10:13:45.997287 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:13:45.997287 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:13:45.997287 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:13:45.997287 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:13:45.997287 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:13:45.997287 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:13:45.997287 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:13:45.997287 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Sep 19 10:13:45.997287 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:13:45.997287 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:13:45.997287 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:13:45.997287 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:13:45.997287 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:13:45.997287 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:13:45.997287 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:13:45.997287 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:13:45.998130 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 10:13:45.998130 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 10:13:45.998130 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 10:13:45.998130 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 10:13:45.998130 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 10:13:45.998130 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 10:13:45.998130 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 10:13:45.998130 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Sep 19 10:13:46.006442 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 264/538] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Sep 19 10:13:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 10:13:46.017154 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d63304-92f8-47b5-a297-20b9ca3d0026 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:46.018291 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156ffecd-cb85-4e98-aed8-80fe3937895d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:46.021706 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156ffecd-cb85-4e98-aed8-80fe3937895d None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:46.022201 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156ffecd-cb85-4e98-aed8-80fe3937895d None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:46.022745 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156ffecd-cb85-4e98-aed8-80fe3937895d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:46.023677 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156ffecd-cb85-4e98-aed8-80fe3937895d None admin] RBAC: Adding query filter params (role.id=75952bc2767d49c1a6e49840d8a8f349, scope.project.id=be6b93ef3359434d9c776343f0aea333, user.id=dfa4d004fd44482cae761c4b3bdfab31) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:13:46.026489 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156ffecd-cb85-4e98-aed8-80fe3937895d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:46.028326 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156ffecd-cb85-4e98-aed8-80fe3937895d None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:46.035705 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 275/539] 10.222.0.66 () {56 vars in 1374 bytes} [Mon Sep 19 10:13:45 2022] GET /identity/v3/role_assignments?user.id=dfa4d004fd44482cae761c4b3bdfab31&scope.project.id=be6b93ef3359434d9c776343f0aea333&role.id=75952bc2767d49c1a6e49840d8a8f349 => generated 259 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 10:13:46.175485 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d63304-92f8-47b5-a297-20b9ca3d0026 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:46.201470 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bc146a-0d65-4574-9bc6-ffc0043a9efb None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:46.201789 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bc146a-0d65-4574-9bc6-ffc0043a9efb None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:46.202046 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bc146a-0d65-4574-9bc6-ffc0043a9efb None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:46.203611 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 276/540] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:13:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 10:13:46.209900 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e01b5a-170b-4803-b754-b00670f2826f None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:46.210174 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e01b5a-170b-4803-b754-b00670f2826f None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:46.210442 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e01b5a-170b-4803-b754-b00670f2826f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:46.224671 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b185ec7-62a2-4899-a0d5-8e3fad6c0da8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:46.225539 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b185ec7-62a2-4899-a0d5-8e3fad6c0da8 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:46.225988 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b185ec7-62a2-4899-a0d5-8e3fad6c0da8 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:46.226405 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b185ec7-62a2-4899-a0d5-8e3fad6c0da8 None admin] PATH_INFO: `/v3/projects` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:46.228841 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b185ec7-62a2-4899-a0d5-8e3fad6c0da8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:13:46.229353 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b185ec7-62a2-4899-a0d5-8e3fad6c0da8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:46.231022 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b185ec7-62a2-4899-a0d5-8e3fad6c0da8 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:46.245358 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 265/541] 10.222.0.66 () {56 vars in 1148 bytes} [Mon Sep 19 10:13:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:13:46.249281 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-81e01b5a-170b-4803-b754-b00670f2826f None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:13:46.250756 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-81e01b5a-170b-4803-b754-b00670f2826f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:13:46.251804 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b185ec7-62a2-4899-a0d5-8e3fad6c0da8 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:46.306622 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:46.317689 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:46.363351 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 277/542] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:13:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 10:13:46.417176 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b185ec7-62a2-4899-a0d5-8e3fad6c0da8 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:46.472708 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef21600a-3739-4413-8cbf-2ad24cdcb5d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:46.473566 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef21600a-3739-4413-8cbf-2ad24cdcb5d7 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:46.473984 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef21600a-3739-4413-8cbf-2ad24cdcb5d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:46.474409 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef21600a-3739-4413-8cbf-2ad24cdcb5d7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:46.475267 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef21600a-3739-4413-8cbf-2ad24cdcb5d7 None admin] RBAC: Adding query filter params (role.id=75952bc2767d49c1a6e49840d8a8f349, scope.project.id=be6b93ef3359434d9c776343f0aea333, user.id=0c1289b015854c6bb6aee8fed6b807db) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:13:46.475711 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef21600a-3739-4413-8cbf-2ad24cdcb5d7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:46.477311 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef21600a-3739-4413-8cbf-2ad24cdcb5d7 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:46.488259 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 266/543] 10.222.0.66 () {56 vars in 1374 bytes} [Mon Sep 19 10:13:46 2022] GET /identity/v3/role_assignments?user.id=0c1289b015854c6bb6aee8fed6b807db&scope.project.id=be6b93ef3359434d9c776343f0aea333&role.id=75952bc2767d49c1a6e49840d8a8f349 => generated 259 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:13:46.646017 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e01b5a-170b-4803-b754-b00670f2826f None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:46.761328 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e01b5a-170b-4803-b754-b00670f2826f None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:46.809798 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca431441-c678-43ea-bf41-fda36bb9fb35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:46.810582 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca431441-c678-43ea-bf41-fda36bb9fb35 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:46.810965 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca431441-c678-43ea-bf41-fda36bb9fb35 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:46.811337 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca431441-c678-43ea-bf41-fda36bb9fb35 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:46.826991 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca431441-c678-43ea-bf41-fda36bb9fb35 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 10:13:46.831981 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-ca431441-c678-43ea-bf41-fda36bb9fb35 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 10:13:46.831981 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:13:46.831981 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:13:46.831981 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:13:46.831981 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:13:46.831981 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:13:46.831981 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:13:46.831981 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:13:46.831981 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:13:46.831981 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:13:46.831981 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:13:46.831981 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:13:46.831981 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 10:13:46.831981 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 10:13:46.831981 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 10:13:46.831981 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 10:13:46.833662 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 10:13:46.833662 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 10:13:46.833662 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 10:13:46.833662 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 10:13:46.833662 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:13:46.833662 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:13:46.833662 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:13:46.833662 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:13:46.833662 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:13:46.833662 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:13:46.833662 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:13:46.833662 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 19 10:13:46.833662 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:13:46.833662 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:13:46.833662 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:13:46.833662 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:13:46.834629 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:13:46.834629 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:13:46.834629 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:13:46.834629 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:13:46.834629 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 10:13:46.834629 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 10:13:46.834629 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 10:13:46.834629 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 10:13:46.834629 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 10:13:46.834629 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 10:13:46.834629 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 10:13:46.834629 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 19 10:13:46.836517 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 278/544] 10.222.0.66 () {56 vars in 1102 bytes} [Mon Sep 19 10:13:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:13:46.842485 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef21600a-3739-4413-8cbf-2ad24cdcb5d7 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:46.958556 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:46.971061 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef21600a-3739-4413-8cbf-2ad24cdcb5d7 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:47.015348 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84b582b-1bf1-4cb1-b84b-822eb1c5641e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:47.015881 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84b582b-1bf1-4cb1-b84b-822eb1c5641e None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:47.016182 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84b582b-1bf1-4cb1-b84b-822eb1c5641e None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:47.016458 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84b582b-1bf1-4cb1-b84b-822eb1c5641e None admin] PATH_INFO: `/v3/roles` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:47.017125 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84b582b-1bf1-4cb1-b84b-822eb1c5641e None admin] RBAC: Adding query filter params (name=service) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:13:47.017428 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84b582b-1bf1-4cb1-b84b-822eb1c5641e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:47.018799 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84b582b-1bf1-4cb1-b84b-822eb1c5641e None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:47.027720 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 267/545] 10.222.0.66 () {56 vars in 1103 bytes} [Mon Sep 19 10:13:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:13:47.033586 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca431441-c678-43ea-bf41-fda36bb9fb35 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:47.093010 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:47.172556 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca431441-c678-43ea-bf41-fda36bb9fb35 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:47.215638 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b033884-9cc7-41b3-b212-04a410f6f0ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:47.216590 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b033884-9cc7-41b3-b212-04a410f6f0ae None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:47.217016 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b033884-9cc7-41b3-b212-04a410f6f0ae None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:47.217472 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b033884-9cc7-41b3-b212-04a410f6f0ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:47.228813 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b033884-9cc7-41b3-b212-04a410f6f0ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:47.230486 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b033884-9cc7-41b3-b212-04a410f6f0ae None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:47.253647 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-1b033884-9cc7-41b3-b212-04a410f6f0ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 10:13:47.253647 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:13:47.253647 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:13:47.253647 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:13:47.253647 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:13:47.253647 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:13:47.253647 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:13:47.253647 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:13:47.253647 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:13:47.253647 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:13:47.253647 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:13:47.253647 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:13:47.253647 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 10:13:47.253647 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 10:13:47.253647 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 10:13:47.253647 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 10:13:47.255286 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:13:47.255286 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:13:47.255286 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:13:47.255286 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:13:47.255286 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:13:47.255286 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:13:47.255286 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:13:47.255286 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 19 10:13:47.255286 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:13:47.255286 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:13:47.255286 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:13:47.255286 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:13:47.255286 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:13:47.255286 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:13:47.255286 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:13:47.255286 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:13:47.255286 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 10:13:47.260118 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 10:13:47.260118 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 10:13:47.260118 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 19 10:13:47.261892 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 279/546] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 19 10:13:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:13:47.269309 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84b582b-1bf1-4cb1-b84b-822eb1c5641e None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:47.408210 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84b582b-1bf1-4cb1-b84b-822eb1c5641e None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:47.454188 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6b67f7-f1c6-416d-bc66-2bdc5c4ef811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:47.454816 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6b67f7-f1c6-416d-bc66-2bdc5c4ef811 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:47.455079 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6b67f7-f1c6-416d-bc66-2bdc5c4ef811 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:47.455357 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6b67f7-f1c6-416d-bc66-2bdc5c4ef811 None admin] PATH_INFO: `/v3/domains` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:47.456004 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6b67f7-f1c6-416d-bc66-2bdc5c4ef811 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:13:47.456412 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6b67f7-f1c6-416d-bc66-2bdc5c4ef811 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:47.457872 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6b67f7-f1c6-416d-bc66-2bdc5c4ef811 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:47.470282 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 268/547] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Sep 19 10:13:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:13:47.475945 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b033884-9cc7-41b3-b212-04a410f6f0ae None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:47.595662 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:47.617666 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b033884-9cc7-41b3-b212-04a410f6f0ae None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:47.659632 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef08250e-0984-45e8-9526-857f0cbbb298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:47.661491 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef08250e-0984-45e8-9526-857f0cbbb298 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:47.661942 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef08250e-0984-45e8-9526-857f0cbbb298 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:47.662374 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef08250e-0984-45e8-9526-857f0cbbb298 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:47.670949 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef08250e-0984-45e8-9526-857f0cbbb298 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:47.672616 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef08250e-0984-45e8-9526-857f0cbbb298 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:47.685107 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-ef08250e-0984-45e8-9526-857f0cbbb298 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 19 10:13:47.685107 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:13:47.685107 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:13:47.685107 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:13:47.685107 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:13:47.685107 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:13:47.685107 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:13:47.685107 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:13:47.685107 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:13:47.685107 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:13:47.685107 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:13:47.685107 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:13:47.685107 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 10:13:47.685107 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 10:13:47.685107 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 10:13:47.685107 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 10:13:47.686618 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:13:47.686618 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:13:47.686618 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 10:13:47.686618 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 10:13:47.686618 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 10:13:47.686618 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 10:13:47.686618 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:13:47.686618 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:13:47.686618 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:13:47.686618 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:13:47.686618 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:13:47.686618 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 19 10:13:47.686618 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:13:47.686618 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:13:47.686618 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:13:47.686618 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:13:47.686618 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:13:47.686618 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:13:47.687845 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:13:47.687845 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:13:47.687845 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 10:13:47.687845 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 10:13:47.687845 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 10:13:47.687845 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 10:13:47.687845 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 10:13:47.687845 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 10:13:47.687845 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 19 10:13:47.687845 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 19 10:13:47.690076 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 280/548] 10.222.0.66 () {56 vars in 1096 bytes} [Mon Sep 19 10:13:47 2022] GET /identity/v3/users/swift => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:13:47.698660 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6b67f7-f1c6-416d-bc66-2bdc5c4ef811 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:47.721266 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:47.834317 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6b67f7-f1c6-416d-bc66-2bdc5c4ef811 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:47.858188 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8b209c-42a5-44af-9b2a-d3725ab8dadf None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:47.858367 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8b209c-42a5-44af-9b2a-d3725ab8dadf None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:47.858641 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8b209c-42a5-44af-9b2a-d3725ab8dadf None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:47.860235 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 281/549] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:13:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:13:47.868145 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81856484-1498-4ac0-a7a7-46274ed598a5 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:47.868458 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81856484-1498-4ac0-a7a7-46274ed598a5 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:47.868713 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81856484-1498-4ac0-a7a7-46274ed598a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:47.869603 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6b57e4-1398-4167-b7a8-35213e0a2395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:47.870221 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6b57e4-1398-4167-b7a8-35213e0a2395 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:47.870503 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6b57e4-1398-4167-b7a8-35213e0a2395 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:47.870780 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6b57e4-1398-4167-b7a8-35213e0a2395 None admin] PATH_INFO: `/v3/users` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:47.871504 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6b57e4-1398-4167-b7a8-35213e0a2395 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:13:47.871811 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6b57e4-1398-4167-b7a8-35213e0a2395 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:47.873287 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6b57e4-1398-4167-b7a8-35213e0a2395 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:47.892213 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 269/550] 10.222.0.66 () {56 vars in 1135 bytes} [Mon Sep 19 10:13:47 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:13:47.901933 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-81856484-1498-4ac0-a7a7-46274ed598a5 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:13:47.903144 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-81856484-1498-4ac0-a7a7-46274ed598a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:13:47.906873 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6b57e4-1398-4167-b7a8-35213e0a2395 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:47.977057 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 282/551] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:13:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 10:13:48.012818 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:48.049612 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6b57e4-1398-4167-b7a8-35213e0a2395 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:48.093699 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238d3915-c7ae-4c11-930a-c47bf52b35b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:48.094314 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238d3915-c7ae-4c11-930a-c47bf52b35b6 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:48.094591 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238d3915-c7ae-4c11-930a-c47bf52b35b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:48.094860 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238d3915-c7ae-4c11-930a-c47bf52b35b6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:48.176659 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238d3915-c7ae-4c11-930a-c47bf52b35b6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:48.178107 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238d3915-c7ae-4c11-930a-c47bf52b35b6 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:48.261284 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:48.307884 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 270/552] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Sep 19 10:13:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 19 10:13:48.314119 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81856484-1498-4ac0-a7a7-46274ed598a5 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:48.314257 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7ec60b-f2c1-49a2-bfca-9900dc326f28 None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:48.314257 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7ec60b-f2c1-49a2-bfca-9900dc326f28 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:48.314598 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7ec60b-f2c1-49a2-bfca-9900dc326f28 None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:48.316020 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 271/553] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:13:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:13:48.325366 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72658184-163b-492e-b98e-adf1cf7fafdc None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:48.327609 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72658184-163b-492e-b98e-adf1cf7fafdc None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:48.328142 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72658184-163b-492e-b98e-adf1cf7fafdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:48.360221 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-72658184-163b-492e-b98e-adf1cf7fafdc None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:13:48.362543 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-72658184-163b-492e-b98e-adf1cf7fafdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:13:48.446191 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:48.479773 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 272/554] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:13:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 10:13:48.481446 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72658184-163b-492e-b98e-adf1cf7fafdc None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:48.503668 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81856484-1498-4ac0-a7a7-46274ed598a5 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:48.580299 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a6dfe1-b5d3-40b0-bce4-64943853dc16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:48.583228 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a6dfe1-b5d3-40b0-bce4-64943853dc16 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:48.588192 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a6dfe1-b5d3-40b0-bce4-64943853dc16 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:48.588764 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a6dfe1-b5d3-40b0-bce4-64943853dc16 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:48.611367 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a6dfe1-b5d3-40b0-bce4-64943853dc16 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:48.616812 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a6dfe1-b5d3-40b0-bce4-64943853dc16 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:48.646869 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-27a6dfe1-b5d3-40b0-bce4-64943853dc16 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 10:13:48.646869 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:13:48.646869 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:13:48.646869 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:13:48.646869 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:13:48.646869 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:13:48.646869 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:13:48.646869 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:13:48.646869 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:13:48.646869 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:13:48.646869 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:13:48.646869 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:13:48.646869 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 10:13:48.646869 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 10:13:48.646869 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 10:13:48.646869 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 10:13:48.648029 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:13:48.648029 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:13:48.648029 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:13:48.648029 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:13:48.648029 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:13:48.648029 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:13:48.648029 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:13:48.648029 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 19 10:13:48.648029 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:13:48.648029 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:13:48.648029 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:13:48.648029 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:13:48.648029 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:13:48.648029 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:13:48.648029 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:13:48.648029 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:13:48.648029 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 10:13:48.648970 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 10:13:48.648970 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 10:13:48.648970 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 19 10:13:48.656777 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 283/555] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 19 10:13:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 343 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:13:48.663116 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a6dfe1-b5d3-40b0-bce4-64943853dc16 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:48.690615 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:48.701039 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72658184-163b-492e-b98e-adf1cf7fafdc None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:48.778158 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f91ddc-2d86-4da3-b935-56506100044b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:48.779188 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f91ddc-2d86-4da3-b935-56506100044b None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:48.780300 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f91ddc-2d86-4da3-b935-56506100044b None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:48.781289 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f91ddc-2d86-4da3-b935-56506100044b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:48.798956 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f91ddc-2d86-4da3-b935-56506100044b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 10:13:48.807023 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-b0f91ddc-2d86-4da3-b935-56506100044b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 10:13:48.807023 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:13:48.807023 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:13:48.807023 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:13:48.807023 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:13:48.807023 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:13:48.807023 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:13:48.807023 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:13:48.807023 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:13:48.807023 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:13:48.807023 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:13:48.807023 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:13:48.807023 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 10:13:48.807023 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 10:13:48.807023 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 10:13:48.807023 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 10:13:48.807948 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 10:13:48.807948 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 10:13:48.807948 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 10:13:48.807948 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 10:13:48.807948 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:13:48.807948 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:13:48.807948 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:13:48.807948 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:13:48.807948 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:13:48.807948 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:13:48.807948 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:13:48.807948 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Sep 19 10:13:48.807948 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:13:48.807948 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:13:48.807948 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:13:48.807948 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:13:48.808791 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:13:48.808791 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:13:48.808791 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:13:48.808791 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:13:48.808791 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 10:13:48.808791 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 10:13:48.808791 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 10:13:48.808791 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 10:13:48.808791 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 10:13:48.808791 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 10:13:48.808791 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 10:13:48.808791 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Sep 19 10:13:48.811410 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 273/556] 10.222.0.66 () {56 vars in 1102 bytes} [Mon Sep 19 10:13:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:13:48.812510 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f91ddc-2d86-4da3-b935-56506100044b None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:48.852458 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a6dfe1-b5d3-40b0-bce4-64943853dc16 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:48.884544 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:48.899311 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6af49d1-4abe-4637-87ec-935e99259525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:48.900089 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6af49d1-4abe-4637-87ec-935e99259525 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:48.900686 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6af49d1-4abe-4637-87ec-935e99259525 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:48.901008 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6af49d1-4abe-4637-87ec-935e99259525 None admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:48.901768 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6af49d1-4abe-4637-87ec-935e99259525 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:13:48.902748 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6af49d1-4abe-4637-87ec-935e99259525 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:48.903777 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6af49d1-4abe-4637-87ec-935e99259525 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:48.922810 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 284/557] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Sep 19 10:13:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 10:13:48.922810 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6af49d1-4abe-4637-87ec-935e99259525 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:48.954199 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f91ddc-2d86-4da3-b935-56506100044b None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:48.995612 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea62d558-4122-46d0-a85b-afe9928b629a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:48.996326 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea62d558-4122-46d0-a85b-afe9928b629a None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:48.996610 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea62d558-4122-46d0-a85b-afe9928b629a None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:48.996904 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea62d558-4122-46d0-a85b-afe9928b629a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:49.008448 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea62d558-4122-46d0-a85b-afe9928b629a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 10:13:49.017697 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-ea62d558-4122-46d0-a85b-afe9928b629a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 10:13:49.017697 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:13:49.017697 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:13:49.017697 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:13:49.017697 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:13:49.017697 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:13:49.017697 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:13:49.017697 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:13:49.017697 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:13:49.017697 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:13:49.017697 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:13:49.017697 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:13:49.017697 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 10:13:49.017697 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 10:13:49.017697 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 10:13:49.017697 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 10:13:49.019141 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 10:13:49.019141 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 10:13:49.019141 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 10:13:49.019141 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 10:13:49.019141 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:13:49.019141 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:13:49.019141 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:13:49.019141 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:13:49.019141 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:13:49.019141 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:13:49.019141 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:13:49.019141 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Sep 19 10:13:49.019141 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:13:49.019141 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:13:49.019141 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:13:49.019141 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:13:49.019972 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:13:49.019972 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:13:49.019972 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:13:49.019972 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:13:49.019972 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 10:13:49.019972 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 10:13:49.019972 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 10:13:49.019972 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 10:13:49.019972 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 10:13:49.019972 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 10:13:49.019972 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 10:13:49.019972 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Sep 19 10:13:49.024131 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 274/558] 10.222.0.66 () {56 vars in 1102 bytes} [Mon Sep 19 10:13:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:13:49.025570 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea62d558-4122-46d0-a85b-afe9928b629a None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:49.048082 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:49.057527 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6af49d1-4abe-4637-87ec-935e99259525 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:49.106983 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da182cfb-a048-4f90-a759-c37b65414607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:49.107755 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da182cfb-a048-4f90-a759-c37b65414607 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:49.108305 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da182cfb-a048-4f90-a759-c37b65414607 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:49.108584 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da182cfb-a048-4f90-a759-c37b65414607 None admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:49.109248 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da182cfb-a048-4f90-a759-c37b65414607 None admin] RBAC: Adding query filter params (name=service) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:13:49.109552 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da182cfb-a048-4f90-a759-c37b65414607 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:49.112108 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da182cfb-a048-4f90-a759-c37b65414607 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:49.127551 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 285/559] 10.222.0.66 () {56 vars in 1103 bytes} [Mon Sep 19 10:13:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:13:49.127551 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da182cfb-a048-4f90-a759-c37b65414607 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:49.151627 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea62d558-4122-46d0-a85b-afe9928b629a None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:49.185614 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:49.199305 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96da4b45-9a35-4caa-926d-55fdd928eb08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:49.199950 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96da4b45-9a35-4caa-926d-55fdd928eb08 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:49.200288 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96da4b45-9a35-4caa-926d-55fdd928eb08 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:49.200521 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96da4b45-9a35-4caa-926d-55fdd928eb08 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:49.207748 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96da4b45-9a35-4caa-926d-55fdd928eb08 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:49.209163 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96da4b45-9a35-4caa-926d-55fdd928eb08 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:49.220781 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-96da4b45-9a35-4caa-926d-55fdd928eb08 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 10:13:49.220781 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:13:49.220781 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:13:49.220781 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:13:49.220781 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:13:49.220781 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:13:49.220781 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:13:49.220781 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:13:49.220781 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:13:49.220781 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:13:49.220781 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:13:49.220781 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:13:49.220781 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 10:13:49.220781 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 10:13:49.220781 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 10:13:49.228799 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 10:13:49.228799 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:13:49.228799 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:13:49.228799 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:13:49.228799 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:13:49.228799 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:13:49.228799 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:13:49.228799 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:13:49.228799 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Sep 19 10:13:49.228799 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:13:49.228799 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:13:49.228799 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:13:49.228799 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:13:49.228799 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:13:49.228799 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:13:49.228799 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:13:49.228799 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:13:49.229740 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 10:13:49.229740 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 10:13:49.229740 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 10:13:49.229740 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 10:13:49.229740 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 10:13:49.229740 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 10:13:49.229740 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 10:13:49.229740 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Sep 19 10:13:49.229740 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 275/560] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Sep 19 10:13:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:13:49.229740 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96da4b45-9a35-4caa-926d-55fdd928eb08 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:49.256475 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da182cfb-a048-4f90-a759-c37b65414607 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:49.295008 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0a626a-5523-499a-94cd-4cd512bb335e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:49.295612 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0a626a-5523-499a-94cd-4cd512bb335e None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:49.295897 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0a626a-5523-499a-94cd-4cd512bb335e None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:49.296189 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0a626a-5523-499a-94cd-4cd512bb335e None admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:49.296842 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0a626a-5523-499a-94cd-4cd512bb335e None admin] RBAC: Adding query filter params (name=service) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:13:49.297144 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0a626a-5523-499a-94cd-4cd512bb335e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:49.298506 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0a626a-5523-499a-94cd-4cd512bb335e None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:49.307430 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 286/561] 10.222.0.66 () {56 vars in 1103 bytes} [Mon Sep 19 10:13:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:13:49.308643 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54817dc1-7fda-4bcc-ae56-31d20dcbb4c9 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:49.308928 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54817dc1-7fda-4bcc-ae56-31d20dcbb4c9 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:49.309202 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54817dc1-7fda-4bcc-ae56-31d20dcbb4c9 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:49.310384 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 287/562] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:13:49 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:13:49.311076 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54817dc1-7fda-4bcc-ae56-31d20dcbb4c9 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:49.313894 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:49.336591 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96da4b45-9a35-4caa-926d-55fdd928eb08 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:49.370705 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4c72a1-285a-407a-ba0c-791936063758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:49.371338 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4c72a1-285a-407a-ba0c-791936063758 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:49.371618 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4c72a1-285a-407a-ba0c-791936063758 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:49.371897 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4c72a1-285a-407a-ba0c-791936063758 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:49.382448 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4c72a1-285a-407a-ba0c-791936063758 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:49.383899 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4c72a1-285a-407a-ba0c-791936063758 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:49.398722 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-6c4c72a1-285a-407a-ba0c-791936063758 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 10:13:49.398722 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:13:49.398722 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:13:49.398722 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:13:49.398722 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:13:49.398722 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:13:49.398722 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:13:49.398722 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:13:49.398722 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:13:49.398722 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:13:49.398722 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:13:49.398722 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:13:49.398722 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 10:13:49.398722 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 10:13:49.398722 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 10:13:49.398722 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 10:13:49.400073 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:13:49.400073 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:13:49.400073 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:13:49.400073 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:13:49.400073 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:13:49.400073 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:13:49.400073 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:13:49.400073 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Sep 19 10:13:49.400073 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:13:49.400073 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:13:49.400073 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:13:49.400073 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:13:49.400073 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:13:49.400073 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:13:49.400073 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:13:49.400073 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:13:49.400073 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 10:13:49.401383 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 10:13:49.401383 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 10:13:49.401383 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Sep 19 10:13:49.401383 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 276/563] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 19 10:13:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:13:49.401383 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b77d6ed-78a1-4325-9cc9-0fa956832073 None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:49.401737 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b77d6ed-78a1-4325-9cc9-0fa956832073 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:49.401817 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b77d6ed-78a1-4325-9cc9-0fa956832073 None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:49.403101 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 277/564] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:13:49 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:13:49.403652 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b77d6ed-78a1-4325-9cc9-0fa956832073 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:49.421608 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54817dc1-7fda-4bcc-ae56-31d20dcbb4c9 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:49.430736 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:49.455215 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1171ce-43e8-4bc2-812c-b2969fd65505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:49.455822 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1171ce-43e8-4bc2-812c-b2969fd65505 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:49.456099 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1171ce-43e8-4bc2-812c-b2969fd65505 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:49.456398 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1171ce-43e8-4bc2-812c-b2969fd65505 None admin] PATH_INFO: `/v3/projects` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:49.457080 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1171ce-43e8-4bc2-812c-b2969fd65505 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:13:49.457384 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1171ce-43e8-4bc2-812c-b2969fd65505 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:49.459409 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1171ce-43e8-4bc2-812c-b2969fd65505 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:49.471254 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 288/565] 10.222.0.66 () {56 vars in 1148 bytes} [Mon Sep 19 10:13:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:13:49.472455 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d121646-0a2b-4ea4-bc59-c70f18fc925c None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:49.472739 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d121646-0a2b-4ea4-bc59-c70f18fc925c None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:49.473018 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d121646-0a2b-4ea4-bc59-c70f18fc925c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:49.491168 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-4d121646-0a2b-4ea4-bc59-c70f18fc925c None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:13:49.492408 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-4d121646-0a2b-4ea4-bc59-c70f18fc925c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:13:49.506748 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b77d6ed-78a1-4325-9cc9-0fa956832073 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:49.535629 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:49.542649 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766e2144-9be5-401f-b200-80e2a4492978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:49.543276 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766e2144-9be5-401f-b200-80e2a4492978 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:49.543547 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766e2144-9be5-401f-b200-80e2a4492978 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:49.543826 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766e2144-9be5-401f-b200-80e2a4492978 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:49.555223 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766e2144-9be5-401f-b200-80e2a4492978 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:49.556725 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766e2144-9be5-401f-b200-80e2a4492978 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:49.562564 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 289/566] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:13:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 10:13:49.563411 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d121646-0a2b-4ea4-bc59-c70f18fc925c None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:49.579928 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-766e2144-9be5-401f-b200-80e2a4492978 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 10:13:49.579928 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:13:49.579928 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:13:49.579928 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:13:49.579928 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:13:49.579928 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:13:49.579928 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:13:49.579928 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:13:49.579928 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:13:49.579928 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:13:49.579928 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:13:49.579928 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:13:49.579928 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 10:13:49.579928 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 10:13:49.579928 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 10:13:49.579928 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 10:13:49.581102 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:13:49.581102 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:13:49.581102 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:13:49.581102 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:13:49.581102 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:13:49.581102 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:13:49.581102 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:13:49.581102 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Sep 19 10:13:49.581102 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:13:49.581102 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:13:49.581102 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:13:49.581102 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:13:49.581102 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:13:49.581102 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:13:49.581102 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:13:49.581102 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:13:49.581102 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 10:13:49.582204 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 10:13:49.582204 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 10:13:49.582204 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Sep 19 10:13:49.584219 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 278/567] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 19 10:13:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:13:49.585448 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad1c880-b6bd-4f9b-bec8-4247d99666d8 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:49.585731 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad1c880-b6bd-4f9b-bec8-4247d99666d8 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:49.586011 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad1c880-b6bd-4f9b-bec8-4247d99666d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:49.604432 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-3ad1c880-b6bd-4f9b-bec8-4247d99666d8 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:13:49.605598 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-3ad1c880-b6bd-4f9b-bec8-4247d99666d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:13:49.680293 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:49.680878 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 279/568] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:13:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 10:13:49.682071 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad1c880-b6bd-4f9b-bec8-4247d99666d8 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:49.685177 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d121646-0a2b-4ea4-bc59-c70f18fc925c None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:49.731563 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45378df-f032-43c3-b4c8-f133900a615c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:49.732840 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45378df-f032-43c3-b4c8-f133900a615c None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:49.733296 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45378df-f032-43c3-b4c8-f133900a615c None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:49.733718 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45378df-f032-43c3-b4c8-f133900a615c None admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:49.734907 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45378df-f032-43c3-b4c8-f133900a615c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:13:49.735368 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45378df-f032-43c3-b4c8-f133900a615c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:49.737493 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45378df-f032-43c3-b4c8-f133900a615c None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:49.751050 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 290/569] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Sep 19 10:13:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:13:49.752019 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45378df-f032-43c3-b4c8-f133900a615c None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:49.800656 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad1c880-b6bd-4f9b-bec8-4247d99666d8 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:49.815239 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:49.838922 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648cfab7-ef7d-4119-bf8b-1d030e3fa246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:49.839922 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648cfab7-ef7d-4119-bf8b-1d030e3fa246 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:49.840423 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648cfab7-ef7d-4119-bf8b-1d030e3fa246 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:49.840834 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648cfab7-ef7d-4119-bf8b-1d030e3fa246 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:49.841689 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648cfab7-ef7d-4119-bf8b-1d030e3fa246 None admin] RBAC: Adding query filter params (role.id=75952bc2767d49c1a6e49840d8a8f349, scope.project.id=be6b93ef3359434d9c776343f0aea333, user.id=6677354e36614c9fb3d03413749be5ca) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:13:49.842136 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648cfab7-ef7d-4119-bf8b-1d030e3fa246 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:49.843931 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648cfab7-ef7d-4119-bf8b-1d030e3fa246 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:49.850370 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 280/570] 10.222.0.66 () {56 vars in 1374 bytes} [Mon Sep 19 10:13:49 2022] GET /identity/v3/role_assignments?user.id=6677354e36614c9fb3d03413749be5ca&scope.project.id=be6b93ef3359434d9c776343f0aea333&role.id=75952bc2767d49c1a6e49840d8a8f349 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:13:49.851326 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648cfab7-ef7d-4119-bf8b-1d030e3fa246 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:49.863460 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45378df-f032-43c3-b4c8-f133900a615c None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:49.904379 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60a6ad0-6702-4237-90d2-a6c4b82a4be6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:49.905175 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60a6ad0-6702-4237-90d2-a6c4b82a4be6 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:49.905547 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60a6ad0-6702-4237-90d2-a6c4b82a4be6 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:49.905914 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60a6ad0-6702-4237-90d2-a6c4b82a4be6 None admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:49.906678 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60a6ad0-6702-4237-90d2-a6c4b82a4be6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:13:49.907081 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60a6ad0-6702-4237-90d2-a6c4b82a4be6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:49.908936 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60a6ad0-6702-4237-90d2-a6c4b82a4be6 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:49.924579 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 291/571] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Sep 19 10:13:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:13:49.925637 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60a6ad0-6702-4237-90d2-a6c4b82a4be6 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:49.948681 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:49.973235 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648cfab7-ef7d-4119-bf8b-1d030e3fa246 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:50.011953 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0fbd52-0abc-4e71-9c04-4e8da87d0ddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:50.012580 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0fbd52-0abc-4e71-9c04-4e8da87d0ddd None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:50.012864 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0fbd52-0abc-4e71-9c04-4e8da87d0ddd None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:50.013140 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0fbd52-0abc-4e71-9c04-4e8da87d0ddd None admin] PATH_INFO: `/v3/users/nova` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:50.023038 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0fbd52-0abc-4e71-9c04-4e8da87d0ddd None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:50.024560 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0fbd52-0abc-4e71-9c04-4e8da87d0ddd None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:50.037774 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60a6ad0-6702-4237-90d2-a6c4b82a4be6 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:50.038619 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-ff0fbd52-0abc-4e71-9c04-4e8da87d0ddd None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 19 10:13:50.038619 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:13:50.038619 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:13:50.038619 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:13:50.038619 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:13:50.038619 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:13:50.038619 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:13:50.038619 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:13:50.038619 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:13:50.038619 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:13:50.038619 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:13:50.038619 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:13:50.038619 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 10:13:50.038619 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 10:13:50.038619 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 10:13:50.038619 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 10:13:50.039547 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:13:50.039547 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:13:50.039547 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 10:13:50.039547 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 10:13:50.039547 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 10:13:50.039547 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 10:13:50.039547 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:13:50.039547 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:13:50.039547 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:13:50.039547 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:13:50.039547 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:13:50.039547 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Sep 19 10:13:50.039547 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:13:50.039547 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:13:50.039547 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:13:50.039547 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:13:50.039547 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:13:50.039547 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:13:50.040521 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:13:50.040521 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:13:50.040521 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 10:13:50.040521 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 10:13:50.040521 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 10:13:50.040521 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 10:13:50.040521 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 10:13:50.040521 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 10:13:50.040521 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 19 10:13:50.040521 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Sep 19 10:13:50.040521 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 281/572] 10.222.0.66 () {56 vars in 1093 bytes} [Mon Sep 19 10:13:49 2022] GET /identity/v3/users/nova => generated 82 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:13:50.041126 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0fbd52-0abc-4e71-9c04-4e8da87d0ddd None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:50.079195 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c5c36c-fdcd-41a6-abb8-ed7387e665d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:50.079833 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c5c36c-fdcd-41a6-abb8-ed7387e665d6 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:50.080114 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c5c36c-fdcd-41a6-abb8-ed7387e665d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:50.080514 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c5c36c-fdcd-41a6-abb8-ed7387e665d6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:50.082873 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:50.093061 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c5c36c-fdcd-41a6-abb8-ed7387e665d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 10:13:50.098909 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-79c5c36c-fdcd-41a6-abb8-ed7387e665d6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 10:13:50.098909 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:13:50.098909 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:13:50.098909 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:13:50.098909 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:13:50.098909 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:13:50.098909 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:13:50.098909 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:13:50.098909 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:13:50.098909 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:13:50.098909 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:13:50.098909 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:13:50.098909 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 10:13:50.098909 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 10:13:50.098909 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 10:13:50.098909 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 10:13:50.099913 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 10:13:50.099913 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 10:13:50.099913 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 10:13:50.099913 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 10:13:50.099913 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:13:50.099913 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:13:50.099913 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:13:50.099913 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:13:50.099913 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:13:50.099913 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:13:50.099913 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:13:50.099913 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 19 10:13:50.099913 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:13:50.099913 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:13:50.099913 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:13:50.099913 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:13:50.100808 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:13:50.100808 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:13:50.100808 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:13:50.100808 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:13:50.100808 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 10:13:50.100808 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 10:13:50.100808 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 10:13:50.100808 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 10:13:50.100808 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 10:13:50.100808 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 10:13:50.100808 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 10:13:50.100808 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 19 10:13:50.100808 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 292/573] 10.222.0.66 () {56 vars in 1102 bytes} [Mon Sep 19 10:13:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:13:50.101482 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c5c36c-fdcd-41a6-abb8-ed7387e665d6 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:50.158631 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0fbd52-0abc-4e71-9c04-4e8da87d0ddd None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:50.190252 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:50.195424 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5872ff-a182-46df-a35f-f1f814af340c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:50.196068 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5872ff-a182-46df-a35f-f1f814af340c None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:50.196379 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5872ff-a182-46df-a35f-f1f814af340c None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:50.196659 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5872ff-a182-46df-a35f-f1f814af340c None admin] PATH_INFO: `/v3/users/glance` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:50.204447 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5872ff-a182-46df-a35f-f1f814af340c None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:50.205908 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5872ff-a182-46df-a35f-f1f814af340c None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:50.213948 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c5c36c-fdcd-41a6-abb8-ed7387e665d6 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:50.217788 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-2a5872ff-a182-46df-a35f-f1f814af340c None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 19 10:13:50.217788 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:13:50.217788 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:13:50.217788 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:13:50.217788 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:13:50.217788 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:13:50.217788 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:13:50.217788 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:13:50.217788 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:13:50.217788 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:13:50.217788 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:13:50.217788 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:13:50.217788 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 10:13:50.217788 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 10:13:50.217788 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 10:13:50.217788 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 10:13:50.218710 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:13:50.218710 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:13:50.218710 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 10:13:50.218710 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 10:13:50.218710 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 10:13:50.218710 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 10:13:50.218710 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:13:50.218710 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:13:50.218710 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:13:50.218710 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:13:50.218710 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:13:50.218710 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Sep 19 10:13:50.218710 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:13:50.218710 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:13:50.218710 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:13:50.218710 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:13:50.218710 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:13:50.218710 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:13:50.225461 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:13:50.225461 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:13:50.225461 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 10:13:50.225461 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 10:13:50.225461 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 10:13:50.225461 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 10:13:50.225461 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 10:13:50.225461 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 10:13:50.225461 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 19 10:13:50.225461 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Sep 19 10:13:50.225461 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 282/574] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Sep 19 10:13:50 2022] GET /identity/v3/users/glance => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:13:50.225461 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5872ff-a182-46df-a35f-f1f814af340c None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:50.260910 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13825a3d-1b71-4b51-b461-7f67fc4e950c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:50.261633 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13825a3d-1b71-4b51-b461-7f67fc4e950c None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:50.262038 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13825a3d-1b71-4b51-b461-7f67fc4e950c None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:50.262260 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13825a3d-1b71-4b51-b461-7f67fc4e950c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:50.274027 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13825a3d-1b71-4b51-b461-7f67fc4e950c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 10:13:50.278820 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-13825a3d-1b71-4b51-b461-7f67fc4e950c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 10:13:50.278820 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:13:50.278820 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:13:50.278820 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:13:50.278820 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:13:50.278820 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:13:50.278820 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:13:50.278820 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:13:50.278820 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:13:50.278820 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:13:50.278820 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:13:50.278820 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:13:50.278820 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 10:13:50.278820 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 10:13:50.278820 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 10:13:50.278820 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 10:13:50.280075 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 10:13:50.280075 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 10:13:50.280075 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 10:13:50.280075 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 10:13:50.280075 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:13:50.280075 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:13:50.280075 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:13:50.280075 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:13:50.280075 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:13:50.280075 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:13:50.280075 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:13:50.280075 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 19 10:13:50.280075 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:13:50.280075 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:13:50.280075 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:13:50.280075 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:13:50.281316 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:13:50.281316 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:13:50.281316 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:13:50.281316 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:13:50.281316 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 10:13:50.281316 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 10:13:50.281316 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 10:13:50.281316 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 10:13:50.281316 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 10:13:50.281316 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 10:13:50.281316 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 10:13:50.281316 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 19 10:13:50.284808 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 293/575] 10.222.0.66 () {56 vars in 1102 bytes} [Mon Sep 19 10:13:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:13:50.285686 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13825a3d-1b71-4b51-b461-7f67fc4e950c None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:50.328377 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:50.336018 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5872ff-a182-46df-a35f-f1f814af340c None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:50.370196 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b06237-b88a-4945-a022-212c8cdcfb4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:50.370962 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b06237-b88a-4945-a022-212c8cdcfb4a None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:50.371334 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b06237-b88a-4945-a022-212c8cdcfb4a None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:50.371724 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b06237-b88a-4945-a022-212c8cdcfb4a None admin] PATH_INFO: `/v3/users` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:50.372578 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b06237-b88a-4945-a022-212c8cdcfb4a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:13:50.372983 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b06237-b88a-4945-a022-212c8cdcfb4a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:50.374517 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b06237-b88a-4945-a022-212c8cdcfb4a None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:50.392259 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 283/576] 10.222.0.66 () {56 vars in 1133 bytes} [Mon Sep 19 10:13:50 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:13:50.393120 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b06237-b88a-4945-a022-212c8cdcfb4a None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:50.403544 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13825a3d-1b71-4b51-b461-7f67fc4e950c None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:50.446544 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04191e5-487d-4a1d-83aa-9f55bc315e60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:50.447500 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04191e5-487d-4a1d-83aa-9f55bc315e60 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:50.448740 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04191e5-487d-4a1d-83aa-9f55bc315e60 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:50.448740 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04191e5-487d-4a1d-83aa-9f55bc315e60 None admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:50.448944 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04191e5-487d-4a1d-83aa-9f55bc315e60 None admin] RBAC: Adding query filter params (name=service) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:13:50.449244 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04191e5-487d-4a1d-83aa-9f55bc315e60 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:50.450695 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04191e5-487d-4a1d-83aa-9f55bc315e60 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:50.455942 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:50.460261 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 294/577] 10.222.0.66 () {56 vars in 1103 bytes} [Mon Sep 19 10:13:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:13:50.461482 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04191e5-487d-4a1d-83aa-9f55bc315e60 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:50.505512 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b06237-b88a-4945-a022-212c8cdcfb4a None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:50.544941 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589f8d8b-9fee-445d-9bbb-4f5489e9dc50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:50.545600 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589f8d8b-9fee-445d-9bbb-4f5489e9dc50 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:50.546038 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589f8d8b-9fee-445d-9bbb-4f5489e9dc50 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:50.546152 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589f8d8b-9fee-445d-9bbb-4f5489e9dc50 None admin] PATH_INFO: `/v3/users` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:50.546807 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589f8d8b-9fee-445d-9bbb-4f5489e9dc50 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:13:50.547111 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589f8d8b-9fee-445d-9bbb-4f5489e9dc50 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:50.548611 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589f8d8b-9fee-445d-9bbb-4f5489e9dc50 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:50.567923 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 284/578] 10.222.0.66 () {56 vars in 1137 bytes} [Mon Sep 19 10:13:50 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:13:50.568789 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589f8d8b-9fee-445d-9bbb-4f5489e9dc50 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:50.575133 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04191e5-487d-4a1d-83aa-9f55bc315e60 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:50.587739 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:50.613159 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fff582-2f2c-4492-b201-9de627466032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:50.613990 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fff582-2f2c-4492-b201-9de627466032 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:50.614364 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fff582-2f2c-4492-b201-9de627466032 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:50.614733 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fff582-2f2c-4492-b201-9de627466032 None admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:50.615872 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fff582-2f2c-4492-b201-9de627466032 None admin] RBAC: Adding query filter params (name=service) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:13:50.615872 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fff582-2f2c-4492-b201-9de627466032 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:50.617350 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fff582-2f2c-4492-b201-9de627466032 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:50.631199 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 295/579] 10.222.0.66 () {56 vars in 1103 bytes} [Mon Sep 19 10:13:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:13:50.631199 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fff582-2f2c-4492-b201-9de627466032 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:50.694142 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589f8d8b-9fee-445d-9bbb-4f5489e9dc50 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:50.700363 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:50.732940 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927f2e20-d1d6-453e-9a10-799d5b81b04c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:50.733849 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927f2e20-d1d6-453e-9a10-799d5b81b04c None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:50.734394 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927f2e20-d1d6-453e-9a10-799d5b81b04c None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:50.734823 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927f2e20-d1d6-453e-9a10-799d5b81b04c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:50.741534 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fff582-2f2c-4492-b201-9de627466032 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:50.749317 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927f2e20-d1d6-453e-9a10-799d5b81b04c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:50.750839 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927f2e20-d1d6-453e-9a10-799d5b81b04c None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:50.767522 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-927f2e20-d1d6-453e-9a10-799d5b81b04c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 10:13:50.767522 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:13:50.767522 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:13:50.767522 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:13:50.767522 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:13:50.767522 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:13:50.767522 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:13:50.767522 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:13:50.767522 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:13:50.767522 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:13:50.767522 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:13:50.767522 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:13:50.767522 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 10:13:50.767522 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 10:13:50.767522 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 10:13:50.767522 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 10:13:50.768615 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:13:50.768615 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:13:50.768615 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:13:50.768615 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:13:50.768615 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:13:50.768615 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:13:50.768615 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:13:50.768615 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Sep 19 10:13:50.768615 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:13:50.768615 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:13:50.768615 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:13:50.768615 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:13:50.768615 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:13:50.768615 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:13:50.768615 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:13:50.768615 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:13:50.768615 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 10:13:50.769510 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 10:13:50.769510 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 10:13:50.769510 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Sep 19 10:13:50.769510 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 285/580] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 19 10:13:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:13:50.769510 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927f2e20-d1d6-453e-9a10-799d5b81b04c None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:50.784663 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5439dd0a-171d-4d46-938e-b50876e57c0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:50.785603 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5439dd0a-171d-4d46-938e-b50876e57c0a None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:50.786475 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5439dd0a-171d-4d46-938e-b50876e57c0a None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:50.787187 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5439dd0a-171d-4d46-938e-b50876e57c0a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:50.799143 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5439dd0a-171d-4d46-938e-b50876e57c0a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:50.800963 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5439dd0a-171d-4d46-938e-b50876e57c0a None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:50.816028 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-5439dd0a-171d-4d46-938e-b50876e57c0a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 10:13:50.816028 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:13:50.816028 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:13:50.816028 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:13:50.816028 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:13:50.816028 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:13:50.816028 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:13:50.816028 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:13:50.816028 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:13:50.816028 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:13:50.816028 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:13:50.816028 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:13:50.816028 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 10:13:50.816028 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 10:13:50.816028 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 10:13:50.816028 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 10:13:50.817798 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:13:50.817798 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:13:50.817798 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:13:50.817798 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:13:50.817798 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:13:50.817798 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:13:50.817798 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:13:50.817798 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 19 10:13:50.817798 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:13:50.817798 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:13:50.817798 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:13:50.817798 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:13:50.817798 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:13:50.817798 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:13:50.817798 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:13:50.817798 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:13:50.817798 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 10:13:50.819068 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 10:13:50.819068 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 10:13:50.819068 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 19 10:13:50.822411 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 296/581] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 19 10:13:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:13:50.823030 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5439dd0a-171d-4d46-938e-b50876e57c0a None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:50.838481 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:50.877815 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927f2e20-d1d6-453e-9a10-799d5b81b04c None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:50.916010 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f2362b-da74-4072-97f8-793b6780b34f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:50.916834 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f2362b-da74-4072-97f8-793b6780b34f None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:50.917221 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f2362b-da74-4072-97f8-793b6780b34f None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:50.917592 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f2362b-da74-4072-97f8-793b6780b34f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:50.929246 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f2362b-da74-4072-97f8-793b6780b34f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:50.930946 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f2362b-da74-4072-97f8-793b6780b34f None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:50.933081 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5439dd0a-171d-4d46-938e-b50876e57c0a None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:50.945983 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-65f2362b-da74-4072-97f8-793b6780b34f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 10:13:50.945983 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:13:50.945983 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:13:50.945983 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:13:50.945983 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:13:50.945983 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:13:50.945983 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:13:50.945983 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:13:50.945983 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:13:50.945983 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:13:50.945983 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:13:50.945983 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:13:50.945983 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 10:13:50.945983 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 10:13:50.945983 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 10:13:50.945983 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 10:13:50.947121 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:13:50.947121 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:13:50.947121 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:13:50.947121 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:13:50.947121 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:13:50.947121 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:13:50.947121 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:13:50.947121 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Sep 19 10:13:50.947121 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:13:50.947121 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:13:50.947121 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:13:50.947121 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:13:50.947121 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:13:50.947121 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:13:50.947121 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:13:50.947121 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:13:50.947121 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 10:13:50.955913 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 10:13:50.955913 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 10:13:50.955913 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Sep 19 10:13:50.955913 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 286/582] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 19 10:13:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:13:50.955913 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f2362b-da74-4072-97f8-793b6780b34f None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:50.959147 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:50.988008 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d53abab-b629-4bcd-90a8-dbd600307c77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:50.989448 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d53abab-b629-4bcd-90a8-dbd600307c77 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:50.989860 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d53abab-b629-4bcd-90a8-dbd600307c77 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:50.990251 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d53abab-b629-4bcd-90a8-dbd600307c77 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:51.003304 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d53abab-b629-4bcd-90a8-dbd600307c77 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:51.005960 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d53abab-b629-4bcd-90a8-dbd600307c77 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:51.020254 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-9d53abab-b629-4bcd-90a8-dbd600307c77 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 10:13:51.020254 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:13:51.020254 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:13:51.020254 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:13:51.020254 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:13:51.020254 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:13:51.020254 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:13:51.020254 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:13:51.020254 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:13:51.020254 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:13:51.020254 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:13:51.020254 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:13:51.020254 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 10:13:51.020254 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 10:13:51.020254 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 10:13:51.020254 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 10:13:51.021213 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:13:51.021213 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:13:51.021213 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:13:51.021213 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:13:51.021213 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:13:51.021213 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:13:51.021213 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:13:51.021213 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 19 10:13:51.021213 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:13:51.021213 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:13:51.021213 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:13:51.021213 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:13:51.021213 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:13:51.021213 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:13:51.021213 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:13:51.021213 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:13:51.021213 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 10:13:51.022072 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 10:13:51.022072 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 10:13:51.022072 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 19 10:13:51.022072 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 297/583] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 19 10:13:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:13:51.022777 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d53abab-b629-4bcd-90a8-dbd600307c77 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:51.072282 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f2362b-da74-4072-97f8-793b6780b34f None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:51.088264 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:51.110208 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b8a95b-ac59-4918-9c79-8b401b414dbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:51.110820 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b8a95b-ac59-4918-9c79-8b401b414dbf None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:51.111141 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b8a95b-ac59-4918-9c79-8b401b414dbf None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:51.111375 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b8a95b-ac59-4918-9c79-8b401b414dbf None admin] PATH_INFO: `/v3/domains` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:51.112024 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b8a95b-ac59-4918-9c79-8b401b414dbf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:13:51.112358 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b8a95b-ac59-4918-9c79-8b401b414dbf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:51.114254 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b8a95b-ac59-4918-9c79-8b401b414dbf None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:51.127050 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 287/584] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Sep 19 10:13:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:13:51.127887 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b8a95b-ac59-4918-9c79-8b401b414dbf None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:51.128699 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d53abab-b629-4bcd-90a8-dbd600307c77 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:51.166338 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9377b214-a189-46a4-bf5b-4306e57e4548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:51.166942 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9377b214-a189-46a4-bf5b-4306e57e4548 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:51.167221 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9377b214-a189-46a4-bf5b-4306e57e4548 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:51.167559 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9377b214-a189-46a4-bf5b-4306e57e4548 None admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:51.168277 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9377b214-a189-46a4-bf5b-4306e57e4548 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:13:51.168592 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9377b214-a189-46a4-bf5b-4306e57e4548 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:51.170243 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9377b214-a189-46a4-bf5b-4306e57e4548 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:51.182470 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 298/585] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Sep 19 10:13:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:13:51.183350 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9377b214-a189-46a4-bf5b-4306e57e4548 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:51.218749 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:51.241606 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b8a95b-ac59-4918-9c79-8b401b414dbf None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:51.277248 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2417e1-74a7-4986-b15d-8af31f567d90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:51.277859 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2417e1-74a7-4986-b15d-8af31f567d90 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:51.278262 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2417e1-74a7-4986-b15d-8af31f567d90 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:51.278475 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2417e1-74a7-4986-b15d-8af31f567d90 None admin] PATH_INFO: `/v3/domains` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:51.279167 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2417e1-74a7-4986-b15d-8af31f567d90 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:13:51.279503 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2417e1-74a7-4986-b15d-8af31f567d90 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:51.281044 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2417e1-74a7-4986-b15d-8af31f567d90 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:51.293525 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 288/586] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Sep 19 10:13:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:13:51.294597 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2417e1-74a7-4986-b15d-8af31f567d90 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:51.302230 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9377b214-a189-46a4-bf5b-4306e57e4548 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:51.332422 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:51.340467 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3000cbc1-c117-4c97-b8e2-6b3eb3458dcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:51.341075 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3000cbc1-c117-4c97-b8e2-6b3eb3458dcf None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:51.341354 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3000cbc1-c117-4c97-b8e2-6b3eb3458dcf None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:51.341627 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3000cbc1-c117-4c97-b8e2-6b3eb3458dcf None admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:51.342379 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3000cbc1-c117-4c97-b8e2-6b3eb3458dcf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:13:51.342671 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3000cbc1-c117-4c97-b8e2-6b3eb3458dcf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:51.344040 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3000cbc1-c117-4c97-b8e2-6b3eb3458dcf None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:51.362380 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 299/587] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Sep 19 10:13:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:13:51.362380 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3000cbc1-c117-4c97-b8e2-6b3eb3458dcf None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:51.409153 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2417e1-74a7-4986-b15d-8af31f567d90 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:51.444976 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb7e0d9-0996-4242-b20b-db859d992c5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:51.445611 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb7e0d9-0996-4242-b20b-db859d992c5d None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:51.445905 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb7e0d9-0996-4242-b20b-db859d992c5d None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:51.446183 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb7e0d9-0996-4242-b20b-db859d992c5d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:51.453725 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb7e0d9-0996-4242-b20b-db859d992c5d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:51.454831 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:51.455183 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb7e0d9-0996-4242-b20b-db859d992c5d None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:51.468371 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-dcb7e0d9-0996-4242-b20b-db859d992c5d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 10:13:51.468371 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:13:51.468371 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:13:51.468371 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:13:51.468371 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:13:51.468371 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:13:51.468371 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:13:51.468371 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:13:51.468371 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:13:51.468371 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:13:51.468371 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:13:51.468371 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:13:51.468371 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 10:13:51.468371 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 10:13:51.468371 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 10:13:51.469306 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 10:13:51.469306 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:13:51.469306 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:13:51.469306 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:13:51.469306 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:13:51.469306 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:13:51.469306 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:13:51.469306 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:13:51.469306 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Sep 19 10:13:51.469306 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:13:51.469306 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:13:51.469306 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:13:51.469306 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:13:51.469306 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:13:51.469306 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:13:51.469306 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:13:51.469306 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:13:51.470180 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 10:13:51.470180 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 10:13:51.470180 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 10:13:51.470180 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 10:13:51.470180 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 10:13:51.470180 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 10:13:51.470180 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 10:13:51.470180 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Sep 19 10:13:51.470180 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 289/588] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Sep 19 10:13:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:13:51.470693 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb7e0d9-0996-4242-b20b-db859d992c5d None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:51.474436 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3000cbc1-c117-4c97-b8e2-6b3eb3458dcf None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:51.511673 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e079f2-4032-4e2a-a4a6-e37d9a87caee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:51.512646 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e079f2-4032-4e2a-a4a6-e37d9a87caee None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:51.512979 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e079f2-4032-4e2a-a4a6-e37d9a87caee None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:51.513232 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e079f2-4032-4e2a-a4a6-e37d9a87caee None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:51.521988 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e079f2-4032-4e2a-a4a6-e37d9a87caee None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:51.523457 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e079f2-4032-4e2a-a4a6-e37d9a87caee None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:51.536506 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-17e079f2-4032-4e2a-a4a6-e37d9a87caee None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 19 10:13:51.536506 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:13:51.536506 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:13:51.536506 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:13:51.536506 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:13:51.536506 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:13:51.536506 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:13:51.536506 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:13:51.536506 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:13:51.536506 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:13:51.536506 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:13:51.536506 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:13:51.536506 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 10:13:51.536506 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 10:13:51.536506 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 10:13:51.536506 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 10:13:51.537514 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:13:51.537514 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:13:51.537514 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 10:13:51.537514 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 10:13:51.537514 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 10:13:51.537514 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 10:13:51.537514 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:13:51.537514 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:13:51.537514 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:13:51.537514 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:13:51.537514 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:13:51.537514 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 19 10:13:51.537514 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:13:51.537514 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:13:51.537514 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:13:51.537514 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:13:51.537514 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:13:51.537514 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:13:51.538560 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:13:51.538560 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:13:51.538560 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 10:13:51.538560 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 10:13:51.538560 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 10:13:51.538560 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 10:13:51.538560 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 10:13:51.538560 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 10:13:51.538560 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 19 10:13:51.538560 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 19 10:13:51.538560 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 300/589] 10.222.0.66 () {56 vars in 1102 bytes} [Mon Sep 19 10:13:51 2022] GET /identity/v3/users/neutron => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:13:51.538560 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e079f2-4032-4e2a-a4a6-e37d9a87caee None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:51.593216 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:51.602180 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb7e0d9-0996-4242-b20b-db859d992c5d None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:51.639715 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe2b909-1c7c-4d1e-8d7a-9e98fe5e9409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:51.640385 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe2b909-1c7c-4d1e-8d7a-9e98fe5e9409 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:51.640664 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe2b909-1c7c-4d1e-8d7a-9e98fe5e9409 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:51.640936 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe2b909-1c7c-4d1e-8d7a-9e98fe5e9409 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:51.648371 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe2b909-1c7c-4d1e-8d7a-9e98fe5e9409 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:51.649826 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe2b909-1c7c-4d1e-8d7a-9e98fe5e9409 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:51.655164 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e079f2-4032-4e2a-a4a6-e37d9a87caee None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:51.661907 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-7fe2b909-1c7c-4d1e-8d7a-9e98fe5e9409 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 10:13:51.661907 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:13:51.661907 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:13:51.661907 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:13:51.661907 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:13:51.661907 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:13:51.661907 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:13:51.661907 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:13:51.661907 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:13:51.661907 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:13:51.661907 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:13:51.661907 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:13:51.661907 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 10:13:51.661907 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 10:13:51.661907 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 10:13:51.662818 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 10:13:51.662818 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:13:51.662818 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:13:51.662818 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:13:51.662818 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:13:51.662818 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:13:51.662818 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:13:51.662818 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:13:51.662818 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Sep 19 10:13:51.662818 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:13:51.662818 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:13:51.662818 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:13:51.662818 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:13:51.662818 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:13:51.662818 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:13:51.662818 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:13:51.662818 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:13:51.663682 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 10:13:51.663682 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 10:13:51.663682 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 10:13:51.663682 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 10:13:51.663682 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 10:13:51.663682 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 10:13:51.663682 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 10:13:51.663682 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Sep 19 10:13:51.663682 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 290/590] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Sep 19 10:13:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:13:51.665096 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe2b909-1c7c-4d1e-8d7a-9e98fe5e9409 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:51.693264 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156b8043-720c-4057-8a0e-ed0f264c77e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:51.694238 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156b8043-720c-4057-8a0e-ed0f264c77e0 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:51.694238 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156b8043-720c-4057-8a0e-ed0f264c77e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:51.694435 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156b8043-720c-4057-8a0e-ed0f264c77e0 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:51.702108 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156b8043-720c-4057-8a0e-ed0f264c77e0 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:51.703547 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156b8043-720c-4057-8a0e-ed0f264c77e0 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:51.715348 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-156b8043-720c-4057-8a0e-ed0f264c77e0 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 19 10:13:51.715348 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:13:51.715348 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:13:51.715348 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:13:51.715348 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:13:51.715348 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:13:51.715348 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:13:51.715348 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:13:51.715348 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:13:51.715348 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:13:51.715348 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:13:51.715348 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:13:51.715348 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 10:13:51.715348 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 10:13:51.715348 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 10:13:51.715348 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 10:13:51.716524 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:13:51.716524 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:13:51.716524 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 10:13:51.716524 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 10:13:51.716524 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 10:13:51.716524 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 10:13:51.716524 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:13:51.716524 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:13:51.716524 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:13:51.716524 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:13:51.716524 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:13:51.716524 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 19 10:13:51.716524 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:13:51.716524 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:13:51.716524 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:13:51.716524 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:13:51.716524 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:13:51.716524 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:13:51.717452 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:13:51.717452 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:13:51.717452 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 10:13:51.717452 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 10:13:51.717452 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 10:13:51.717452 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 10:13:51.717452 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 10:13:51.717452 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 10:13:51.717452 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 19 10:13:51.717452 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 19 10:13:51.717452 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 301/591] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Sep 19 10:13:51 2022] GET /identity/v3/users/cinder => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:13:51.717452 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156b8043-720c-4057-8a0e-ed0f264c77e0 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:51.727560 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:51.791309 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe2b909-1c7c-4d1e-8d7a-9e98fe5e9409 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:51.827401 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156b8043-720c-4057-8a0e-ed0f264c77e0 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:51.827716 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a57f58-58c4-4fc1-883a-aa73b4914cea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:51.828360 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a57f58-58c4-4fc1-883a-aa73b4914cea None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:51.828644 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a57f58-58c4-4fc1-883a-aa73b4914cea None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:51.828923 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a57f58-58c4-4fc1-883a-aa73b4914cea None admin] PATH_INFO: `/v3/projects` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:51.829634 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a57f58-58c4-4fc1-883a-aa73b4914cea None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:13:51.829944 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a57f58-58c4-4fc1-883a-aa73b4914cea None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:51.831379 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a57f58-58c4-4fc1-883a-aa73b4914cea None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:51.849789 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 291/592] 10.222.0.66 () {56 vars in 1148 bytes} [Mon Sep 19 10:13:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:13:51.849789 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a57f58-58c4-4fc1-883a-aa73b4914cea None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:51.865804 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:51.875153 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b1839d-ed0f-4725-8d3a-90f8fa61cb3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:51.875868 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b1839d-ed0f-4725-8d3a-90f8fa61cb3f None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:51.876243 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b1839d-ed0f-4725-8d3a-90f8fa61cb3f None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:51.876612 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b1839d-ed0f-4725-8d3a-90f8fa61cb3f None admin] PATH_INFO: `/v3/users` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:51.877378 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b1839d-ed0f-4725-8d3a-90f8fa61cb3f None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:13:51.877645 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b1839d-ed0f-4725-8d3a-90f8fa61cb3f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:51.879085 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b1839d-ed0f-4725-8d3a-90f8fa61cb3f None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:51.914868 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 302/593] 10.222.0.66 () {56 vars in 1139 bytes} [Mon Sep 19 10:13:51 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:13:51.914868 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b1839d-ed0f-4725-8d3a-90f8fa61cb3f None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:51.983016 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a57f58-58c4-4fc1-883a-aa73b4914cea None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:51.988117 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:52.018961 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04729ede-949f-4d62-b64f-fc6f518df7e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:52.019571 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04729ede-949f-4d62-b64f-fc6f518df7e5 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:52.019852 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04729ede-949f-4d62-b64f-fc6f518df7e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:52.020719 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04729ede-949f-4d62-b64f-fc6f518df7e5 None admin] PATH_INFO: `/v3/projects` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:52.021396 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04729ede-949f-4d62-b64f-fc6f518df7e5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:13:52.021702 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04729ede-949f-4d62-b64f-fc6f518df7e5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:52.023158 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04729ede-949f-4d62-b64f-fc6f518df7e5 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:52.031975 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b1839d-ed0f-4725-8d3a-90f8fa61cb3f None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:52.036443 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 292/594] 10.222.0.66 () {56 vars in 1148 bytes} [Mon Sep 19 10:13:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:13:52.036443 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04729ede-949f-4d62-b64f-fc6f518df7e5 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:52.073609 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfb9782-0817-449a-9335-dd22033495dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:52.074213 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfb9782-0817-449a-9335-dd22033495dd None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:52.074590 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfb9782-0817-449a-9335-dd22033495dd None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:52.074739 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfb9782-0817-449a-9335-dd22033495dd None admin] PATH_INFO: `/v3/users` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:52.075455 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfb9782-0817-449a-9335-dd22033495dd None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:13:52.075755 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfb9782-0817-449a-9335-dd22033495dd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:52.077209 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfb9782-0817-449a-9335-dd22033495dd None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:52.094409 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 303/595] 10.222.0.66 () {56 vars in 1137 bytes} [Mon Sep 19 10:13:51 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:13:52.095202 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfb9782-0817-449a-9335-dd22033495dd None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:52.120526 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:52.145816 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04729ede-949f-4d62-b64f-fc6f518df7e5 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:52.181028 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f38994-4913-47a1-b668-a5de31420211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:52.181695 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f38994-4913-47a1-b668-a5de31420211 None admin] REQUEST_METHOD: `PUT` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:52.181982 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f38994-4913-47a1-b668-a5de31420211 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:52.182258 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f38994-4913-47a1-b668-a5de31420211 None admin] PATH_INFO: `/v3/projects/be6b93ef3359434d9c776343f0aea333/users/15c70bfb085a44e9b84942b480ff22f1/roles/75952bc2767d49c1a6e49840d8a8f349` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:52.193662 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfb9782-0817-449a-9335-dd22033495dd None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:52.197500 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f38994-4913-47a1-b668-a5de31420211 None admin] RBAC: Authorizing `identity:create_grant(project_id=be6b93ef3359434d9c776343f0aea333, user_id=15c70bfb085a44e9b84942b480ff22f1, role_id=75952bc2767d49c1a6e49840d8a8f349)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:52.198956 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f38994-4913-47a1-b668-a5de31420211 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:52.211705 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 293/596] 10.222.0.66 () {58 vars in 1439 bytes} [Mon Sep 19 10:13:52 2022] PUT /identity/v3/projects/be6b93ef3359434d9c776343f0aea333/users/15c70bfb085a44e9b84942b480ff22f1/roles/75952bc2767d49c1a6e49840d8a8f349 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:13:52.213030 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b4de16-1d7f-4346-88ec-e11e5f773252 None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:52.213318 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b4de16-1d7f-4346-88ec-e11e5f773252 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:52.213591 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b4de16-1d7f-4346-88ec-e11e5f773252 None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:52.215151 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 294/597] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:13:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:13:52.215885 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b4de16-1d7f-4346-88ec-e11e5f773252 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:52.223694 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:52.238537 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606add85-97e4-4e83-b642-44e9de148007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:52.239235 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606add85-97e4-4e83-b642-44e9de148007 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:52.239544 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606add85-97e4-4e83-b642-44e9de148007 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:52.239858 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606add85-97e4-4e83-b642-44e9de148007 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:52.252112 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606add85-97e4-4e83-b642-44e9de148007 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:52.253472 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606add85-97e4-4e83-b642-44e9de148007 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:52.272142 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-606add85-97e4-4e83-b642-44e9de148007 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 10:13:52.272142 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:13:52.272142 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:13:52.272142 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:13:52.272142 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:13:52.272142 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:13:52.272142 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:13:52.272142 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:13:52.272142 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:13:52.272142 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:13:52.272142 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:13:52.272142 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:13:52.272142 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 10:13:52.272142 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 10:13:52.272142 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 10:13:52.272142 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 10:13:52.273209 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:13:52.273209 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:13:52.273209 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:13:52.273209 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:13:52.273209 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:13:52.273209 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:13:52.273209 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:13:52.273209 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 19 10:13:52.273209 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:13:52.273209 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:13:52.273209 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:13:52.273209 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:13:52.273209 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:13:52.273209 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:13:52.273209 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:13:52.273209 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:13:52.273209 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 10:13:52.274838 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 10:13:52.274838 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 10:13:52.274838 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 19 10:13:52.274838 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 304/598] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 19 10:13:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:13:52.274838 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606add85-97e4-4e83-b642-44e9de148007 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:52.361403 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b4de16-1d7f-4346-88ec-e11e5f773252 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:52.392092 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:52.392953 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606add85-97e4-4e83-b642-44e9de148007 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:52.409066 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d4521e-de93-469d-8328-4b51c38c054a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:52.409740 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d4521e-de93-469d-8328-4b51c38c054a None admin] REQUEST_METHOD: `PUT` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:52.410026 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d4521e-de93-469d-8328-4b51c38c054a None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:52.410301 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d4521e-de93-469d-8328-4b51c38c054a None admin] PATH_INFO: `/v3/projects/be6b93ef3359434d9c776343f0aea333/users/2f95c0d9f2414f3ca2fa2d1546d47f1b/roles/75952bc2767d49c1a6e49840d8a8f349` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:52.425866 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d4521e-de93-469d-8328-4b51c38c054a None admin] RBAC: Authorizing `identity:create_grant(project_id=be6b93ef3359434d9c776343f0aea333, user_id=2f95c0d9f2414f3ca2fa2d1546d47f1b, role_id=75952bc2767d49c1a6e49840d8a8f349)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:52.427878 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d4521e-de93-469d-8328-4b51c38c054a None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:52.433930 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923771a7-547a-4b26-ab99-e160fa2732d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:52.434487 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923771a7-547a-4b26-ab99-e160fa2732d3 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:52.434761 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923771a7-547a-4b26-ab99-e160fa2732d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:52.435048 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923771a7-547a-4b26-ab99-e160fa2732d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:52.444278 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 295/599] 10.222.0.66 () {58 vars in 1439 bytes} [Mon Sep 19 10:13:52 2022] PUT /identity/v3/projects/be6b93ef3359434d9c776343f0aea333/users/2f95c0d9f2414f3ca2fa2d1546d47f1b/roles/75952bc2767d49c1a6e49840d8a8f349 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:13:52.448221 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e718f881-1580-4fb2-8868-9fc96e115c66 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:52.448221 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e718f881-1580-4fb2-8868-9fc96e115c66 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:52.448221 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e718f881-1580-4fb2-8868-9fc96e115c66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:52.451249 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923771a7-547a-4b26-ab99-e160fa2732d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:52.452887 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923771a7-547a-4b26-ab99-e160fa2732d3 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:52.474030 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-923771a7-547a-4b26-ab99-e160fa2732d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 10:13:52.474030 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:13:52.474030 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:13:52.474030 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:13:52.474030 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:13:52.474030 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:13:52.474030 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:13:52.474030 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:13:52.474030 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:13:52.474030 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:13:52.474030 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:13:52.474030 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:13:52.474030 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 10:13:52.474030 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 10:13:52.474030 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 10:13:52.474030 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 10:13:52.475314 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:13:52.475314 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:13:52.475314 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:13:52.475314 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:13:52.475314 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:13:52.475314 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:13:52.475314 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:13:52.475314 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 19 10:13:52.475314 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:13:52.475314 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:13:52.475314 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:13:52.475314 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:13:52.475314 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:13:52.475314 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:13:52.475314 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:13:52.475314 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:13:52.475314 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 10:13:52.476444 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 10:13:52.476444 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 10:13:52.476444 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 19 10:13:52.477075 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 305/600] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 19 10:13:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:13:52.478105 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923771a7-547a-4b26-ab99-e160fa2732d3 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:52.479869 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-e718f881-1580-4fb2-8868-9fc96e115c66 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:13:52.481609 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-e718f881-1580-4fb2-8868-9fc96e115c66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:13:52.509380 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:52.578110 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 296/601] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:13:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 10:13:52.579697 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e718f881-1580-4fb2-8868-9fc96e115c66 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:52.606287 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923771a7-547a-4b26-ab99-e160fa2732d3 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:52.678924 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43eecd7-a558-430d-afc4-edbb8fce79bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:52.679447 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43eecd7-a558-430d-afc4-edbb8fce79bf None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:52.679725 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43eecd7-a558-430d-afc4-edbb8fce79bf None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:52.679997 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43eecd7-a558-430d-afc4-edbb8fce79bf None admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:52.680710 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43eecd7-a558-430d-afc4-edbb8fce79bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:13:52.681011 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43eecd7-a558-430d-afc4-edbb8fce79bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:52.682779 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43eecd7-a558-430d-afc4-edbb8fce79bf None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:52.701535 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 306/602] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Sep 19 10:13:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:13:52.711036 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43eecd7-a558-430d-afc4-edbb8fce79bf None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:52.749529 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e718f881-1580-4fb2-8868-9fc96e115c66 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:52.762622 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:52.808594 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:52.825127 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43eecd7-a558-430d-afc4-edbb8fce79bf None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:52.833510 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98547128-c7dc-482c-9594-3c3f8411a364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:52.834135 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98547128-c7dc-482c-9594-3c3f8411a364 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:52.834412 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98547128-c7dc-482c-9594-3c3f8411a364 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:52.834683 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98547128-c7dc-482c-9594-3c3f8411a364 None admin] PATH_INFO: `/v3/domains` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:52.835334 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98547128-c7dc-482c-9594-3c3f8411a364 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:13:52.835634 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98547128-c7dc-482c-9594-3c3f8411a364 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:52.837049 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98547128-c7dc-482c-9594-3c3f8411a364 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:52.862423 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777cca3c-39a0-45e9-bc47-ec86a92f0fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:52.863073 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777cca3c-39a0-45e9-bc47-ec86a92f0fb7 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:52.863355 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777cca3c-39a0-45e9-bc47-ec86a92f0fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:52.863630 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777cca3c-39a0-45e9-bc47-ec86a92f0fb7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:52.870392 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 297/603] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Sep 19 10:13:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:13:52.875571 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777cca3c-39a0-45e9-bc47-ec86a92f0fb7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:52.877085 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777cca3c-39a0-45e9-bc47-ec86a92f0fb7 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:52.877231 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98547128-c7dc-482c-9594-3c3f8411a364 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:52.890115 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-777cca3c-39a0-45e9-bc47-ec86a92f0fb7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 10:13:52.890115 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:13:52.890115 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:13:52.890115 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:13:52.890115 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:13:52.890115 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:13:52.890115 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:13:52.890115 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:13:52.890115 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:13:52.890115 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:13:52.890115 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:13:52.890115 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:13:52.890115 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 10:13:52.890115 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 10:13:52.890115 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 10:13:52.891042 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 10:13:52.891042 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:13:52.891042 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:13:52.891042 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:13:52.891042 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:13:52.891042 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:13:52.891042 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:13:52.891042 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:13:52.891042 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 19 10:13:52.891042 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:13:52.891042 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:13:52.891042 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:13:52.891042 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:13:52.891042 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:13:52.891042 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:13:52.891042 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:13:52.891042 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:13:52.891916 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 10:13:52.891916 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 10:13:52.891916 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 10:13:52.891916 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 10:13:52.891916 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 10:13:52.891916 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 10:13:52.891916 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 10:13:52.891916 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 19 10:13:52.891916 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 307/604] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Sep 19 10:13:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:13:52.892460 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777cca3c-39a0-45e9-bc47-ec86a92f0fb7 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:53.002319 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98547128-c7dc-482c-9594-3c3f8411a364 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:53.015277 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777cca3c-39a0-45e9-bc47-ec86a92f0fb7 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:53.041486 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856bdcc8-0d0c-420a-8bf6-d95b8d6aa747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:53.042562 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856bdcc8-0d0c-420a-8bf6-d95b8d6aa747 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:53.043037 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856bdcc8-0d0c-420a-8bf6-d95b8d6aa747 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:53.043549 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856bdcc8-0d0c-420a-8bf6-d95b8d6aa747 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:53.053393 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856bdcc8-0d0c-420a-8bf6-d95b8d6aa747 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:53.055138 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856bdcc8-0d0c-420a-8bf6-d95b8d6aa747 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:53.056290 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5158c46-5fe1-4f24-b523-8f76cd508991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:53.056989 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5158c46-5fe1-4f24-b523-8f76cd508991 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:53.057273 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5158c46-5fe1-4f24-b523-8f76cd508991 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:53.057547 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5158c46-5fe1-4f24-b523-8f76cd508991 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:53.068797 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5158c46-5fe1-4f24-b523-8f76cd508991 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 10:13:53.069482 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-856bdcc8-0d0c-420a-8bf6-d95b8d6aa747 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 10:13:53.069482 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:13:53.069482 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:13:53.069482 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:13:53.069482 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:13:53.069482 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:13:53.069482 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:13:53.069482 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:13:53.069482 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:13:53.069482 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:13:53.069482 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:13:53.069482 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:13:53.069482 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 10:13:53.069482 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 10:13:53.069482 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 10:13:53.070347 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 10:13:53.070347 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:13:53.070347 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:13:53.070347 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:13:53.070347 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:13:53.070347 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:13:53.070347 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:13:53.070347 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:13:53.070347 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Sep 19 10:13:53.070347 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:13:53.070347 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:13:53.070347 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:13:53.070347 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:13:53.070347 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:13:53.070347 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:13:53.070347 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:13:53.070347 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:13:53.071221 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 10:13:53.071221 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 10:13:53.071221 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 10:13:53.071221 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 10:13:53.071221 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 10:13:53.071221 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 10:13:53.071221 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 10:13:53.071221 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Sep 19 10:13:53.073624 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 298/605] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Sep 19 10:13:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:13:53.074101 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-b5158c46-5fe1-4f24-b523-8f76cd508991 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 10:13:53.074101 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:13:53.074101 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:13:53.074101 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:13:53.074101 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:13:53.074101 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:13:53.074101 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:13:53.074101 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:13:53.074101 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:13:53.074101 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:13:53.074101 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:13:53.074101 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:13:53.074101 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 10:13:53.074101 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 10:13:53.074101 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 10:13:53.074101 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 10:13:53.074981 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 10:13:53.074981 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 10:13:53.074981 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 10:13:53.074981 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 10:13:53.074981 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:13:53.074981 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:13:53.074981 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:13:53.074981 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:13:53.074981 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:13:53.074981 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:13:53.074981 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:13:53.074981 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 19 10:13:53.074981 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:13:53.074981 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:13:53.074981 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:13:53.074981 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:13:53.075818 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:13:53.075818 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:13:53.075818 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:13:53.075818 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:13:53.075818 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 10:13:53.075818 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 10:13:53.075818 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 10:13:53.075818 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 10:13:53.075818 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 10:13:53.075818 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 10:13:53.075818 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 10:13:53.075818 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 19 10:13:53.077513 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856bdcc8-0d0c-420a-8bf6-d95b8d6aa747 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:53.084195 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 308/606] 10.222.0.66 () {56 vars in 1102 bytes} [Mon Sep 19 10:13:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:13:53.084195 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5158c46-5fe1-4f24-b523-8f76cd508991 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:53.091442 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:53.121523 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:53.198521 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5158c46-5fe1-4f24-b523-8f76cd508991 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:53.206094 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856bdcc8-0d0c-420a-8bf6-d95b8d6aa747 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:53.235826 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60de58e9-1209-419b-8cd8-912034a3e5e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:53.236794 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60de58e9-1209-419b-8cd8-912034a3e5e4 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:53.237276 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60de58e9-1209-419b-8cd8-912034a3e5e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:53.237744 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60de58e9-1209-419b-8cd8-912034a3e5e4 None admin] PATH_INFO: `/v3/projects` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:53.239355 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60de58e9-1209-419b-8cd8-912034a3e5e4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:13:53.239957 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60de58e9-1209-419b-8cd8-912034a3e5e4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:53.241609 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60de58e9-1209-419b-8cd8-912034a3e5e4 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:53.249290 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28df0ba-2e14-4e01-8f9a-26081d4a4319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:53.250117 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28df0ba-2e14-4e01-8f9a-26081d4a4319 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:53.250410 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28df0ba-2e14-4e01-8f9a-26081d4a4319 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:53.250763 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28df0ba-2e14-4e01-8f9a-26081d4a4319 None admin] PATH_INFO: `/v3/projects` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:53.251572 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28df0ba-2e14-4e01-8f9a-26081d4a4319 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:13:53.251989 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28df0ba-2e14-4e01-8f9a-26081d4a4319 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:53.253720 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28df0ba-2e14-4e01-8f9a-26081d4a4319 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:53.257374 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 309/607] 10.222.0.66 () {56 vars in 1148 bytes} [Mon Sep 19 10:13:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:13:53.258414 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60de58e9-1209-419b-8cd8-912034a3e5e4 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:53.274506 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 299/608] 10.222.0.66 () {56 vars in 1148 bytes} [Mon Sep 19 10:13:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:13:53.275566 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28df0ba-2e14-4e01-8f9a-26081d4a4319 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:53.331221 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:53.368802 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60de58e9-1209-419b-8cd8-912034a3e5e4 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:53.375713 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:53.394164 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28df0ba-2e14-4e01-8f9a-26081d4a4319 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:53.406622 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeb046a-373a-4b24-8c45-5f9bba41f8ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:53.407649 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeb046a-373a-4b24-8c45-5f9bba41f8ae None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:53.408150 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeb046a-373a-4b24-8c45-5f9bba41f8ae None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:53.408686 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeb046a-373a-4b24-8c45-5f9bba41f8ae None admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:53.409639 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feeb046a-373a-4b24-8c45-5f9bba41f8ae None admin] RBAC: Adding query filter params (name=service) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:13:53.410148 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feeb046a-373a-4b24-8c45-5f9bba41f8ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:53.412374 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feeb046a-373a-4b24-8c45-5f9bba41f8ae None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:53.421897 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 310/609] 10.222.0.66 () {56 vars in 1103 bytes} [Mon Sep 19 10:13:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:13:53.422955 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeb046a-373a-4b24-8c45-5f9bba41f8ae None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:53.433450 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b036ec7-8678-4a30-9dc3-f8e64480ac02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:53.434200 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b036ec7-8678-4a30-9dc3-f8e64480ac02 None admin] REQUEST_METHOD: `PUT` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:53.434482 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b036ec7-8678-4a30-9dc3-f8e64480ac02 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:53.434758 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b036ec7-8678-4a30-9dc3-f8e64480ac02 None admin] PATH_INFO: `/v3/projects/be6b93ef3359434d9c776343f0aea333/users/dfa4d004fd44482cae761c4b3bdfab31/roles/75952bc2767d49c1a6e49840d8a8f349` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:53.452516 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b036ec7-8678-4a30-9dc3-f8e64480ac02 None admin] RBAC: Authorizing `identity:create_grant(project_id=be6b93ef3359434d9c776343f0aea333, user_id=dfa4d004fd44482cae761c4b3bdfab31, role_id=75952bc2767d49c1a6e49840d8a8f349)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:53.454131 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b036ec7-8678-4a30-9dc3-f8e64480ac02 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:53.476248 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 300/610] 10.222.0.66 () {58 vars in 1439 bytes} [Mon Sep 19 10:13:53 2022] PUT /identity/v3/projects/be6b93ef3359434d9c776343f0aea333/users/dfa4d004fd44482cae761c4b3bdfab31/roles/75952bc2767d49c1a6e49840d8a8f349 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:13:53.477531 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b036ec7-8678-4a30-9dc3-f8e64480ac02 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:53.602711 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeb046a-373a-4b24-8c45-5f9bba41f8ae None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:53.656873 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:53.677479 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b253bb2e-ae79-46ef-82a6-662a059c99d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:53.678161 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b253bb2e-ae79-46ef-82a6-662a059c99d3 None admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:53.678436 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b253bb2e-ae79-46ef-82a6-662a059c99d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:53.678706 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b253bb2e-ae79-46ef-82a6-662a059c99d3 None admin] PATH_INFO: `/v3/projects/be6b93ef3359434d9c776343f0aea333/users/0c1289b015854c6bb6aee8fed6b807db/roles/75952bc2767d49c1a6e49840d8a8f349` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:53.682820 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b036ec7-8678-4a30-9dc3-f8e64480ac02 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:53.704603 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b253bb2e-ae79-46ef-82a6-662a059c99d3 None admin] RBAC: Authorizing `identity:create_grant(project_id=be6b93ef3359434d9c776343f0aea333, user_id=0c1289b015854c6bb6aee8fed6b807db, role_id=75952bc2767d49c1a6e49840d8a8f349)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:53.706354 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b253bb2e-ae79-46ef-82a6-662a059c99d3 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:53.723831 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 311/611] 10.222.0.66 () {58 vars in 1439 bytes} [Mon Sep 19 10:13:53 2022] PUT /identity/v3/projects/be6b93ef3359434d9c776343f0aea333/users/0c1289b015854c6bb6aee8fed6b807db/roles/75952bc2767d49c1a6e49840d8a8f349 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:13:53.731205 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0448e61d-7446-4ffa-8cc0-472c29ffef11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:53.732129 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0448e61d-7446-4ffa-8cc0-472c29ffef11 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:53.732609 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0448e61d-7446-4ffa-8cc0-472c29ffef11 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:53.733034 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0448e61d-7446-4ffa-8cc0-472c29ffef11 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:53.741615 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:53.751192 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0448e61d-7446-4ffa-8cc0-472c29ffef11 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:53.756323 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0448e61d-7446-4ffa-8cc0-472c29ffef11 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:53.774390 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-0448e61d-7446-4ffa-8cc0-472c29ffef11 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 10:13:53.774390 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:13:53.774390 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:13:53.774390 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:13:53.774390 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:13:53.774390 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:13:53.774390 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:13:53.774390 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:13:53.774390 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:13:53.774390 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:13:53.774390 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:13:53.774390 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:13:53.774390 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 10:13:53.774390 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 10:13:53.774390 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 10:13:53.774390 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 10:13:53.775416 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:13:53.775416 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:13:53.775416 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:13:53.775416 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:13:53.775416 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:13:53.775416 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:13:53.775416 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:13:53.775416 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Sep 19 10:13:53.775416 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:13:53.775416 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:13:53.775416 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:13:53.775416 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:13:53.775416 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:13:53.775416 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:13:53.775416 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:13:53.775416 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:13:53.775416 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 10:13:53.776323 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 10:13:53.776323 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 10:13:53.776323 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Sep 19 10:13:53.778393 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 301/612] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 19 10:13:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:13:53.784592 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b253bb2e-ae79-46ef-82a6-662a059c99d3 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:53.910873 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b253bb2e-ae79-46ef-82a6-662a059c99d3 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:53.955968 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6d1850-58b1-40b9-86db-3ffb6d1038e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:53.956865 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6d1850-58b1-40b9-86db-3ffb6d1038e8 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:53.957314 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6d1850-58b1-40b9-86db-3ffb6d1038e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:53.957759 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6d1850-58b1-40b9-86db-3ffb6d1038e8 None admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:53.958561 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6d1850-58b1-40b9-86db-3ffb6d1038e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:13:53.959034 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6d1850-58b1-40b9-86db-3ffb6d1038e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:53.960681 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6d1850-58b1-40b9-86db-3ffb6d1038e8 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:53.976258 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 312/613] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Sep 19 10:13:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:13:53.982000 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0448e61d-7446-4ffa-8cc0-472c29ffef11 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:54.128048 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0448e61d-7446-4ffa-8cc0-472c29ffef11 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:54.173286 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdf418c-bc9a-494d-a0d5-96276c82cbcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:54.173841 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdf418c-bc9a-494d-a0d5-96276c82cbcc None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:54.174123 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdf418c-bc9a-494d-a0d5-96276c82cbcc None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:54.174397 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdf418c-bc9a-494d-a0d5-96276c82cbcc None admin] PATH_INFO: `/v3/users/swift` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:54.188683 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdf418c-bc9a-494d-a0d5-96276c82cbcc None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:54.190617 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdf418c-bc9a-494d-a0d5-96276c82cbcc None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:54.215595 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-fbdf418c-bc9a-494d-a0d5-96276c82cbcc None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 19 10:13:54.215595 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:13:54.215595 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:13:54.215595 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:13:54.215595 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:13:54.215595 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:13:54.215595 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:13:54.215595 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:13:54.215595 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:13:54.215595 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:13:54.215595 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:13:54.215595 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:13:54.215595 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 10:13:54.215595 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 10:13:54.215595 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 10:13:54.215595 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 10:13:54.216612 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:13:54.216612 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:13:54.216612 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 10:13:54.216612 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 10:13:54.216612 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 10:13:54.216612 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 10:13:54.216612 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:13:54.216612 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:13:54.216612 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:13:54.216612 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:13:54.216612 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:13:54.216612 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Sep 19 10:13:54.216612 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:13:54.216612 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:13:54.216612 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:13:54.216612 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:13:54.216612 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:13:54.216612 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:13:54.217541 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:13:54.217541 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:13:54.217541 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 10:13:54.217541 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 10:13:54.217541 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 10:13:54.217541 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 10:13:54.217541 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 10:13:54.217541 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 10:13:54.217541 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 19 10:13:54.217541 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Sep 19 10:13:54.220289 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 302/614] 10.222.0.66 () {56 vars in 1096 bytes} [Mon Sep 19 10:13:53 2022] GET /identity/v3/users/swift => generated 83 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:13:54.223084 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6d1850-58b1-40b9-86db-3ffb6d1038e8 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:54.333938 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:54.457733 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6d1850-58b1-40b9-86db-3ffb6d1038e8 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:54.521403 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35772120-e6df-46c8-b902-adb4ebb4b5e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:54.522436 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35772120-e6df-46c8-b902-adb4ebb4b5e8 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:54.522914 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35772120-e6df-46c8-b902-adb4ebb4b5e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:54.523391 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35772120-e6df-46c8-b902-adb4ebb4b5e8 None admin] PATH_INFO: `/v3/users` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:54.524342 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35772120-e6df-46c8-b902-adb4ebb4b5e8 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:13:54.524852 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35772120-e6df-46c8-b902-adb4ebb4b5e8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:54.526522 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35772120-e6df-46c8-b902-adb4ebb4b5e8 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:54.553945 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 313/615] 10.222.0.66 () {56 vars in 1135 bytes} [Mon Sep 19 10:13:54 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:13:54.565262 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdf418c-bc9a-494d-a0d5-96276c82cbcc None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:54.674011 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:54.792217 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdf418c-bc9a-494d-a0d5-96276c82cbcc None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:54.864985 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14243854-268e-4e77-81ea-c90d015372ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:54.865656 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14243854-268e-4e77-81ea-c90d015372ab None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:54.865938 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14243854-268e-4e77-81ea-c90d015372ab None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:54.866209 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14243854-268e-4e77-81ea-c90d015372ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:54.872864 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2067c5d0-3775-432a-b6ba-1060b3197f4a None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:54.873363 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2067c5d0-3775-432a-b6ba-1060b3197f4a None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:54.873439 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2067c5d0-3775-432a-b6ba-1060b3197f4a None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:54.877793 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 314/616] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:13:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:13:54.878471 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14243854-268e-4e77-81ea-c90d015372ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:54.880000 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14243854-268e-4e77-81ea-c90d015372ab None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:54.885683 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e95c35-566c-4799-af15-bbf342bbb802 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:54.886090 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e95c35-566c-4799-af15-bbf342bbb802 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:54.886372 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e95c35-566c-4799-af15-bbf342bbb802 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:54.901570 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-14243854-268e-4e77-81ea-c90d015372ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 10:13:54.901570 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:13:54.901570 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:13:54.901570 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:13:54.901570 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:13:54.901570 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:13:54.901570 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:13:54.901570 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:13:54.901570 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:13:54.901570 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:13:54.901570 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:13:54.901570 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:13:54.901570 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 10:13:54.901570 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 10:13:54.901570 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 10:13:54.901570 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 10:13:54.903137 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:13:54.903137 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:13:54.903137 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:13:54.903137 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:13:54.903137 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:13:54.903137 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:13:54.903137 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:13:54.903137 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Sep 19 10:13:54.903137 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:13:54.903137 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:13:54.903137 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:13:54.903137 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:13:54.903137 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:13:54.903137 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:13:54.903137 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:13:54.903137 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:13:54.903137 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 10:13:54.904724 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 10:13:54.904724 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 10:13:54.904724 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Sep 19 10:13:54.904724 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 303/617] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 19 10:13:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 338 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:13:54.918737 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14243854-268e-4e77-81ea-c90d015372ab None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:54.955189 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-57e95c35-566c-4799-af15-bbf342bbb802 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:13:54.958870 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-57e95c35-566c-4799-af15-bbf342bbb802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:13:55.086211 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 315/618] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:13:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 10:13:55.087497 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88da1b6e-029b-4c23-b6b3-8fd260c8158e None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:55.087796 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88da1b6e-029b-4c23-b6b3-8fd260c8158e None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:55.088078 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88da1b6e-029b-4c23-b6b3-8fd260c8158e None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:55.090129 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 316/619] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:13:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:13:55.095868 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f150b5-696a-4f04-bf8a-620bcc639581 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:55.096146 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f150b5-696a-4f04-bf8a-620bcc639581 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:55.096714 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f150b5-696a-4f04-bf8a-620bcc639581 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:55.135382 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-63f150b5-696a-4f04-bf8a-620bcc639581 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:13:55.138587 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-63f150b5-696a-4f04-bf8a-620bcc639581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:13:55.168628 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:55.183478 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:55.188031 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14243854-268e-4e77-81ea-c90d015372ab None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:55.244212 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 317/620] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:13:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 10:13:55.264905 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b81ba6-0442-4c92-8ff2-0ab174dc42f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:55.265880 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b81ba6-0442-4c92-8ff2-0ab174dc42f4 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:55.266524 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b81ba6-0442-4c92-8ff2-0ab174dc42f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:55.266997 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b81ba6-0442-4c92-8ff2-0ab174dc42f4 None admin] PATH_INFO: `/v3/domains` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:55.267842 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b81ba6-0442-4c92-8ff2-0ab174dc42f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:13:55.268368 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b81ba6-0442-4c92-8ff2-0ab174dc42f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:55.270004 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b81ba6-0442-4c92-8ff2-0ab174dc42f4 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:55.285070 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 304/621] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Sep 19 10:13:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 373 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:13:55.292020 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f150b5-696a-4f04-bf8a-620bcc639581 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:55.370884 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b81ba6-0442-4c92-8ff2-0ab174dc42f4 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:55.469935 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f150b5-696a-4f04-bf8a-620bcc639581 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:55.521144 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b81ba6-0442-4c92-8ff2-0ab174dc42f4 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:55.536518 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d079bc07-b9bd-4338-83de-55b516352450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:55.537163 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d079bc07-b9bd-4338-83de-55b516352450 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:55.537441 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d079bc07-b9bd-4338-83de-55b516352450 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:55.537713 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d079bc07-b9bd-4338-83de-55b516352450 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:55.547413 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d079bc07-b9bd-4338-83de-55b516352450 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:55.548893 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d079bc07-b9bd-4338-83de-55b516352450 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:55.569452 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-d079bc07-b9bd-4338-83de-55b516352450 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 10:13:55.569452 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:13:55.569452 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:13:55.569452 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:13:55.569452 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:13:55.569452 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:13:55.569452 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:13:55.569452 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:13:55.569452 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:13:55.569452 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:13:55.569452 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:13:55.569452 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:13:55.569452 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 10:13:55.569452 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 10:13:55.569452 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 10:13:55.570426 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 10:13:55.570426 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:13:55.570426 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:13:55.570426 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:13:55.570426 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:13:55.570426 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:13:55.570426 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:13:55.570426 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:13:55.570426 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 19 10:13:55.570426 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:13:55.570426 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:13:55.570426 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:13:55.570426 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:13:55.570426 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:13:55.570426 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:13:55.570426 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:13:55.570426 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:13:55.571322 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 10:13:55.571322 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 10:13:55.571322 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 10:13:55.571322 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 10:13:55.571322 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 10:13:55.571322 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 10:13:55.571322 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 10:13:55.571322 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 19 10:13:55.576429 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 318/622] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Sep 19 10:13:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:13:55.582518 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d079bc07-b9bd-4338-83de-55b516352450 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:55.590039 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d41862c-0358-4909-ba7c-c160d1b308b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:55.590682 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d41862c-0358-4909-ba7c-c160d1b308b9 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:55.590964 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d41862c-0358-4909-ba7c-c160d1b308b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:55.591240 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d41862c-0358-4909-ba7c-c160d1b308b9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:55.610211 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d41862c-0358-4909-ba7c-c160d1b308b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 10:13:55.617569 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-6d41862c-0358-4909-ba7c-c160d1b308b9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 10:13:55.617569 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:13:55.617569 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:13:55.617569 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:13:55.617569 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:13:55.617569 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:13:55.617569 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:13:55.617569 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:13:55.617569 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:13:55.617569 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:13:55.617569 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:13:55.617569 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:13:55.617569 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 10:13:55.617569 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 10:13:55.617569 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 10:13:55.617569 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 10:13:55.619498 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 10:13:55.619498 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 10:13:55.619498 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 10:13:55.619498 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 10:13:55.619498 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:13:55.619498 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:13:55.619498 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:13:55.619498 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:13:55.619498 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:13:55.619498 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:13:55.619498 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:13:55.619498 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Sep 19 10:13:55.619498 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:13:55.619498 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:13:55.619498 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:13:55.619498 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:13:55.620571 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:13:55.620571 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:13:55.620571 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:13:55.620571 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:13:55.620571 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 10:13:55.620571 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 10:13:55.620571 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 10:13:55.620571 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 10:13:55.620571 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 10:13:55.620571 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 10:13:55.620571 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 10:13:55.620571 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Sep 19 10:13:55.624009 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 305/623] 10.222.0.66 () {56 vars in 1102 bytes} [Mon Sep 19 10:13:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:13:55.624915 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d41862c-0358-4909-ba7c-c160d1b308b9 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:55.625628 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:55.653776 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:55.721231 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d079bc07-b9bd-4338-83de-55b516352450 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:55.757913 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318c18d7-323c-42f6-8616-d920ace46904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:55.758706 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318c18d7-323c-42f6-8616-d920ace46904 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:55.759163 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318c18d7-323c-42f6-8616-d920ace46904 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:55.759611 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318c18d7-323c-42f6-8616-d920ace46904 None admin] PATH_INFO: `/v3/projects` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:55.760609 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318c18d7-323c-42f6-8616-d920ace46904 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:13:55.760915 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318c18d7-323c-42f6-8616-d920ace46904 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:55.761778 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d41862c-0358-4909-ba7c-c160d1b308b9 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:55.762342 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318c18d7-323c-42f6-8616-d920ace46904 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:55.775300 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 319/624] 10.222.0.66 () {56 vars in 1148 bytes} [Mon Sep 19 10:13:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:13:55.776156 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318c18d7-323c-42f6-8616-d920ace46904 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:55.799068 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a9fd38-e59e-460e-a26b-91b1da2db3ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:55.799743 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a9fd38-e59e-460e-a26b-91b1da2db3ad None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:55.800079 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a9fd38-e59e-460e-a26b-91b1da2db3ad None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:55.800417 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a9fd38-e59e-460e-a26b-91b1da2db3ad None admin] PATH_INFO: `/v3/roles/service` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:55.812023 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a9fd38-e59e-460e-a26b-91b1da2db3ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 10:13:55.819172 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-23a9fd38-e59e-460e-a26b-91b1da2db3ad None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 10:13:55.819172 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:13:55.819172 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:13:55.819172 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:13:55.819172 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:13:55.819172 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:13:55.819172 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:13:55.819172 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:13:55.819172 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:13:55.819172 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:13:55.819172 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:13:55.819172 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:13:55.819172 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 10:13:55.819172 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 10:13:55.819172 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 10:13:55.819172 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 10:13:55.820111 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 10:13:55.820111 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 10:13:55.820111 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 10:13:55.820111 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 10:13:55.820111 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:13:55.820111 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:13:55.820111 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:13:55.820111 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:13:55.820111 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:13:55.820111 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:13:55.820111 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:13:55.820111 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Sep 19 10:13:55.820111 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:13:55.820111 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:13:55.820111 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:13:55.820111 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:13:55.822267 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:13:55.822267 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:13:55.822267 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:13:55.822267 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:13:55.822267 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 10:13:55.822267 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 10:13:55.822267 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 10:13:55.822267 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 10:13:55.822267 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 10:13:55.822267 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 10:13:55.822267 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 10:13:55.822267 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Sep 19 10:13:55.822267 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 306/625] 10.222.0.66 () {56 vars in 1102 bytes} [Mon Sep 19 10:13:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:13:55.822267 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a9fd38-e59e-460e-a26b-91b1da2db3ad None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:55.867158 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:55.894804 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318c18d7-323c-42f6-8616-d920ace46904 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:55.912616 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:55.932451 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d327f89f-b4ef-4dcd-b16a-d93486c4e27e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:55.933156 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d327f89f-b4ef-4dcd-b16a-d93486c4e27e None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:55.933502 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d327f89f-b4ef-4dcd-b16a-d93486c4e27e None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:55.933840 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d327f89f-b4ef-4dcd-b16a-d93486c4e27e None admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:55.934696 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d327f89f-b4ef-4dcd-b16a-d93486c4e27e None admin] RBAC: Adding query filter params (name=service) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:13:55.935133 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d327f89f-b4ef-4dcd-b16a-d93486c4e27e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:55.937023 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d327f89f-b4ef-4dcd-b16a-d93486c4e27e None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:55.940269 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a9fd38-e59e-460e-a26b-91b1da2db3ad None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:55.950986 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 320/626] 10.222.0.66 () {56 vars in 1103 bytes} [Mon Sep 19 10:13:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:13:55.952063 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d327f89f-b4ef-4dcd-b16a-d93486c4e27e None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:55.979002 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f674059a-c6d8-43ac-8c60-271b68b1171f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:55.980043 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f674059a-c6d8-43ac-8c60-271b68b1171f None admin] REQUEST_METHOD: `PUT` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:55.980498 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f674059a-c6d8-43ac-8c60-271b68b1171f None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:55.981050 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f674059a-c6d8-43ac-8c60-271b68b1171f None admin] PATH_INFO: `/v3/projects/be6b93ef3359434d9c776343f0aea333/users/6677354e36614c9fb3d03413749be5ca/roles/75952bc2767d49c1a6e49840d8a8f349` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:56.001051 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f674059a-c6d8-43ac-8c60-271b68b1171f None admin] RBAC: Authorizing `identity:create_grant(project_id=be6b93ef3359434d9c776343f0aea333, user_id=6677354e36614c9fb3d03413749be5ca, role_id=75952bc2767d49c1a6e49840d8a8f349)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:56.003454 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f674059a-c6d8-43ac-8c60-271b68b1171f None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:56.026405 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 307/627] 10.222.0.66 () {58 vars in 1439 bytes} [Mon Sep 19 10:13:55 2022] PUT /identity/v3/projects/be6b93ef3359434d9c776343f0aea333/users/6677354e36614c9fb3d03413749be5ca/roles/75952bc2767d49c1a6e49840d8a8f349 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:13:56.028134 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f674059a-c6d8-43ac-8c60-271b68b1171f None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:56.068058 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d327f89f-b4ef-4dcd-b16a-d93486c4e27e None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:56.124915 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6663b36c-9068-4c01-92a8-698c557e2eff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:56.125541 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6663b36c-9068-4c01-92a8-698c557e2eff None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:56.125819 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6663b36c-9068-4c01-92a8-698c557e2eff None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:56.126088 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6663b36c-9068-4c01-92a8-698c557e2eff None admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:56.126751 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6663b36c-9068-4c01-92a8-698c557e2eff None admin] RBAC: Adding query filter params (name=service) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:13:56.127049 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6663b36c-9068-4c01-92a8-698c557e2eff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:56.128474 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6663b36c-9068-4c01-92a8-698c557e2eff None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:56.137173 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:56.150716 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 321/628] 10.222.0.66 () {56 vars in 1103 bytes} [Mon Sep 19 10:13:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:13:56.163991 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6663b36c-9068-4c01-92a8-698c557e2eff None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:56.228361 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f674059a-c6d8-43ac-8c60-271b68b1171f None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:56.273840 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:56.284909 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b32a55f-2e52-4437-9ad2-8e8067941d2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:56.286125 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b32a55f-2e52-4437-9ad2-8e8067941d2a None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:56.286313 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b32a55f-2e52-4437-9ad2-8e8067941d2a None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:56.286592 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b32a55f-2e52-4437-9ad2-8e8067941d2a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:56.302391 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b32a55f-2e52-4437-9ad2-8e8067941d2a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:56.304020 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b32a55f-2e52-4437-9ad2-8e8067941d2a None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:56.322683 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6663b36c-9068-4c01-92a8-698c557e2eff None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:56.322997 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-5b32a55f-2e52-4437-9ad2-8e8067941d2a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 10:13:56.322997 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:13:56.322997 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:13:56.322997 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:13:56.322997 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:13:56.322997 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:13:56.322997 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:13:56.322997 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:13:56.322997 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:13:56.322997 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:13:56.322997 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:13:56.322997 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:13:56.322997 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 10:13:56.322997 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 10:13:56.322997 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 10:13:56.322997 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 10:13:56.324462 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:13:56.324462 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:13:56.324462 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:13:56.324462 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:13:56.324462 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:13:56.324462 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:13:56.324462 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:13:56.324462 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Sep 19 10:13:56.324462 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:13:56.324462 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:13:56.324462 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:13:56.324462 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:13:56.324462 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:13:56.324462 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:13:56.324462 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:13:56.324462 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:13:56.324462 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 10:13:56.325351 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 10:13:56.325351 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 10:13:56.325351 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Sep 19 10:13:56.327738 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 308/629] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 19 10:13:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:13:56.334683 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b32a55f-2e52-4437-9ad2-8e8067941d2a None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:56.370272 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0486e49a-0793-4c9c-a297-4746bb51257d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:56.371200 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0486e49a-0793-4c9c-a297-4746bb51257d None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:56.371634 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0486e49a-0793-4c9c-a297-4746bb51257d None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:56.372056 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0486e49a-0793-4c9c-a297-4746bb51257d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:56.386238 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0486e49a-0793-4c9c-a297-4746bb51257d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:56.387973 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0486e49a-0793-4c9c-a297-4746bb51257d None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:56.409735 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-0486e49a-0793-4c9c-a297-4746bb51257d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 10:13:56.409735 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:13:56.409735 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:13:56.409735 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:13:56.409735 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:13:56.409735 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:13:56.409735 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:13:56.409735 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:13:56.409735 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:13:56.409735 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:13:56.409735 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:13:56.409735 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:13:56.409735 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 10:13:56.409735 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 10:13:56.409735 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 10:13:56.409735 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 10:13:56.410797 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:13:56.410797 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:13:56.410797 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:13:56.410797 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:13:56.410797 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:13:56.410797 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:13:56.410797 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:13:56.410797 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 19 10:13:56.410797 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:13:56.410797 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:13:56.410797 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:13:56.410797 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:13:56.410797 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:13:56.410797 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:13:56.410797 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:13:56.410797 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:13:56.410797 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 10:13:56.411701 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 10:13:56.411701 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 10:13:56.411701 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 19 10:13:56.414846 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 322/630] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 19 10:13:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 10:13:56.420568 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97ff357-ed22-4a1f-ac76-47166dedce16 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:56.420568 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97ff357-ed22-4a1f-ac76-47166dedce16 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:56.420568 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97ff357-ed22-4a1f-ac76-47166dedce16 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:56.420568 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 323/631] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:13:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:13:56.425326 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435a9f7b-97af-42ef-8f61-c743680e4608 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:56.425613 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435a9f7b-97af-42ef-8f61-c743680e4608 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:56.425872 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435a9f7b-97af-42ef-8f61-c743680e4608 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:56.446547 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-435a9f7b-97af-42ef-8f61-c743680e4608 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:13:56.447758 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-435a9f7b-97af-42ef-8f61-c743680e4608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:13:56.464576 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b32a55f-2e52-4437-9ad2-8e8067941d2a None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:56.503983 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e708b8-c408-4c79-ac5c-93fe9f0e45de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:56.504973 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:56.505741 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e708b8-c408-4c79-ac5c-93fe9f0e45de None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:56.506218 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e708b8-c408-4c79-ac5c-93fe9f0e45de None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:56.506683 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e708b8-c408-4c79-ac5c-93fe9f0e45de None admin] PATH_INFO: `/v3/domains` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:56.507628 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e708b8-c408-4c79-ac5c-93fe9f0e45de None admin] RBAC: Adding query filter params (name=Default) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:13:56.508142 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e708b8-c408-4c79-ac5c-93fe9f0e45de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:56.509814 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e708b8-c408-4c79-ac5c-93fe9f0e45de None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:56.527833 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 309/632] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Sep 19 10:13:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:13:56.527833 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e708b8-c408-4c79-ac5c-93fe9f0e45de None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:56.533634 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 324/633] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:13:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 10:13:56.535010 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145f951c-3758-4c48-8984-895035705014 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:56.535302 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145f951c-3758-4c48-8984-895035705014 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:56.535640 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145f951c-3758-4c48-8984-895035705014 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:56.537645 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 325/634] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:13:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:13:56.538280 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145f951c-3758-4c48-8984-895035705014 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:56.594791 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:56.658549 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e708b8-c408-4c79-ac5c-93fe9f0e45de None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:56.678845 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145f951c-3758-4c48-8984-895035705014 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:56.711962 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ee2438-4f0b-4c60-999a-d1a2f6ccdfb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:56.712736 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ee2438-4f0b-4c60-999a-d1a2f6ccdfb8 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:56.713057 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ee2438-4f0b-4c60-999a-d1a2f6ccdfb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:56.713447 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ee2438-4f0b-4c60-999a-d1a2f6ccdfb8 None admin] PATH_INFO: `/v3/domains` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:56.714166 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ee2438-4f0b-4c60-999a-d1a2f6ccdfb8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:13:56.714723 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ee2438-4f0b-4c60-999a-d1a2f6ccdfb8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:56.716154 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ee2438-4f0b-4c60-999a-d1a2f6ccdfb8 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:56.734611 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 310/635] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Sep 19 10:13:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:13:56.734611 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7302e11c-8718-4678-9ba1-1df3413484a0 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:56.734611 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7302e11c-8718-4678-9ba1-1df3413484a0 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:56.734611 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7302e11c-8718-4678-9ba1-1df3413484a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:56.752345 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5ae929-b9a0-4afa-be9c-7358ef181f10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:56.753719 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5ae929-b9a0-4afa-be9c-7358ef181f10 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:56.754844 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5ae929-b9a0-4afa-be9c-7358ef181f10 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:56.754995 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-7302e11c-8718-4678-9ba1-1df3413484a0 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:13:56.755629 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5ae929-b9a0-4afa-be9c-7358ef181f10 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:56.757481 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-7302e11c-8718-4678-9ba1-1df3413484a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:13:56.769462 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5ae929-b9a0-4afa-be9c-7358ef181f10 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:56.772618 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5ae929-b9a0-4afa-be9c-7358ef181f10 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:56.789958 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-ce5ae929-b9a0-4afa-be9c-7358ef181f10 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 19 10:13:56.789958 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:13:56.789958 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:13:56.789958 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:13:56.789958 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:13:56.789958 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:13:56.789958 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:13:56.789958 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:13:56.789958 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:13:56.789958 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:13:56.789958 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:13:56.789958 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:13:56.789958 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 10:13:56.789958 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 10:13:56.789958 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 10:13:56.789958 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 10:13:56.790974 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:13:56.790974 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:13:56.790974 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 10:13:56.790974 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 10:13:56.790974 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 10:13:56.790974 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 10:13:56.790974 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:13:56.790974 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:13:56.790974 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:13:56.790974 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:13:56.790974 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:13:56.790974 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 19 10:13:56.790974 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:13:56.790974 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:13:56.790974 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:13:56.790974 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:13:56.790974 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:13:56.790974 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:13:56.791924 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:13:56.791924 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:13:56.791924 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 10:13:56.791924 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 10:13:56.791924 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 10:13:56.791924 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 10:13:56.791924 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 10:13:56.791924 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 10:13:56.791924 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 19 10:13:56.791924 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 19 10:13:56.798748 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 326/636] 10.222.0.66 () {56 vars in 1093 bytes} [Mon Sep 19 10:13:56 2022] GET /identity/v3/users/nova => generated 82 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:13:56.798748 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5ae929-b9a0-4afa-be9c-7358ef181f10 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:56.838605 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 311/637] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:13:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 10:13:56.839354 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7302e11c-8718-4678-9ba1-1df3413484a0 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:56.859455 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:56.874813 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:56.940669 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5ae929-b9a0-4afa-be9c-7358ef181f10 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:56.963277 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7302e11c-8718-4678-9ba1-1df3413484a0 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:56.987678 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e658b706-65a3-4462-b71f-ef35f7b3fbd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:56.989562 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e658b706-65a3-4462-b71f-ef35f7b3fbd5 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:56.990174 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e658b706-65a3-4462-b71f-ef35f7b3fbd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:56.990742 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e658b706-65a3-4462-b71f-ef35f7b3fbd5 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:57.000262 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23d1143-4d67-451f-afd6-9350cfe2b20a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:57.000717 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e658b706-65a3-4462-b71f-ef35f7b3fbd5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:57.001070 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23d1143-4d67-451f-afd6-9350cfe2b20a None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:57.001435 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23d1143-4d67-451f-afd6-9350cfe2b20a None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:57.001776 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23d1143-4d67-451f-afd6-9350cfe2b20a None admin] PATH_INFO: `/v3/users` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:57.002569 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23d1143-4d67-451f-afd6-9350cfe2b20a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:13:57.002939 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23d1143-4d67-451f-afd6-9350cfe2b20a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:57.003268 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e658b706-65a3-4462-b71f-ef35f7b3fbd5 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:57.005076 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23d1143-4d67-451f-afd6-9350cfe2b20a None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:57.024303 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-e658b706-65a3-4462-b71f-ef35f7b3fbd5 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 19 10:13:57.024303 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:13:57.024303 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:13:57.024303 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:13:57.024303 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:13:57.024303 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:13:57.024303 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:13:57.024303 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:13:57.024303 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:13:57.024303 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:13:57.024303 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:13:57.024303 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:13:57.024303 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 10:13:57.024303 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 10:13:57.024303 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 10:13:57.024303 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 10:13:57.025845 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:13:57.025845 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:13:57.025845 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 10:13:57.025845 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 10:13:57.025845 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 10:13:57.025845 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 10:13:57.025845 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:13:57.025845 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:13:57.025845 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:13:57.025845 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:13:57.025845 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:13:57.025845 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 19 10:13:57.025845 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:13:57.025845 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:13:57.025845 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:13:57.025845 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:13:57.025845 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:13:57.025845 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:13:57.027352 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:13:57.027352 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:13:57.027352 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 10:13:57.027352 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 10:13:57.027352 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 10:13:57.027352 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 10:13:57.027352 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 10:13:57.027352 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 10:13:57.027352 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 19 10:13:57.027352 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 19 10:13:57.029247 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 327/638] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Sep 19 10:13:56 2022] GET /identity/v3/users/glance => generated 84 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:13:57.030704 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e658b706-65a3-4462-b71f-ef35f7b3fbd5 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:57.039648 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 312/639] 10.222.0.66 () {56 vars in 1133 bytes} [Mon Sep 19 10:13:56 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:13:57.039648 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23d1143-4d67-451f-afd6-9350cfe2b20a None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:57.155399 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:57.163184 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e658b706-65a3-4462-b71f-ef35f7b3fbd5 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:57.164929 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:57.165530 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23d1143-4d67-451f-afd6-9350cfe2b20a None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:57.199261 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013d8998-d7be-4c1a-9094-fe2ebe8b46e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:57.199804 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013d8998-d7be-4c1a-9094-fe2ebe8b46e7 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:57.200077 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013d8998-d7be-4c1a-9094-fe2ebe8b46e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:57.200366 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013d8998-d7be-4c1a-9094-fe2ebe8b46e7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:57.203012 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83232a4-56c0-4c88-9f3f-412ce1277b35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:57.203363 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83232a4-56c0-4c88-9f3f-412ce1277b35 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:57.203638 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83232a4-56c0-4c88-9f3f-412ce1277b35 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:57.203908 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83232a4-56c0-4c88-9f3f-412ce1277b35 None admin] PATH_INFO: `/v3/users` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:57.204654 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83232a4-56c0-4c88-9f3f-412ce1277b35 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:13:57.204957 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83232a4-56c0-4c88-9f3f-412ce1277b35 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:57.206428 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83232a4-56c0-4c88-9f3f-412ce1277b35 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:57.210935 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013d8998-d7be-4c1a-9094-fe2ebe8b46e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 10:13:57.216087 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-013d8998-d7be-4c1a-9094-fe2ebe8b46e7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 10:13:57.216087 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:13:57.216087 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:13:57.216087 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:13:57.216087 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:13:57.216087 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:13:57.216087 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:13:57.216087 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:13:57.216087 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:13:57.216087 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:13:57.216087 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:13:57.216087 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:13:57.216087 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 10:13:57.216087 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 10:13:57.216087 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 10:13:57.216087 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 10:13:57.217041 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 10:13:57.217041 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 10:13:57.217041 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 10:13:57.217041 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 10:13:57.217041 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:13:57.217041 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:13:57.217041 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:13:57.217041 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:13:57.217041 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:13:57.217041 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:13:57.217041 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:13:57.217041 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 19 10:13:57.217041 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:13:57.217041 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:13:57.217041 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:13:57.217041 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:13:57.217857 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:13:57.217857 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:13:57.217857 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:13:57.217857 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:13:57.217857 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 10:13:57.217857 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 10:13:57.217857 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 10:13:57.217857 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 10:13:57.217857 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 10:13:57.217857 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 10:13:57.217857 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 10:13:57.217857 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 19 10:13:57.222081 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 328/640] 10.222.0.66 () {56 vars in 1102 bytes} [Mon Sep 19 10:13:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:13:57.222760 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013d8998-d7be-4c1a-9094-fe2ebe8b46e7 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:57.228964 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 313/641] 10.222.0.66 () {56 vars in 1137 bytes} [Mon Sep 19 10:13:57 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:13:57.228964 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83232a4-56c0-4c88-9f3f-412ce1277b35 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:57.327355 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83232a4-56c0-4c88-9f3f-412ce1277b35 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:57.333080 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013d8998-d7be-4c1a-9094-fe2ebe8b46e7 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:57.360767 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362c4d98-272f-4a62-98ea-55feb598d5ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:57.361396 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362c4d98-272f-4a62-98ea-55feb598d5ca None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:57.361725 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362c4d98-272f-4a62-98ea-55feb598d5ca None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:57.362000 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362c4d98-272f-4a62-98ea-55feb598d5ca None admin] PATH_INFO: `/v3/roles/service` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:57.370395 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8096eaa-9ed4-4671-bbe1-942a83c92ce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:57.371296 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8096eaa-9ed4-4671-bbe1-942a83c92ce0 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:57.371782 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8096eaa-9ed4-4671-bbe1-942a83c92ce0 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:57.372069 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8096eaa-9ed4-4671-bbe1-942a83c92ce0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:57.373592 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362c4d98-272f-4a62-98ea-55feb598d5ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 10:13:57.378329 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-362c4d98-272f-4a62-98ea-55feb598d5ca None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 10:13:57.378329 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:13:57.378329 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:13:57.378329 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:13:57.378329 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:13:57.378329 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:13:57.378329 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:13:57.378329 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:13:57.378329 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:13:57.378329 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:13:57.378329 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:13:57.378329 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:13:57.378329 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 10:13:57.378329 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 10:13:57.378329 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 10:13:57.378329 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 10:13:57.379374 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 10:13:57.379374 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 10:13:57.379374 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 10:13:57.379374 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 10:13:57.379374 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:13:57.379374 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:13:57.379374 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:13:57.379374 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:13:57.379374 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:13:57.379374 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:13:57.379374 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:13:57.379374 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Sep 19 10:13:57.379374 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:13:57.379374 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:13:57.379374 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:13:57.379374 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:13:57.384648 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:13:57.384648 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:13:57.384648 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:13:57.384648 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:13:57.384648 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 10:13:57.384648 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 10:13:57.384648 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 10:13:57.384648 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 10:13:57.384648 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 10:13:57.384648 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 10:13:57.384648 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 10:13:57.384648 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Sep 19 10:13:57.384648 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 314/642] 10.222.0.66 () {56 vars in 1102 bytes} [Mon Sep 19 10:13:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:13:57.384648 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362c4d98-272f-4a62-98ea-55feb598d5ca None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:57.398544 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:57.411773 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:57.455219 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8096eaa-9ed4-4671-bbe1-942a83c92ce0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:57.456632 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8096eaa-9ed4-4671-bbe1-942a83c92ce0 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:57.501237 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362c4d98-272f-4a62-98ea-55feb598d5ca None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:57.540175 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cc32e9-d9b1-46f4-bd1f-d80e8c83d342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:57.540800 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cc32e9-d9b1-46f4-bd1f-d80e8c83d342 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:57.541074 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cc32e9-d9b1-46f4-bd1f-d80e8c83d342 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:57.541339 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cc32e9-d9b1-46f4-bd1f-d80e8c83d342 None admin] PATH_INFO: `/v3/roles` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:57.541988 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cc32e9-d9b1-46f4-bd1f-d80e8c83d342 None admin] RBAC: Adding query filter params (name=service) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:13:57.542289 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cc32e9-d9b1-46f4-bd1f-d80e8c83d342 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:57.543678 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cc32e9-d9b1-46f4-bd1f-d80e8c83d342 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:57.557127 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 315/643] 10.222.0.66 () {56 vars in 1103 bytes} [Mon Sep 19 10:13:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:13:57.557127 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cc32e9-d9b1-46f4-bd1f-d80e8c83d342 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:57.577460 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 329/644] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Sep 19 10:13:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 10:13:57.577460 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8096eaa-9ed4-4671-bbe1-942a83c92ce0 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:57.633698 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:57.647452 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:57.667074 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cc32e9-d9b1-46f4-bd1f-d80e8c83d342 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:57.695343 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8096eaa-9ed4-4671-bbe1-942a83c92ce0 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:57.705749 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd56630-dbe6-4b5a-b62f-f204c75957fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:57.706600 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd56630-dbe6-4b5a-b62f-f204c75957fb None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:57.706885 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd56630-dbe6-4b5a-b62f-f204c75957fb None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:57.707329 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd56630-dbe6-4b5a-b62f-f204c75957fb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:57.729709 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5817b65-923e-4e4b-870d-954cfdb82e52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:57.730738 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5817b65-923e-4e4b-870d-954cfdb82e52 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:57.731018 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5817b65-923e-4e4b-870d-954cfdb82e52 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:57.731454 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5817b65-923e-4e4b-870d-954cfdb82e52 None admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:57.732105 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5817b65-923e-4e4b-870d-954cfdb82e52 None admin] RBAC: Adding query filter params (name=service) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:13:57.732431 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5817b65-923e-4e4b-870d-954cfdb82e52 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:57.733805 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5817b65-923e-4e4b-870d-954cfdb82e52 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:57.746705 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 330/645] 10.222.0.66 () {56 vars in 1103 bytes} [Mon Sep 19 10:13:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:13:57.746705 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5817b65-923e-4e4b-870d-954cfdb82e52 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:57.786191 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd56630-dbe6-4b5a-b62f-f204c75957fb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:57.787809 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd56630-dbe6-4b5a-b62f-f204c75957fb None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:57.854645 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5817b65-923e-4e4b-870d-954cfdb82e52 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:57.863890 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:57.879903 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:57.891151 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca133f1-b6e3-4348-b2e7-03fd6fc1b697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:57.892124 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca133f1-b6e3-4348-b2e7-03fd6fc1b697 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:57.892647 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca133f1-b6e3-4348-b2e7-03fd6fc1b697 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:57.893112 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca133f1-b6e3-4348-b2e7-03fd6fc1b697 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:57.904332 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 316/646] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Sep 19 10:13:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 10:13:57.904332 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd56630-dbe6-4b5a-b62f-f204c75957fb None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:57.909375 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca133f1-b6e3-4348-b2e7-03fd6fc1b697 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:57.911454 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca133f1-b6e3-4348-b2e7-03fd6fc1b697 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:57.926493 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-8ca133f1-b6e3-4348-b2e7-03fd6fc1b697 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 10:13:57.926493 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:13:57.926493 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:13:57.926493 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:13:57.926493 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:13:57.926493 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:13:57.926493 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:13:57.926493 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:13:57.926493 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:13:57.926493 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:13:57.926493 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:13:57.926493 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:13:57.926493 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 10:13:57.926493 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 10:13:57.926493 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 10:13:57.926493 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 10:13:57.927570 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:13:57.927570 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:13:57.927570 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:13:57.927570 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:13:57.927570 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:13:57.927570 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:13:57.927570 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:13:57.927570 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 19 10:13:57.927570 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:13:57.927570 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:13:57.927570 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:13:57.927570 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:13:57.927570 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:13:57.927570 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:13:57.927570 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:13:57.927570 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:13:57.927570 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 10:13:57.928592 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 10:13:57.928592 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 10:13:57.928592 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 19 10:13:57.928592 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 331/647] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 19 10:13:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:13:57.928592 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca133f1-b6e3-4348-b2e7-03fd6fc1b697 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:58.012389 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd56630-dbe6-4b5a-b62f-f204c75957fb None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:58.039730 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca133f1-b6e3-4348-b2e7-03fd6fc1b697 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:58.049460 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1674f33-3710-4eae-85ad-da964e8ae1b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:58.050606 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1674f33-3710-4eae-85ad-da964e8ae1b2 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:58.051062 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1674f33-3710-4eae-85ad-da964e8ae1b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:58.051493 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1674f33-3710-4eae-85ad-da964e8ae1b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:58.061773 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1674f33-3710-4eae-85ad-da964e8ae1b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:58.063277 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1674f33-3710-4eae-85ad-da964e8ae1b2 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:58.076509 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a004d11-1fd6-48a7-85d1-7327ef2a9a1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:58.077139 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a004d11-1fd6-48a7-85d1-7327ef2a9a1d None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:58.077418 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a004d11-1fd6-48a7-85d1-7327ef2a9a1d None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:58.077688 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a004d11-1fd6-48a7-85d1-7327ef2a9a1d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:58.078247 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-c1674f33-3710-4eae-85ad-da964e8ae1b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 10:13:58.078247 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:13:58.078247 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:13:58.078247 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:13:58.078247 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:13:58.078247 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:13:58.078247 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:13:58.078247 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:13:58.078247 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:13:58.078247 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:13:58.078247 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:13:58.078247 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:13:58.078247 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 10:13:58.078247 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 10:13:58.078247 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 10:13:58.078247 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 10:13:58.079147 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:13:58.079147 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:13:58.079147 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:13:58.079147 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:13:58.079147 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:13:58.079147 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:13:58.079147 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:13:58.079147 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Sep 19 10:13:58.079147 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:13:58.079147 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:13:58.079147 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:13:58.079147 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:13:58.079147 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:13:58.079147 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:13:58.079147 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:13:58.079147 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:13:58.079147 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 10:13:58.080006 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 10:13:58.080006 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 10:13:58.080006 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Sep 19 10:13:58.080006 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 317/648] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 19 10:13:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:13:58.080765 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1674f33-3710-4eae-85ad-da964e8ae1b2 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:58.095267 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a004d11-1fd6-48a7-85d1-7327ef2a9a1d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:58.096766 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a004d11-1fd6-48a7-85d1-7327ef2a9a1d None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:58.105746 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:58.112678 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-6a004d11-1fd6-48a7-85d1-7327ef2a9a1d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 10:13:58.112678 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:13:58.112678 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:13:58.112678 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:13:58.112678 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:13:58.112678 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:13:58.112678 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:13:58.112678 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:13:58.112678 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:13:58.112678 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:13:58.112678 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:13:58.112678 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:13:58.112678 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 10:13:58.112678 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 10:13:58.112678 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 10:13:58.112678 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 10:13:58.113666 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:13:58.113666 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:13:58.113666 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:13:58.113666 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:13:58.113666 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:13:58.113666 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:13:58.113666 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:13:58.113666 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 19 10:13:58.113666 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:13:58.113666 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:13:58.113666 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:13:58.113666 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:13:58.113666 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:13:58.113666 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:13:58.113666 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:13:58.113666 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:13:58.113666 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 10:13:58.114595 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 10:13:58.114595 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 10:13:58.114595 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 19 10:13:58.114595 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 332/649] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 19 10:13:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:13:58.114595 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a004d11-1fd6-48a7-85d1-7327ef2a9a1d None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:58.144052 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:58.189485 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1674f33-3710-4eae-85ad-da964e8ae1b2 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:58.226012 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a004d11-1fd6-48a7-85d1-7327ef2a9a1d None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:58.229790 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65da702-e5b5-477c-a6ca-8ac03f7b3bb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:58.230433 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65da702-e5b5-477c-a6ca-8ac03f7b3bb5 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:58.230716 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65da702-e5b5-477c-a6ca-8ac03f7b3bb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:58.230993 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65da702-e5b5-477c-a6ca-8ac03f7b3bb5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:58.243658 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65da702-e5b5-477c-a6ca-8ac03f7b3bb5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:58.246847 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65da702-e5b5-477c-a6ca-8ac03f7b3bb5 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:58.262989 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-c65da702-e5b5-477c-a6ca-8ac03f7b3bb5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 10:13:58.262989 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:13:58.262989 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:13:58.262989 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:13:58.262989 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:13:58.262989 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:13:58.262989 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:13:58.262989 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:13:58.262989 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:13:58.262989 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:13:58.262989 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:13:58.262989 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:13:58.262989 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 10:13:58.262989 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 10:13:58.262989 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 10:13:58.262989 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 10:13:58.264002 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:13:58.264002 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:13:58.264002 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:13:58.264002 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:13:58.264002 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:13:58.264002 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:13:58.264002 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:13:58.264002 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Sep 19 10:13:58.264002 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:13:58.264002 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:13:58.264002 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:13:58.264002 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:13:58.264002 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:13:58.264002 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:13:58.264002 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:13:58.264002 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:13:58.264002 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 10:13:58.264945 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 10:13:58.264945 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 10:13:58.264945 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Sep 19 10:13:58.264945 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 318/650] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 19 10:13:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:13:58.264945 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65da702-e5b5-477c-a6ca-8ac03f7b3bb5 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:58.266530 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8243f31d-9e4d-4533-b252-ff386e33a0d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:58.267167 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8243f31d-9e4d-4533-b252-ff386e33a0d2 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:58.267447 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8243f31d-9e4d-4533-b252-ff386e33a0d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:58.267719 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8243f31d-9e4d-4533-b252-ff386e33a0d2 None admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:58.268429 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8243f31d-9e4d-4533-b252-ff386e33a0d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:13:58.268734 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8243f31d-9e4d-4533-b252-ff386e33a0d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:58.270759 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8243f31d-9e4d-4533-b252-ff386e33a0d2 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:58.285295 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 333/651] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Sep 19 10:13:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:13:58.290566 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8243f31d-9e4d-4533-b252-ff386e33a0d2 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:58.351524 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:58.377316 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65da702-e5b5-477c-a6ca-8ac03f7b3bb5 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:58.398030 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:58.411572 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8243f31d-9e4d-4533-b252-ff386e33a0d2 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:58.414185 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d479080e-57ac-494e-ab28-bfe2d0447590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:58.414789 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d479080e-57ac-494e-ab28-bfe2d0447590 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:58.415065 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d479080e-57ac-494e-ab28-bfe2d0447590 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:58.415335 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d479080e-57ac-494e-ab28-bfe2d0447590 None admin] PATH_INFO: `/v3/domains` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:58.415971 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d479080e-57ac-494e-ab28-bfe2d0447590 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:13:58.416295 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d479080e-57ac-494e-ab28-bfe2d0447590 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:58.417686 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d479080e-57ac-494e-ab28-bfe2d0447590 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:58.430272 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 319/652] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Sep 19 10:13:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:13:58.431136 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d479080e-57ac-494e-ab28-bfe2d0447590 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:58.467848 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d860fa-ffc3-4bef-b6c7-29273fcb25ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:58.468710 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d860fa-ffc3-4bef-b6c7-29273fcb25ef None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:58.469002 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d860fa-ffc3-4bef-b6c7-29273fcb25ef None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:58.469272 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d860fa-ffc3-4bef-b6c7-29273fcb25ef None admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:58.470023 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d860fa-ffc3-4bef-b6c7-29273fcb25ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:13:58.470323 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d860fa-ffc3-4bef-b6c7-29273fcb25ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:58.471773 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d860fa-ffc3-4bef-b6c7-29273fcb25ef None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:58.483918 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 334/653] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Sep 19 10:13:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:13:58.484805 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d860fa-ffc3-4bef-b6c7-29273fcb25ef None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:58.547003 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d479080e-57ac-494e-ab28-bfe2d0447590 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:58.582885 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ba59a9-22e2-439c-baeb-bf21eb6975ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:58.583489 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ba59a9-22e2-439c-baeb-bf21eb6975ee None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:58.583763 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ba59a9-22e2-439c-baeb-bf21eb6975ee None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:58.584029 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ba59a9-22e2-439c-baeb-bf21eb6975ee None admin] PATH_INFO: `/v3/domains` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:58.584693 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ba59a9-22e2-439c-baeb-bf21eb6975ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:13:58.584993 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ba59a9-22e2-439c-baeb-bf21eb6975ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:58.586351 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ba59a9-22e2-439c-baeb-bf21eb6975ee None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:58.586974 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d860fa-ffc3-4bef-b6c7-29273fcb25ef None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:58.587726 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:58.598341 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 320/654] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Sep 19 10:13:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:13:58.599887 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f27751-0961-4b31-84e3-455234ea35f4 None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:58.600183 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f27751-0961-4b31-84e3-455234ea35f4 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:58.600466 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f27751-0961-4b31-84e3-455234ea35f4 None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:58.601662 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 321/655] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:13:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:13:58.602354 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f27751-0961-4b31-84e3-455234ea35f4 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:58.626670 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cabf7af-650f-4b0f-90ab-6cfe60ad1631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:58.627301 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cabf7af-650f-4b0f-90ab-6cfe60ad1631 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:58.627815 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cabf7af-650f-4b0f-90ab-6cfe60ad1631 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:58.627815 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cabf7af-650f-4b0f-90ab-6cfe60ad1631 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:58.636179 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cabf7af-650f-4b0f-90ab-6cfe60ad1631 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:58.637629 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cabf7af-650f-4b0f-90ab-6cfe60ad1631 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:58.648642 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-6cabf7af-650f-4b0f-90ab-6cfe60ad1631 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 19 10:13:58.648642 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:13:58.648642 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:13:58.648642 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:13:58.648642 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:13:58.648642 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:13:58.648642 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:13:58.648642 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:13:58.648642 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:13:58.648642 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:13:58.648642 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:13:58.648642 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:13:58.648642 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 10:13:58.648642 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 10:13:58.648642 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 10:13:58.648642 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 10:13:58.649798 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:13:58.649798 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:13:58.649798 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 10:13:58.649798 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 10:13:58.649798 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 10:13:58.649798 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 10:13:58.649798 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:13:58.649798 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:13:58.649798 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:13:58.649798 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:13:58.649798 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:13:58.649798 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 19 10:13:58.649798 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:13:58.649798 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:13:58.649798 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:13:58.649798 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:13:58.649798 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:13:58.649798 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:13:58.650801 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:13:58.650801 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:13:58.650801 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 10:13:58.650801 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 10:13:58.650801 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 10:13:58.650801 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 10:13:58.650801 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 10:13:58.650801 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 10:13:58.650801 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 19 10:13:58.650801 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 19 10:13:58.650801 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 335/656] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Sep 19 10:13:58 2022] GET /identity/v3/users/cinder => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:13:58.651378 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cabf7af-650f-4b0f-90ab-6cfe60ad1631 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:58.661819 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:58.706736 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f27751-0961-4b31-84e3-455234ea35f4 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:58.741633 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9562633e-a00b-43ed-a2c3-c63b0acfe148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:58.742257 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9562633e-a00b-43ed-a2c3-c63b0acfe148 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:58.742540 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9562633e-a00b-43ed-a2c3-c63b0acfe148 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:58.742809 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9562633e-a00b-43ed-a2c3-c63b0acfe148 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:58.749343 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9562633e-a00b-43ed-a2c3-c63b0acfe148 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:58.750797 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9562633e-a00b-43ed-a2c3-c63b0acfe148 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:58.751786 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cabf7af-650f-4b0f-90ab-6cfe60ad1631 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:58.766436 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-9562633e-a00b-43ed-a2c3-c63b0acfe148 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 10:13:58.766436 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:13:58.766436 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:13:58.766436 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:13:58.766436 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:13:58.766436 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:13:58.766436 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:13:58.766436 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:13:58.766436 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:13:58.766436 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:13:58.766436 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:13:58.766436 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:13:58.766436 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 10:13:58.766436 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 10:13:58.766436 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 10:13:58.767477 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 10:13:58.767477 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:13:58.767477 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:13:58.767477 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:13:58.767477 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:13:58.767477 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:13:58.767477 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:13:58.767477 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:13:58.767477 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Sep 19 10:13:58.767477 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:13:58.767477 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:13:58.767477 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:13:58.767477 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:13:58.767477 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:13:58.767477 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:13:58.767477 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:13:58.767477 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:13:58.768581 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 10:13:58.768581 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 10:13:58.768581 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 10:13:58.768581 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 10:13:58.768581 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 10:13:58.768581 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 10:13:58.768581 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 10:13:58.768581 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Sep 19 10:13:58.768581 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 322/657] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Sep 19 10:13:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:13:58.769250 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9562633e-a00b-43ed-a2c3-c63b0acfe148 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:58.800428 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff904754-72f3-4305-b1b0-9c316f06d2e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:58.800706 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff904754-72f3-4305-b1b0-9c316f06d2e6 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:58.801762 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff904754-72f3-4305-b1b0-9c316f06d2e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:58.801922 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff904754-72f3-4305-b1b0-9c316f06d2e6 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:58.812585 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff904754-72f3-4305-b1b0-9c316f06d2e6 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:58.814852 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff904754-72f3-4305-b1b0-9c316f06d2e6 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:58.827252 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-ff904754-72f3-4305-b1b0-9c316f06d2e6 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 19 10:13:58.827252 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:13:58.827252 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:13:58.827252 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:13:58.827252 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:13:58.827252 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:13:58.827252 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:13:58.827252 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:13:58.827252 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:13:58.827252 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:13:58.827252 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:13:58.827252 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:13:58.827252 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 10:13:58.827252 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 10:13:58.827252 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 10:13:58.827252 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 10:13:58.828320 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:13:58.828320 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:13:58.828320 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 10:13:58.828320 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 10:13:58.828320 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 10:13:58.828320 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 10:13:58.828320 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:13:58.828320 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:13:58.828320 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:13:58.828320 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:13:58.828320 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:13:58.828320 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 19 10:13:58.828320 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:13:58.828320 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:13:58.828320 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:13:58.828320 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:13:58.828320 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:13:58.828320 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:13:58.829273 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:13:58.829273 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:13:58.829273 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 10:13:58.829273 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 10:13:58.829273 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 10:13:58.829273 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 10:13:58.829273 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 10:13:58.829273 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 10:13:58.829273 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 19 10:13:58.829273 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 19 10:13:58.829273 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 336/658] 10.222.0.66 () {56 vars in 1102 bytes} [Mon Sep 19 10:13:58 2022] GET /identity/v3/users/neutron => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:13:58.830397 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047bffe1-8508-4c31-83e4-0ca65a041836 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:58.830679 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047bffe1-8508-4c31-83e4-0ca65a041836 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:58.830952 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047bffe1-8508-4c31-83e4-0ca65a041836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:58.836119 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:58.850576 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-047bffe1-8508-4c31-83e4-0ca65a041836 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:13:58.851784 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-047bffe1-8508-4c31-83e4-0ca65a041836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:13:58.881753 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9562633e-a00b-43ed-a2c3-c63b0acfe148 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:58.913802 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:58.916215 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3676fd0-cad8-4373-a583-a11566d5c22a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:58.916993 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3676fd0-cad8-4373-a583-a11566d5c22a None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:58.917278 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3676fd0-cad8-4373-a583-a11566d5c22a None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:58.917557 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3676fd0-cad8-4373-a583-a11566d5c22a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:58.919964 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 337/659] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:13:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 10:13:58.920810 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047bffe1-8508-4c31-83e4-0ca65a041836 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:58.933987 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3676fd0-cad8-4373-a583-a11566d5c22a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:58.935496 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3676fd0-cad8-4373-a583-a11566d5c22a None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:58.950525 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-f3676fd0-cad8-4373-a583-a11566d5c22a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 10:13:58.950525 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:13:58.950525 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:13:58.950525 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:13:58.950525 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:13:58.950525 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:13:58.950525 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:13:58.950525 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:13:58.950525 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:13:58.950525 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:13:58.950525 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:13:58.950525 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:13:58.950525 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 10:13:58.950525 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 10:13:58.950525 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 10:13:58.951416 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 10:13:58.951416 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:13:58.951416 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:13:58.951416 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:13:58.951416 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:13:58.951416 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:13:58.951416 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:13:58.951416 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:13:58.951416 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Sep 19 10:13:58.951416 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:13:58.951416 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:13:58.951416 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:13:58.951416 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:13:58.951416 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:13:58.951416 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:13:58.951416 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:13:58.951416 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:13:58.952353 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 10:13:58.952353 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 10:13:58.952353 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 10:13:58.952353 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 10:13:58.952353 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 10:13:58.952353 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 10:13:58.952353 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 10:13:58.952353 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Sep 19 10:13:58.952353 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 323/660] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Sep 19 10:13:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:13:58.953725 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3676fd0-cad8-4373-a583-a11566d5c22a None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:59.029784 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047bffe1-8508-4c31-83e4-0ca65a041836 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:59.058817 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3676fd0-cad8-4373-a583-a11566d5c22a None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:59.066340 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c0f809-3c2f-412c-a87b-3bbb523d7628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:59.066985 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c0f809-3c2f-412c-a87b-3bbb523d7628 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:59.067263 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c0f809-3c2f-412c-a87b-3bbb523d7628 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:59.067537 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c0f809-3c2f-412c-a87b-3bbb523d7628 None admin] PATH_INFO: `/v3/users` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:59.068285 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c0f809-3c2f-412c-a87b-3bbb523d7628 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:13:59.068591 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c0f809-3c2f-412c-a87b-3bbb523d7628 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:59.070015 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c0f809-3c2f-412c-a87b-3bbb523d7628 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:59.073101 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:59.093882 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a55c62d-8628-430d-bf7a-9781276649bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:59.094493 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a55c62d-8628-430d-bf7a-9781276649bd None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:59.095080 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a55c62d-8628-430d-bf7a-9781276649bd None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:59.095184 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 338/661] 10.222.0.66 () {56 vars in 1137 bytes} [Mon Sep 19 10:13:58 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:13:59.095341 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a55c62d-8628-430d-bf7a-9781276649bd None admin] PATH_INFO: `/v3/projects` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:59.096025 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c0f809-3c2f-412c-a87b-3bbb523d7628 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:59.096135 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a55c62d-8628-430d-bf7a-9781276649bd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:13:59.096469 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a55c62d-8628-430d-bf7a-9781276649bd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:59.098421 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a55c62d-8628-430d-bf7a-9781276649bd None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:59.110734 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 324/662] 10.222.0.66 () {56 vars in 1148 bytes} [Mon Sep 19 10:13:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:13:59.111582 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a55c62d-8628-430d-bf7a-9781276649bd None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:59.163361 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:59.211462 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c0f809-3c2f-412c-a87b-3bbb523d7628 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:59.217521 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a55c62d-8628-430d-bf7a-9781276649bd None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:59.245172 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcbbe2d-cb1c-441f-8535-f2f0be2eac89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:59.245777 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcbbe2d-cb1c-441f-8535-f2f0be2eac89 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:59.246057 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcbbe2d-cb1c-441f-8535-f2f0be2eac89 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:59.246330 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcbbe2d-cb1c-441f-8535-f2f0be2eac89 None admin] PATH_INFO: `/v3/users` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:59.247046 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcbbe2d-cb1c-441f-8535-f2f0be2eac89 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:13:59.247351 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcbbe2d-cb1c-441f-8535-f2f0be2eac89 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:59.248813 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcbbe2d-cb1c-441f-8535-f2f0be2eac89 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:59.250992 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983a5a29-a4de-4eea-9b03-95d1e058a022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:59.251591 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983a5a29-a4de-4eea-9b03-95d1e058a022 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:59.251868 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983a5a29-a4de-4eea-9b03-95d1e058a022 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:59.252133 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983a5a29-a4de-4eea-9b03-95d1e058a022 None admin] PATH_INFO: `/v3/projects` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:59.252835 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983a5a29-a4de-4eea-9b03-95d1e058a022 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:13:59.253132 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983a5a29-a4de-4eea-9b03-95d1e058a022 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:59.254551 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983a5a29-a4de-4eea-9b03-95d1e058a022 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:59.265491 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 339/663] 10.222.0.66 () {56 vars in 1139 bytes} [Mon Sep 19 10:13:59 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:13:59.271069 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 325/664] 10.222.0.66 () {56 vars in 1148 bytes} [Mon Sep 19 10:13:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:13:59.271221 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcbbe2d-cb1c-441f-8535-f2f0be2eac89 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:59.271313 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983a5a29-a4de-4eea-9b03-95d1e058a022 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:59.305189 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:59.369933 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcbbe2d-cb1c-441f-8535-f2f0be2eac89 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:59.370422 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983a5a29-a4de-4eea-9b03-95d1e058a022 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:59.383427 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:59.404738 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6020fe6-0326-411c-bd3a-a9ec5a47078d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:59.405014 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1535244b-b509-47f3-8623-c7a34f652e18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:59.405351 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6020fe6-0326-411c-bd3a-a9ec5a47078d None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:59.405491 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1535244b-b509-47f3-8623-c7a34f652e18 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:59.405627 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6020fe6-0326-411c-bd3a-a9ec5a47078d None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:59.405759 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1535244b-b509-47f3-8623-c7a34f652e18 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:59.405916 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6020fe6-0326-411c-bd3a-a9ec5a47078d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:59.406044 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1535244b-b509-47f3-8623-c7a34f652e18 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:59.406721 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1535244b-b509-47f3-8623-c7a34f652e18 None admin] RBAC: Adding query filter params (role.id=75952bc2767d49c1a6e49840d8a8f349, scope.project.id=be6b93ef3359434d9c776343f0aea333, user.id=15c70bfb085a44e9b84942b480ff22f1) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:13:59.407023 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1535244b-b509-47f3-8623-c7a34f652e18 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:59.408486 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1535244b-b509-47f3-8623-c7a34f652e18 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:59.414994 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 326/665] 10.222.0.66 () {56 vars in 1374 bytes} [Mon Sep 19 10:13:59 2022] GET /identity/v3/role_assignments?user.id=15c70bfb085a44e9b84942b480ff22f1&scope.project.id=be6b93ef3359434d9c776343f0aea333&role.id=75952bc2767d49c1a6e49840d8a8f349 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:13:59.416311 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1535244b-b509-47f3-8623-c7a34f652e18 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:59.487825 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6020fe6-0326-411c-bd3a-a9ec5a47078d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:59.490004 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6020fe6-0326-411c-bd3a-a9ec5a47078d None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:59.527522 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:59.532499 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1535244b-b509-47f3-8623-c7a34f652e18 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:59.572374 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44edd7e-fb9a-48bf-beb0-96c2bf509615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:59.573022 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44edd7e-fb9a-48bf-beb0-96c2bf509615 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:59.573295 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44edd7e-fb9a-48bf-beb0-96c2bf509615 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:59.573569 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44edd7e-fb9a-48bf-beb0-96c2bf509615 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:59.586551 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44edd7e-fb9a-48bf-beb0-96c2bf509615 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 10:13:59.592554 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-e44edd7e-fb9a-48bf-beb0-96c2bf509615 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 10:13:59.592554 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:13:59.592554 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:13:59.592554 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:13:59.592554 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:13:59.592554 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:13:59.592554 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:13:59.592554 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:13:59.592554 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:13:59.592554 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:13:59.592554 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:13:59.592554 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:13:59.592554 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 10:13:59.592554 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 10:13:59.592554 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 10:13:59.592554 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 10:13:59.593486 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 10:13:59.593486 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 10:13:59.593486 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 10:13:59.593486 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 10:13:59.593486 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:13:59.593486 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:13:59.593486 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:13:59.593486 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:13:59.593486 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:13:59.593486 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:13:59.593486 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:13:59.593486 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Sep 19 10:13:59.593486 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:13:59.593486 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:13:59.593486 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:13:59.593486 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:13:59.594319 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:13:59.594319 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:13:59.594319 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:13:59.594319 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:13:59.594319 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 10:13:59.594319 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 10:13:59.594319 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 10:13:59.594319 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 10:13:59.594319 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 10:13:59.594319 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 10:13:59.594319 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 10:13:59.594319 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Sep 19 10:13:59.594319 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 327/666] 10.222.0.66 () {56 vars in 1102 bytes} [Mon Sep 19 10:13:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:13:59.595539 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44edd7e-fb9a-48bf-beb0-96c2bf509615 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:59.610221 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 340/667] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Sep 19 10:13:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 10:13:59.610688 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6020fe6-0326-411c-bd3a-a9ec5a47078d None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:59.627190 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:59.713781 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44edd7e-fb9a-48bf-beb0-96c2bf509615 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:59.734377 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6020fe6-0326-411c-bd3a-a9ec5a47078d None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:59.750372 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0428d0-ed8d-4808-8dbf-3bb3288897be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:59.750988 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0428d0-ed8d-4808-8dbf-3bb3288897be None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:59.751378 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0428d0-ed8d-4808-8dbf-3bb3288897be None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:59.751652 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0428d0-ed8d-4808-8dbf-3bb3288897be None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:59.769582 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921d47b4-fe8d-4c37-bc55-f8b0518b9725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:59.770235 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921d47b4-fe8d-4c37-bc55-f8b0518b9725 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:59.770512 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921d47b4-fe8d-4c37-bc55-f8b0518b9725 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:59.770777 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921d47b4-fe8d-4c37-bc55-f8b0518b9725 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:59.771497 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921d47b4-fe8d-4c37-bc55-f8b0518b9725 None admin] RBAC: Adding query filter params (role.id=75952bc2767d49c1a6e49840d8a8f349, scope.project.id=be6b93ef3359434d9c776343f0aea333, user.id=2f95c0d9f2414f3ca2fa2d1546d47f1b) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:13:59.771800 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921d47b4-fe8d-4c37-bc55-f8b0518b9725 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:59.773254 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921d47b4-fe8d-4c37-bc55-f8b0518b9725 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:59.779670 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 341/668] 10.222.0.66 () {56 vars in 1374 bytes} [Mon Sep 19 10:13:59 2022] GET /identity/v3/role_assignments?user.id=2f95c0d9f2414f3ca2fa2d1546d47f1b&scope.project.id=be6b93ef3359434d9c776343f0aea333&role.id=75952bc2767d49c1a6e49840d8a8f349 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:13:59.780579 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921d47b4-fe8d-4c37-bc55-f8b0518b9725 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:59.789093 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:59.837754 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0428d0-ed8d-4808-8dbf-3bb3288897be None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:59.839514 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0428d0-ed8d-4808-8dbf-3bb3288897be None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:59.875773 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:13:59.911511 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921d47b4-fe8d-4c37-bc55-f8b0518b9725 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:13:59.959814 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315fad29-6eeb-4d1d-9e9d-6aee32d33e70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:13:59.961033 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315fad29-6eeb-4d1d-9e9d-6aee32d33e70 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:13:59.961316 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315fad29-6eeb-4d1d-9e9d-6aee32d33e70 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:13:59.961588 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315fad29-6eeb-4d1d-9e9d-6aee32d33e70 None admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:13:59.962299 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315fad29-6eeb-4d1d-9e9d-6aee32d33e70 None admin] RBAC: Adding query filter params (name=service) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:13:59.962604 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315fad29-6eeb-4d1d-9e9d-6aee32d33e70 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:13:59.964018 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315fad29-6eeb-4d1d-9e9d-6aee32d33e70 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:13:59.977213 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 328/669] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Sep 19 10:13:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 10:13:59.977213 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0428d0-ed8d-4808-8dbf-3bb3288897be None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:13:59.982413 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 342/670] 10.222.0.66 () {56 vars in 1103 bytes} [Mon Sep 19 10:13:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:13:59.983379 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315fad29-6eeb-4d1d-9e9d-6aee32d33e70 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:00.050019 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:00.100697 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315fad29-6eeb-4d1d-9e9d-6aee32d33e70 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:00.109576 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0428d0-ed8d-4808-8dbf-3bb3288897be None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:00.144598 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc99aa0-d6cd-4785-aa58-480252d6571d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:00.145846 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc99aa0-d6cd-4785-aa58-480252d6571d None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:00.146449 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc99aa0-d6cd-4785-aa58-480252d6571d None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:00.146865 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc99aa0-d6cd-4785-aa58-480252d6571d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:00.156808 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c53271d-b287-47d6-83c1-b0102507636c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:00.157720 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c53271d-b287-47d6-83c1-b0102507636c None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:00.157830 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:00.159110 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c53271d-b287-47d6-83c1-b0102507636c None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:00.159938 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c53271d-b287-47d6-83c1-b0102507636c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:00.161717 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc99aa0-d6cd-4785-aa58-480252d6571d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:00.163733 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc99aa0-d6cd-4785-aa58-480252d6571d None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:00.174681 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c53271d-b287-47d6-83c1-b0102507636c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:00.176758 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c53271d-b287-47d6-83c1-b0102507636c None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:00.180871 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-1cc99aa0-d6cd-4785-aa58-480252d6571d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 10:14:00.180871 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:14:00.180871 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:14:00.180871 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:14:00.180871 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:14:00.180871 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:14:00.180871 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:14:00.180871 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:14:00.180871 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:14:00.180871 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:14:00.180871 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:14:00.180871 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:14:00.180871 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 10:14:00.180871 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 10:14:00.180871 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 10:14:00.180871 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 10:14:00.181822 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:14:00.181822 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:14:00.181822 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:14:00.181822 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:14:00.181822 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:14:00.181822 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:14:00.181822 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:14:00.181822 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 19 10:14:00.181822 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:14:00.181822 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:14:00.181822 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:14:00.181822 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:14:00.181822 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:14:00.181822 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:14:00.181822 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:14:00.181822 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:14:00.181822 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 10:14:00.182873 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 10:14:00.182873 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 10:14:00.182873 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 19 10:14:00.182873 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 343/671] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 19 10:13:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:14:00.187862 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc99aa0-d6cd-4785-aa58-480252d6571d None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:00.204225 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-3c53271d-b287-47d6-83c1-b0102507636c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 10:14:00.204225 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:14:00.204225 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:14:00.204225 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:14:00.204225 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:14:00.204225 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:14:00.204225 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:14:00.204225 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:14:00.204225 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:14:00.204225 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:14:00.204225 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:14:00.204225 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:14:00.204225 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 10:14:00.204225 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 10:14:00.204225 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 10:14:00.204225 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 10:14:00.205218 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:14:00.205218 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:14:00.205218 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:14:00.205218 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:14:00.205218 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:14:00.205218 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:14:00.205218 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:14:00.205218 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Sep 19 10:14:00.205218 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:14:00.205218 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:14:00.205218 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:14:00.205218 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:14:00.205218 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:14:00.205218 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:14:00.205218 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:14:00.205218 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:14:00.205218 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 10:14:00.206179 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 10:14:00.206179 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 10:14:00.206179 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Sep 19 10:14:00.209236 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 329/672] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 19 10:13:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:14:00.210424 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c53271d-b287-47d6-83c1-b0102507636c None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:00.314586 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc99aa0-d6cd-4785-aa58-480252d6571d None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:00.339769 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c53271d-b287-47d6-83c1-b0102507636c None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:00.350689 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:00.355975 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afb9f18-df62-408d-8cee-a176b6044858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:00.357379 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afb9f18-df62-408d-8cee-a176b6044858 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:00.357896 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afb9f18-df62-408d-8cee-a176b6044858 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:00.358335 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afb9f18-df62-408d-8cee-a176b6044858 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:00.370943 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afb9f18-df62-408d-8cee-a176b6044858 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:00.372792 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afb9f18-df62-408d-8cee-a176b6044858 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:00.378626 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcea521c-272f-4d60-860d-21d22cb21184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:00.380017 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcea521c-272f-4d60-860d-21d22cb21184 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:00.380523 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcea521c-272f-4d60-860d-21d22cb21184 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:00.381043 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcea521c-272f-4d60-860d-21d22cb21184 None admin] PATH_INFO: `/v3/domains` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:00.382031 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcea521c-272f-4d60-860d-21d22cb21184 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:14:00.382571 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcea521c-272f-4d60-860d-21d22cb21184 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:00.384144 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcea521c-272f-4d60-860d-21d22cb21184 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:00.389048 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-4afb9f18-df62-408d-8cee-a176b6044858 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 10:14:00.389048 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:14:00.389048 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:14:00.389048 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:14:00.389048 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:14:00.389048 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:14:00.389048 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:14:00.389048 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:14:00.389048 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:14:00.389048 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:14:00.389048 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:14:00.389048 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:14:00.389048 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 10:14:00.389048 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 10:14:00.389048 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 10:14:00.389048 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 10:14:00.389993 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:14:00.389993 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:14:00.389993 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:14:00.389993 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:14:00.389993 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:14:00.389993 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:14:00.389993 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:14:00.389993 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 19 10:14:00.389993 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:14:00.389993 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:14:00.389993 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:14:00.389993 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:14:00.389993 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:14:00.389993 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:14:00.389993 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:14:00.389993 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:14:00.389993 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 10:14:00.390891 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 10:14:00.390891 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 10:14:00.390891 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 19 10:14:00.395880 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 344/673] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 19 10:14:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:14:00.396591 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afb9f18-df62-408d-8cee-a176b6044858 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:00.402706 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 330/674] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Sep 19 10:14:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:14:00.403988 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcea521c-272f-4d60-860d-21d22cb21184 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:00.462171 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:00.521741 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afb9f18-df62-408d-8cee-a176b6044858 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:00.522798 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcea521c-272f-4d60-860d-21d22cb21184 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:00.559435 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9f372e-b9d2-4474-9223-31a8d76a9ef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:00.559760 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8d4a36-8c39-4665-baac-f2906503ce45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:00.560390 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8d4a36-8c39-4665-baac-f2906503ce45 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:00.560670 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8d4a36-8c39-4665-baac-f2906503ce45 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:00.560998 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8d4a36-8c39-4665-baac-f2906503ce45 None admin] PATH_INFO: `/v3/domains` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:00.561280 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9f372e-b9d2-4474-9223-31a8d76a9ef8 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:00.561633 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8d4a36-8c39-4665-baac-f2906503ce45 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:14:00.561933 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8d4a36-8c39-4665-baac-f2906503ce45 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:00.562141 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9f372e-b9d2-4474-9223-31a8d76a9ef8 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:00.562592 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9f372e-b9d2-4474-9223-31a8d76a9ef8 None admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:00.563314 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8d4a36-8c39-4665-baac-f2906503ce45 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:00.563828 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9f372e-b9d2-4474-9223-31a8d76a9ef8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:14:00.564405 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9f372e-b9d2-4474-9223-31a8d76a9ef8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:00.566297 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9f372e-b9d2-4474-9223-31a8d76a9ef8 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:00.580526 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 345/675] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Sep 19 10:14:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:14:00.580817 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 331/676] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Sep 19 10:14:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:14:00.581742 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8d4a36-8c39-4665-baac-f2906503ce45 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:00.582167 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9f372e-b9d2-4474-9223-31a8d76a9ef8 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:00.615922 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:00.690383 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9f372e-b9d2-4474-9223-31a8d76a9ef8 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:00.693918 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:00.702358 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8d4a36-8c39-4665-baac-f2906503ce45 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:00.729024 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840682f5-0e87-4d45-93fe-4dba2002cc8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:00.729728 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840682f5-0e87-4d45-93fe-4dba2002cc8b None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:00.730175 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840682f5-0e87-4d45-93fe-4dba2002cc8b None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:00.730545 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840682f5-0e87-4d45-93fe-4dba2002cc8b None admin] PATH_INFO: `/v3/users/swift` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:00.739336 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840682f5-0e87-4d45-93fe-4dba2002cc8b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:00.740954 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840682f5-0e87-4d45-93fe-4dba2002cc8b None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:00.741243 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7e9d39-0b72-4a68-a4d0-e74db479098b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:00.742031 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7e9d39-0b72-4a68-a4d0-e74db479098b None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:00.742446 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7e9d39-0b72-4a68-a4d0-e74db479098b None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:00.743028 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7e9d39-0b72-4a68-a4d0-e74db479098b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:00.750320 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7e9d39-0b72-4a68-a4d0-e74db479098b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:00.751944 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7e9d39-0b72-4a68-a4d0-e74db479098b None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:00.753918 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-840682f5-0e87-4d45-93fe-4dba2002cc8b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 19 10:14:00.753918 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:14:00.753918 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:14:00.753918 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:14:00.753918 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:14:00.753918 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:14:00.753918 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:14:00.753918 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:14:00.753918 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:14:00.753918 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:14:00.753918 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:14:00.753918 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:14:00.753918 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 10:14:00.753918 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 10:14:00.753918 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 10:14:00.753918 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 10:14:00.755639 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:14:00.755639 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:14:00.755639 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 10:14:00.755639 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 10:14:00.755639 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 10:14:00.755639 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 10:14:00.755639 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:14:00.755639 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:14:00.755639 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:14:00.755639 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:14:00.755639 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:14:00.755639 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 19 10:14:00.755639 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:14:00.755639 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:14:00.755639 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:14:00.755639 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:14:00.755639 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:14:00.755639 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:14:00.756633 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:14:00.756633 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:14:00.756633 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 10:14:00.756633 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 10:14:00.756633 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 10:14:00.756633 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 10:14:00.756633 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 10:14:00.756633 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 10:14:00.756633 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 19 10:14:00.756633 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 19 10:14:00.761447 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 346/677] 10.222.0.66 () {56 vars in 1096 bytes} [Mon Sep 19 10:14:00 2022] GET /identity/v3/users/swift => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:14:00.762346 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840682f5-0e87-4d45-93fe-4dba2002cc8b None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:00.768536 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-2b7e9d39-0b72-4a68-a4d0-e74db479098b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 10:14:00.768536 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:14:00.768536 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:14:00.768536 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:14:00.768536 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:14:00.768536 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:14:00.768536 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:14:00.768536 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:14:00.768536 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:14:00.768536 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:14:00.768536 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:14:00.768536 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:14:00.768536 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 10:14:00.768536 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 10:14:00.768536 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 10:14:00.769440 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 10:14:00.769440 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:14:00.769440 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:14:00.769440 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:14:00.769440 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:14:00.769440 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:14:00.769440 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:14:00.769440 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:14:00.769440 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Sep 19 10:14:00.769440 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:14:00.769440 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:14:00.769440 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:14:00.769440 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:14:00.769440 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:14:00.769440 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:14:00.769440 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:14:00.769440 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:14:00.770362 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 10:14:00.770362 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 10:14:00.770362 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 10:14:00.770362 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 10:14:00.770362 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 10:14:00.770362 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 10:14:00.770362 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 10:14:00.770362 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Sep 19 10:14:00.772822 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 332/678] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Sep 19 10:14:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:14:00.773858 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7e9d39-0b72-4a68-a4d0-e74db479098b None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:00.878767 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:00.884090 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840682f5-0e87-4d45-93fe-4dba2002cc8b None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:00.893793 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7e9d39-0b72-4a68-a4d0-e74db479098b None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:00.933822 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48abe75b-45c3-4c75-bd1b-a8afe9d153fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:00.934466 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48abe75b-45c3-4c75-bd1b-a8afe9d153fd None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:00.934796 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48abe75b-45c3-4c75-bd1b-a8afe9d153fd None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:00.935340 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48abe75b-45c3-4c75-bd1b-a8afe9d153fd None admin] PATH_INFO: `/v3/projects/service` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:00.940631 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5f2476-7f5d-4d71-9bfd-9e3bb0c8a6d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:00.941595 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5f2476-7f5d-4d71-9bfd-9e3bb0c8a6d3 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:00.942748 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5f2476-7f5d-4d71-9bfd-9e3bb0c8a6d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:00.943062 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48abe75b-45c3-4c75-bd1b-a8afe9d153fd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:00.943352 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5f2476-7f5d-4d71-9bfd-9e3bb0c8a6d3 None admin] PATH_INFO: `/v3/users` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:00.944246 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5f2476-7f5d-4d71-9bfd-9e3bb0c8a6d3 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:14:00.944601 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48abe75b-45c3-4c75-bd1b-a8afe9d153fd None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:00.944873 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5f2476-7f5d-4d71-9bfd-9e3bb0c8a6d3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:00.946612 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5f2476-7f5d-4d71-9bfd-9e3bb0c8a6d3 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:00.958018 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-48abe75b-45c3-4c75-bd1b-a8afe9d153fd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 10:14:00.958018 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:14:00.958018 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:14:00.958018 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:14:00.958018 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:14:00.958018 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:14:00.958018 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:14:00.958018 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:14:00.958018 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:14:00.958018 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:14:00.958018 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:14:00.958018 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:14:00.958018 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 10:14:00.958018 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 10:14:00.958018 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 10:14:00.959114 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 10:14:00.959114 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:14:00.959114 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:14:00.959114 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:14:00.959114 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:14:00.959114 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:14:00.959114 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:14:00.959114 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:14:00.959114 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 19 10:14:00.959114 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:14:00.959114 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:14:00.959114 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:14:00.959114 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:14:00.959114 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:14:00.959114 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:14:00.959114 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:14:00.959114 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:14:00.960456 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 10:14:00.960456 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 10:14:00.960456 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 10:14:00.960456 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 10:14:00.960456 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 10:14:00.960456 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 10:14:00.960456 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 10:14:00.960456 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 19 10:14:00.960456 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 347/679] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Sep 19 10:14:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:14:00.960456 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48abe75b-45c3-4c75-bd1b-a8afe9d153fd None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:00.976891 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 333/680] 10.222.0.66 () {56 vars in 1135 bytes} [Mon Sep 19 10:14:00 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:14:00.977228 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5f2476-7f5d-4d71-9bfd-9e3bb0c8a6d3 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:00.995863 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:01.083802 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48abe75b-45c3-4c75-bd1b-a8afe9d153fd None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:01.115436 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5f2476-7f5d-4d71-9bfd-9e3bb0c8a6d3 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:01.121914 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be1a4dd-1a60-45d6-a56b-0a63167c7890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:01.122660 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be1a4dd-1a60-45d6-a56b-0a63167c7890 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:01.123066 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be1a4dd-1a60-45d6-a56b-0a63167c7890 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:01.123447 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be1a4dd-1a60-45d6-a56b-0a63167c7890 None admin] PATH_INFO: `/v3/projects` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:01.124350 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be1a4dd-1a60-45d6-a56b-0a63167c7890 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:14:01.124758 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be1a4dd-1a60-45d6-a56b-0a63167c7890 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:01.126314 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be1a4dd-1a60-45d6-a56b-0a63167c7890 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:01.141075 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 348/681] 10.222.0.66 () {56 vars in 1148 bytes} [Mon Sep 19 10:14:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:14:01.142038 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be1a4dd-1a60-45d6-a56b-0a63167c7890 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:01.168936 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da3e2ea-875a-42f2-bf8d-ae078f06fa08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:01.170047 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da3e2ea-875a-42f2-bf8d-ae078f06fa08 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:01.171048 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da3e2ea-875a-42f2-bf8d-ae078f06fa08 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:01.171477 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da3e2ea-875a-42f2-bf8d-ae078f06fa08 None admin] PATH_INFO: `/v3/projects` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:01.172636 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da3e2ea-875a-42f2-bf8d-ae078f06fa08 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:14:01.173089 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da3e2ea-875a-42f2-bf8d-ae078f06fa08 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:01.175566 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da3e2ea-875a-42f2-bf8d-ae078f06fa08 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:01.193404 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 334/682] 10.222.0.66 () {56 vars in 1148 bytes} [Mon Sep 19 10:14:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:14:01.194998 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da3e2ea-875a-42f2-bf8d-ae078f06fa08 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:01.209992 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:01.242673 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:01.260943 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be1a4dd-1a60-45d6-a56b-0a63167c7890 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:01.299045 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee980d0-ab43-42ac-b262-c2cd46ba33a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:01.299654 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee980d0-ab43-42ac-b262-c2cd46ba33a2 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:01.299931 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee980d0-ab43-42ac-b262-c2cd46ba33a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:01.300235 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee980d0-ab43-42ac-b262-c2cd46ba33a2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:01.332049 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da3e2ea-875a-42f2-bf8d-ae078f06fa08 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:01.369148 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77474645-a6d9-4adc-9054-1c79f7d90db6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:01.369807 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77474645-a6d9-4adc-9054-1c79f7d90db6 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:01.370084 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77474645-a6d9-4adc-9054-1c79f7d90db6 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:01.370354 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77474645-a6d9-4adc-9054-1c79f7d90db6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:01.371491 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77474645-a6d9-4adc-9054-1c79f7d90db6 None admin] RBAC: Adding query filter params (role.id=75952bc2767d49c1a6e49840d8a8f349, scope.project.id=be6b93ef3359434d9c776343f0aea333, user.id=0c1289b015854c6bb6aee8fed6b807db) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:14:01.371491 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77474645-a6d9-4adc-9054-1c79f7d90db6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:01.372991 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77474645-a6d9-4adc-9054-1c79f7d90db6 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:01.379800 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 335/683] 10.222.0.66 () {56 vars in 1374 bytes} [Mon Sep 19 10:14:01 2022] GET /identity/v3/role_assignments?user.id=0c1289b015854c6bb6aee8fed6b807db&scope.project.id=be6b93ef3359434d9c776343f0aea333&role.id=75952bc2767d49c1a6e49840d8a8f349 => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:14:01.380415 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77474645-a6d9-4adc-9054-1c79f7d90db6 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:01.394071 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee980d0-ab43-42ac-b262-c2cd46ba33a2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:01.396150 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee980d0-ab43-42ac-b262-c2cd46ba33a2 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:01.469656 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:01.493863 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:01.506490 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77474645-a6d9-4adc-9054-1c79f7d90db6 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:01.518114 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 349/684] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Sep 19 10:14:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 10:14:01.520640 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee980d0-ab43-42ac-b262-c2cd46ba33a2 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:01.569473 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b54f342-27f5-4450-bf81-b99c8b9cc153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:01.570102 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b54f342-27f5-4450-bf81-b99c8b9cc153 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:01.570381 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b54f342-27f5-4450-bf81-b99c8b9cc153 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:01.573037 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b54f342-27f5-4450-bf81-b99c8b9cc153 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:01.573849 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b54f342-27f5-4450-bf81-b99c8b9cc153 None admin] RBAC: Adding query filter params (role.id=75952bc2767d49c1a6e49840d8a8f349, scope.project.id=be6b93ef3359434d9c776343f0aea333, user.id=dfa4d004fd44482cae761c4b3bdfab31) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:14:01.574159 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b54f342-27f5-4450-bf81-b99c8b9cc153 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:01.575633 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b54f342-27f5-4450-bf81-b99c8b9cc153 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:01.592870 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 336/685] 10.222.0.66 () {56 vars in 1374 bytes} [Mon Sep 19 10:14:01 2022] GET /identity/v3/role_assignments?user.id=dfa4d004fd44482cae761c4b3bdfab31&scope.project.id=be6b93ef3359434d9c776343f0aea333&role.id=75952bc2767d49c1a6e49840d8a8f349 => generated 608 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:14:01.671769 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee980d0-ab43-42ac-b262-c2cd46ba33a2 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:01.713322 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91de839-5137-412f-ab99-258fdc75b362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:01.713967 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91de839-5137-412f-ab99-258fdc75b362 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:01.714243 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91de839-5137-412f-ab99-258fdc75b362 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:01.714512 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91de839-5137-412f-ab99-258fdc75b362 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:01.726504 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91de839-5137-412f-ab99-258fdc75b362 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:01.727984 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91de839-5137-412f-ab99-258fdc75b362 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:01.747979 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-c91de839-5137-412f-ab99-258fdc75b362 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 10:14:01.747979 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:14:01.747979 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:14:01.747979 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:14:01.747979 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:14:01.747979 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:14:01.747979 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:14:01.747979 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:14:01.747979 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:14:01.747979 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:14:01.747979 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:14:01.747979 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:14:01.747979 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 10:14:01.747979 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 10:14:01.747979 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 10:14:01.747979 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 10:14:01.749031 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:14:01.749031 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:14:01.749031 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:14:01.749031 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:14:01.749031 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:14:01.749031 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:14:01.749031 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:14:01.749031 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 19 10:14:01.749031 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:14:01.749031 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:14:01.749031 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:14:01.749031 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:14:01.749031 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:14:01.749031 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:14:01.749031 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:14:01.749031 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:14:01.749031 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 10:14:01.749988 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 10:14:01.749988 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 10:14:01.749988 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 19 10:14:01.750345 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 350/686] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 19 10:14:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:14:01.758392 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b54f342-27f5-4450-bf81-b99c8b9cc153 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:01.884535 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefca646-d919-41aa-a191-8d779c5ee6ca None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:01.884871 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefca646-d919-41aa-a191-8d779c5ee6ca None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:01.885089 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefca646-d919-41aa-a191-8d779c5ee6ca None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:01.886677 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 351/687] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:14:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:14:01.888500 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b54f342-27f5-4450-bf81-b99c8b9cc153 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:01.892341 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40536e8-e6cc-467c-a6a4-3a6f9ee8acbc None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:01.892623 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40536e8-e6cc-467c-a6a4-3a6f9ee8acbc None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:01.892896 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40536e8-e6cc-467c-a6a4-3a6f9ee8acbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:01.926799 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-d40536e8-e6cc-467c-a6a4-3a6f9ee8acbc None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:14:01.928025 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-d40536e8-e6cc-467c-a6a4-3a6f9ee8acbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:14:01.933368 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847d925b-8417-4afd-ae00-78019636231c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:01.934286 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847d925b-8417-4afd-ae00-78019636231c None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:01.934767 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847d925b-8417-4afd-ae00-78019636231c None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:01.935296 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847d925b-8417-4afd-ae00-78019636231c None admin] PATH_INFO: `/v3/domains` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:01.936159 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847d925b-8417-4afd-ae00-78019636231c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:14:01.936685 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847d925b-8417-4afd-ae00-78019636231c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:01.938824 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847d925b-8417-4afd-ae00-78019636231c None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:01.942879 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:01.961385 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 337/688] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Sep 19 10:14:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:14:01.963122 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847d925b-8417-4afd-ae00-78019636231c None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:01.969367 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:02.019524 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 352/689] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:14:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 10:14:02.080812 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847d925b-8417-4afd-ae00-78019636231c None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:02.134312 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c0a5ef-0b35-4aa5-bd5a-055352012f32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:02.135035 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c0a5ef-0b35-4aa5-bd5a-055352012f32 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:02.135291 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c0a5ef-0b35-4aa5-bd5a-055352012f32 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:02.135494 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c0a5ef-0b35-4aa5-bd5a-055352012f32 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:02.143416 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c0a5ef-0b35-4aa5-bd5a-055352012f32 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:02.145486 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c0a5ef-0b35-4aa5-bd5a-055352012f32 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:02.158118 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-73c0a5ef-0b35-4aa5-bd5a-055352012f32 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 10:14:02.158118 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:14:02.158118 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:14:02.158118 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:14:02.158118 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:14:02.158118 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:14:02.158118 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:14:02.158118 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:14:02.158118 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:14:02.158118 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:14:02.158118 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:14:02.158118 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:14:02.158118 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 10:14:02.158118 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 10:14:02.158118 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 10:14:02.159109 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 10:14:02.159109 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:14:02.159109 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:14:02.159109 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:14:02.159109 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:14:02.159109 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:14:02.159109 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:14:02.159109 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:14:02.159109 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Sep 19 10:14:02.159109 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:14:02.159109 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:14:02.159109 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:14:02.159109 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:14:02.159109 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:14:02.159109 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:14:02.159109 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:14:02.159109 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:14:02.160223 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 10:14:02.160223 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 10:14:02.160223 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 10:14:02.160223 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 10:14:02.160223 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 10:14:02.160223 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 10:14:02.160223 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 10:14:02.160223 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Sep 19 10:14:02.160223 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 338/690] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Sep 19 10:14:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:14:02.166889 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40536e8-e6cc-467c-a6a4-3a6f9ee8acbc None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:02.269752 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0b6c9a-bae4-4402-ada4-9dff25f967d0 None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:02.270078 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0b6c9a-bae4-4402-ada4-9dff25f967d0 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:02.270305 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0b6c9a-bae4-4402-ada4-9dff25f967d0 None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:02.271898 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 339/691] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:14:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 10:14:02.279841 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d5ecff-a765-47dd-847a-66061704b1cf None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:02.280134 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d5ecff-a765-47dd-847a-66061704b1cf None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:02.280457 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d5ecff-a765-47dd-847a-66061704b1cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:02.298393 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40536e8-e6cc-467c-a6a4-3a6f9ee8acbc None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:02.314177 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-f3d5ecff-a765-47dd-847a-66061704b1cf None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:14:02.315368 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-f3d5ecff-a765-47dd-847a-66061704b1cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:14:02.338324 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c748b2d-484b-46e8-9c9b-261370b32966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:02.339290 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c748b2d-484b-46e8-9c9b-261370b32966 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:02.339858 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c748b2d-484b-46e8-9c9b-261370b32966 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:02.340352 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c748b2d-484b-46e8-9c9b-261370b32966 None admin] PATH_INFO: `/v3/projects` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:02.341308 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c748b2d-484b-46e8-9c9b-261370b32966 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:14:02.341833 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c748b2d-484b-46e8-9c9b-261370b32966 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:02.343744 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c748b2d-484b-46e8-9c9b-261370b32966 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:02.362936 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 353/692] 10.222.0.66 () {56 vars in 1148 bytes} [Mon Sep 19 10:14:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:14:02.364543 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c748b2d-484b-46e8-9c9b-261370b32966 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:02.396602 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:02.425422 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:02.462970 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 340/693] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:14:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 10:14:02.468769 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d5ecff-a765-47dd-847a-66061704b1cf None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:02.574141 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c748b2d-484b-46e8-9c9b-261370b32966 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:02.583084 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d5ecff-a765-47dd-847a-66061704b1cf None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:02.621640 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0497f20-4551-4fd7-90b5-fc6c4953a555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:02.622681 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0497f20-4551-4fd7-90b5-fc6c4953a555 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:02.623168 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0497f20-4551-4fd7-90b5-fc6c4953a555 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:02.623635 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0497f20-4551-4fd7-90b5-fc6c4953a555 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:02.636038 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0497f20-4551-4fd7-90b5-fc6c4953a555 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 10:14:02.641297 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-d0497f20-4551-4fd7-90b5-fc6c4953a555 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 10:14:02.641297 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:14:02.641297 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:14:02.641297 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:14:02.641297 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:14:02.641297 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:14:02.641297 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:14:02.641297 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:14:02.641297 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:14:02.641297 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:14:02.641297 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:14:02.641297 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:14:02.641297 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 10:14:02.641297 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 10:14:02.641297 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 10:14:02.641297 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 10:14:02.642213 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 10:14:02.642213 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 10:14:02.642213 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 10:14:02.642213 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 10:14:02.642213 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:14:02.642213 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:14:02.642213 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:14:02.642213 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:14:02.642213 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:14:02.642213 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:14:02.642213 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:14:02.642213 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Sep 19 10:14:02.642213 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:14:02.642213 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:14:02.642213 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:14:02.642213 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:14:02.643048 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:14:02.643048 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:14:02.643048 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:14:02.643048 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:14:02.643048 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 10:14:02.643048 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 10:14:02.643048 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 10:14:02.643048 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 10:14:02.643048 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 10:14:02.643048 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 10:14:02.643048 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 10:14:02.643048 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Sep 19 10:14:02.645834 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 341/694] 10.222.0.66 () {56 vars in 1096 bytes} [Mon Sep 19 10:14:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 10:14:02.651092 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0497f20-4551-4fd7-90b5-fc6c4953a555 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:02.704513 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:02.704870 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e97576e-21d7-4a56-8b38-5195b66a2e9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:02.705575 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e97576e-21d7-4a56-8b38-5195b66a2e9c None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:02.705741 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e97576e-21d7-4a56-8b38-5195b66a2e9c None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:02.706062 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e97576e-21d7-4a56-8b38-5195b66a2e9c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:02.706748 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e97576e-21d7-4a56-8b38-5195b66a2e9c None admin] RBAC: Adding query filter params (role.id=75952bc2767d49c1a6e49840d8a8f349, scope.project.id=be6b93ef3359434d9c776343f0aea333, user.id=6677354e36614c9fb3d03413749be5ca) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:14:02.707054 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e97576e-21d7-4a56-8b38-5195b66a2e9c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:02.709137 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e97576e-21d7-4a56-8b38-5195b66a2e9c None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:02.720321 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 354/695] 10.222.0.66 () {56 vars in 1374 bytes} [Mon Sep 19 10:14:02 2022] GET /identity/v3/role_assignments?user.id=6677354e36614c9fb3d03413749be5ca&scope.project.id=be6b93ef3359434d9c776343f0aea333&role.id=75952bc2767d49c1a6e49840d8a8f349 => generated 608 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:14:02.761556 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e97576e-21d7-4a56-8b38-5195b66a2e9c None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:02.811452 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0497f20-4551-4fd7-90b5-fc6c4953a555 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:02.877366 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c167e93-ce54-4373-8132-c31ee75b2ed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:02.878372 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c167e93-ce54-4373-8132-c31ee75b2ed9 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:02.878849 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c167e93-ce54-4373-8132-c31ee75b2ed9 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:02.879345 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c167e93-ce54-4373-8132-c31ee75b2ed9 None admin] PATH_INFO: `/v3/roles` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:02.880307 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c167e93-ce54-4373-8132-c31ee75b2ed9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:14:02.880826 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c167e93-ce54-4373-8132-c31ee75b2ed9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:02.882415 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c167e93-ce54-4373-8132-c31ee75b2ed9 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:02.896400 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 342/696] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Sep 19 10:14:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 10:14:02.899277 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c167e93-ce54-4373-8132-c31ee75b2ed9 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:02.975791 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:02.989283 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e97576e-21d7-4a56-8b38-5195b66a2e9c None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:03.025273 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c167e93-ce54-4373-8132-c31ee75b2ed9 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:03.034016 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c6e5b6-95ce-4e74-9c0a-16c771b242c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:03.034656 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c6e5b6-95ce-4e74-9c0a-16c771b242c8 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:03.034937 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c6e5b6-95ce-4e74-9c0a-16c771b242c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:03.035211 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c6e5b6-95ce-4e74-9c0a-16c771b242c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:03.040487 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:03.049579 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c6e5b6-95ce-4e74-9c0a-16c771b242c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:03.051569 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c6e5b6-95ce-4e74-9c0a-16c771b242c8 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:03.070314 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-06c6e5b6-95ce-4e74-9c0a-16c771b242c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 10:14:03.070314 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:14:03.070314 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:14:03.070314 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:14:03.070314 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:14:03.070314 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:14:03.070314 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:14:03.070314 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:14:03.070314 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:14:03.070314 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:14:03.070314 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:14:03.070314 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:14:03.070314 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 10:14:03.070314 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 10:14:03.070314 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 10:14:03.070314 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 10:14:03.071315 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:14:03.071315 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:14:03.071315 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:14:03.071315 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:14:03.071315 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:14:03.071315 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:14:03.071315 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:14:03.071315 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 19 10:14:03.071315 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:14:03.071315 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:14:03.071315 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:14:03.071315 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:14:03.071315 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:14:03.071315 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:14:03.071315 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:14:03.071315 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:14:03.071315 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 10:14:03.072267 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 10:14:03.072267 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 10:14:03.072267 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 19 10:14:03.072441 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923f1a1b-f49a-43b5-91d2-1583a7bcb397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:03.072441 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923f1a1b-f49a-43b5-91d2-1583a7bcb397 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:03.072441 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923f1a1b-f49a-43b5-91d2-1583a7bcb397 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:03.072441 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923f1a1b-f49a-43b5-91d2-1583a7bcb397 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:03.072698 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 355/697] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 19 10:14:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 10:14:03.078621 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c6e5b6-95ce-4e74-9c0a-16c771b242c8 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:03.091212 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923f1a1b-f49a-43b5-91d2-1583a7bcb397 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:03.092726 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923f1a1b-f49a-43b5-91d2-1583a7bcb397 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:03.109434 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-923f1a1b-f49a-43b5-91d2-1583a7bcb397 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 10:14:03.109434 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:14:03.109434 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:14:03.109434 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:14:03.109434 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:14:03.109434 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:14:03.109434 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:14:03.109434 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:14:03.109434 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:14:03.109434 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:14:03.109434 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:14:03.109434 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:14:03.109434 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 10:14:03.109434 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 10:14:03.109434 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 10:14:03.109434 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 10:14:03.110479 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:14:03.110479 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:14:03.110479 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:14:03.110479 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:14:03.110479 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:14:03.110479 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:14:03.110479 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:14:03.110479 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Sep 19 10:14:03.110479 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:14:03.110479 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:14:03.110479 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:14:03.110479 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:14:03.110479 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:14:03.110479 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:14:03.110479 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:14:03.110479 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:14:03.110479 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 10:14:03.111376 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 10:14:03.111376 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 10:14:03.111376 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Sep 19 10:14:03.114486 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 343/698] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 19 10:14:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 10:14:03.117438 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923f1a1b-f49a-43b5-91d2-1583a7bcb397 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:03.202476 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c6e5b6-95ce-4e74-9c0a-16c771b242c8 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:03.234954 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923f1a1b-f49a-43b5-91d2-1583a7bcb397 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:03.242237 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6365bdba-d581-453f-9105-0b4fc615e253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:03.243186 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6365bdba-d581-453f-9105-0b4fc615e253 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:03.243666 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6365bdba-d581-453f-9105-0b4fc615e253 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:03.244141 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6365bdba-d581-453f-9105-0b4fc615e253 None admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:03.245032 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6365bdba-d581-453f-9105-0b4fc615e253 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:14:03.245535 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6365bdba-d581-453f-9105-0b4fc615e253 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:03.247139 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6365bdba-d581-453f-9105-0b4fc615e253 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:03.261372 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 356/699] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Sep 19 10:14:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:14:03.267744 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6365bdba-d581-453f-9105-0b4fc615e253 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:03.271440 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:03.273167 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea04d7c-ed6c-418a-9db3-e8e001fde1d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:03.274037 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea04d7c-ed6c-418a-9db3-e8e001fde1d4 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:03.274480 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea04d7c-ed6c-418a-9db3-e8e001fde1d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:03.275890 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea04d7c-ed6c-418a-9db3-e8e001fde1d4 None admin] PATH_INFO: `/v3/domains` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:03.276786 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea04d7c-ed6c-418a-9db3-e8e001fde1d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:14:03.277234 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea04d7c-ed6c-418a-9db3-e8e001fde1d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:03.278760 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea04d7c-ed6c-418a-9db3-e8e001fde1d4 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:03.300311 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 344/700] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Sep 19 10:14:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:14:03.301936 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea04d7c-ed6c-418a-9db3-e8e001fde1d4 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:03.324958 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:03.385144 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6365bdba-d581-453f-9105-0b4fc615e253 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:03.408681 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea04d7c-ed6c-418a-9db3-e8e001fde1d4 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:03.423995 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c9f949-069b-4f6b-a9b9-a6af194fc543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:03.424640 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c9f949-069b-4f6b-a9b9-a6af194fc543 None admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:03.424921 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c9f949-069b-4f6b-a9b9-a6af194fc543 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:03.425351 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c9f949-069b-4f6b-a9b9-a6af194fc543 None admin] PATH_INFO: `/v3/users` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:03.426565 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c9f949-069b-4f6b-a9b9-a6af194fc543 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:03.428716 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c9f949-069b-4f6b-a9b9-a6af194fc543 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:03.450555 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b497b864-081e-4d6e-b5cc-b6e53d795472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:03.451620 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b497b864-081e-4d6e-b5cc-b6e53d795472 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:03.452097 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b497b864-081e-4d6e-b5cc-b6e53d795472 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:03.452598 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b497b864-081e-4d6e-b5cc-b6e53d795472 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:03.452891 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 357/701] 10.222.0.66 () {60 vars in 1132 bytes} [Mon Sep 19 10:14:03 2022] POST /identity/v3/users => generated 254 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 10:14:03.464884 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b497b864-081e-4d6e-b5cc-b6e53d795472 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:03.467188 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b497b864-081e-4d6e-b5cc-b6e53d795472 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:03.482121 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-b497b864-081e-4d6e-b5cc-b6e53d795472 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 19 10:14:03.482121 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:14:03.482121 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:14:03.482121 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:14:03.482121 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:14:03.482121 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:14:03.482121 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:14:03.482121 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:14:03.482121 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:14:03.482121 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:14:03.482121 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:14:03.482121 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:14:03.482121 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 10:14:03.482121 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 10:14:03.482121 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 10:14:03.482121 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 10:14:03.483127 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:14:03.483127 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:14:03.483127 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 10:14:03.483127 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 10:14:03.483127 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 10:14:03.483127 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 10:14:03.483127 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:14:03.483127 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:14:03.483127 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:14:03.483127 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:14:03.483127 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:14:03.483127 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Sep 19 10:14:03.483127 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:14:03.483127 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:14:03.483127 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:14:03.483127 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:14:03.483127 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:14:03.483127 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:14:03.484180 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:14:03.484180 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:14:03.484180 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 10:14:03.484180 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 10:14:03.484180 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 10:14:03.484180 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 10:14:03.484180 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 10:14:03.484180 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 10:14:03.484180 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 19 10:14:03.484180 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Sep 19 10:14:03.492387 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 345/702] 10.222.0.66 () {56 vars in 1093 bytes} [Mon Sep 19 10:14:03 2022] GET /identity/v3/users/nova => generated 82 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:14:03.497327 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c9f949-069b-4f6b-a9b9-a6af194fc543 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:03.578344 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:03.640995 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c9f949-069b-4f6b-a9b9-a6af194fc543 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:03.689027 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb51f0f-db6a-41fd-af0c-1e39e99a9543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:03.689723 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb51f0f-db6a-41fd-af0c-1e39e99a9543 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:03.689968 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb51f0f-db6a-41fd-af0c-1e39e99a9543 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:03.690193 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb51f0f-db6a-41fd-af0c-1e39e99a9543 None admin] PATH_INFO: `/v3/users` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:03.690998 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb51f0f-db6a-41fd-af0c-1e39e99a9543 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:14:03.691300 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb51f0f-db6a-41fd-af0c-1e39e99a9543 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:03.693035 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb51f0f-db6a-41fd-af0c-1e39e99a9543 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:03.719443 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 358/703] 10.222.0.66 () {56 vars in 1133 bytes} [Mon Sep 19 10:14:03 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:14:03.729309 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b497b864-081e-4d6e-b5cc-b6e53d795472 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:03.825754 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:03.846912 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b497b864-081e-4d6e-b5cc-b6e53d795472 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:03.882759 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f20c32-da88-4d9d-8701-d094c742ce12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:03.883507 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f20c32-da88-4d9d-8701-d094c742ce12 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:03.883942 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f20c32-da88-4d9d-8701-d094c742ce12 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:03.884337 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f20c32-da88-4d9d-8701-d094c742ce12 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:03.965527 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f20c32-da88-4d9d-8701-d094c742ce12 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:03.967169 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f20c32-da88-4d9d-8701-d094c742ce12 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:04.057881 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:04.084597 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 346/704] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Sep 19 10:14:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 10:14:04.089974 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb51f0f-db6a-41fd-af0c-1e39e99a9543 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:04.221108 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb51f0f-db6a-41fd-af0c-1e39e99a9543 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:04.243909 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:04.264087 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c002648f-f1f7-4905-9fd5-7437a5ff3a8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:04.264892 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c002648f-f1f7-4905-9fd5-7437a5ff3a8a None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:04.265264 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c002648f-f1f7-4905-9fd5-7437a5ff3a8a None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:04.265649 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c002648f-f1f7-4905-9fd5-7437a5ff3a8a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:04.276704 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c002648f-f1f7-4905-9fd5-7437a5ff3a8a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:04.278282 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c002648f-f1f7-4905-9fd5-7437a5ff3a8a None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:04.295785 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-c002648f-f1f7-4905-9fd5-7437a5ff3a8a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 10:14:04.295785 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:14:04.295785 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:14:04.295785 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:14:04.295785 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:14:04.295785 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:14:04.295785 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:14:04.295785 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:14:04.295785 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:14:04.295785 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:14:04.295785 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:14:04.295785 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:14:04.295785 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 10:14:04.295785 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 10:14:04.295785 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 10:14:04.295785 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 10:14:04.297025 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:14:04.297025 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:14:04.297025 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:14:04.297025 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:14:04.297025 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:14:04.297025 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:14:04.297025 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:14:04.297025 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 19 10:14:04.297025 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:14:04.297025 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:14:04.297025 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:14:04.297025 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:14:04.297025 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:14:04.297025 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:14:04.297025 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:14:04.297025 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:14:04.297025 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 10:14:04.298106 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 10:14:04.298106 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 10:14:04.298106 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 19 10:14:04.299515 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 359/705] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 19 10:14:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:14:04.304853 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f20c32-da88-4d9d-8701-d094c742ce12 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:04.335942 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd464ca2-611d-4bca-adca-673c668cfb34 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:04.336311 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd464ca2-611d-4bca-adca-673c668cfb34 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:04.336675 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd464ca2-611d-4bca-adca-673c668cfb34 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:04.338171 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 360/706] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:14:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:14:04.346102 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20da252-231b-4433-b862-706ecaae826c None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:04.346504 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20da252-231b-4433-b862-706ecaae826c None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:04.346866 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20da252-231b-4433-b862-706ecaae826c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:04.365457 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-a20da252-231b-4433-b862-706ecaae826c None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:14:04.366900 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-a20da252-231b-4433-b862-706ecaae826c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:14:04.429775 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f20c32-da88-4d9d-8701-d094c742ce12 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:04.441444 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 361/707] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:14:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 10:14:04.443683 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ac4d66-b9ed-4be6-8f2a-5eea2e8903eb None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:04.444286 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ac4d66-b9ed-4be6-8f2a-5eea2e8903eb None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:04.444768 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ac4d66-b9ed-4be6-8f2a-5eea2e8903eb None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:04.446654 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 362/708] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:14:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:14:04.452566 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73f4656-bf66-4205-b0f5-0538086d36f4 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:04.453142 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73f4656-bf66-4205-b0f5-0538086d36f4 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:04.453582 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73f4656-bf66-4205-b0f5-0538086d36f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:04.471637 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513fd01d-6b71-4d6c-8197-db819439c22e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:04.472469 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513fd01d-6b71-4d6c-8197-db819439c22e None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:04.472870 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513fd01d-6b71-4d6c-8197-db819439c22e None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:04.473264 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513fd01d-6b71-4d6c-8197-db819439c22e None admin] PATH_INFO: `/v3/domains` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:04.473995 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513fd01d-6b71-4d6c-8197-db819439c22e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:14:04.474536 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513fd01d-6b71-4d6c-8197-db819439c22e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:04.475419 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-e73f4656-bf66-4205-b0f5-0538086d36f4 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:14:04.476200 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513fd01d-6b71-4d6c-8197-db819439c22e None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:04.476961 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-e73f4656-bf66-4205-b0f5-0538086d36f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:14:04.489748 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 347/709] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Sep 19 10:14:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 10:14:04.501167 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513fd01d-6b71-4d6c-8197-db819439c22e None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:04.560305 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 363/710] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:14:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 10:14:04.585706 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:04.671996 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513fd01d-6b71-4d6c-8197-db819439c22e None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:04.719672 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9533dd61-d9e8-496e-9386-008e4418b2a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:04.720342 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9533dd61-d9e8-496e-9386-008e4418b2a7 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:04.720624 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9533dd61-d9e8-496e-9386-008e4418b2a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:04.720895 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9533dd61-d9e8-496e-9386-008e4418b2a7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:04.730297 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9533dd61-d9e8-496e-9386-008e4418b2a7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:04.731791 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9533dd61-d9e8-496e-9386-008e4418b2a7 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:04.751664 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-9533dd61-d9e8-496e-9386-008e4418b2a7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 10:14:04.751664 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:14:04.751664 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:14:04.751664 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:14:04.751664 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:14:04.751664 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:14:04.751664 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:14:04.751664 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:14:04.751664 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:14:04.751664 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:14:04.751664 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:14:04.751664 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:14:04.751664 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 10:14:04.751664 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 10:14:04.751664 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 10:14:04.752685 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 10:14:04.752685 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:14:04.752685 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:14:04.752685 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:14:04.752685 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:14:04.752685 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:14:04.752685 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:14:04.752685 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:14:04.752685 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Sep 19 10:14:04.752685 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:14:04.752685 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:14:04.752685 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:14:04.752685 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:14:04.752685 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:14:04.752685 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:14:04.752685 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:14:04.752685 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:14:04.753631 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 10:14:04.753631 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 10:14:04.753631 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 10:14:04.753631 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 10:14:04.753631 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 10:14:04.753631 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 10:14:04.753631 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 10:14:04.753631 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Sep 19 10:14:04.757235 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 348/711] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Sep 19 10:14:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:14:04.762697 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73f4656-bf66-4205-b0f5-0538086d36f4 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:04.812441 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:04.901642 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9533dd61-d9e8-496e-9386-008e4418b2a7 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:04.907254 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73f4656-bf66-4205-b0f5-0538086d36f4 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:04.943331 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d167f6e8-0271-44f1-a290-ad657025bda1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:04.944568 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d167f6e8-0271-44f1-a290-ad657025bda1 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:04.945054 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d167f6e8-0271-44f1-a290-ad657025bda1 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:04.945546 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d167f6e8-0271-44f1-a290-ad657025bda1 None admin] PATH_INFO: `/v3/projects` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:04.946449 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d167f6e8-0271-44f1-a290-ad657025bda1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:14:04.946953 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d167f6e8-0271-44f1-a290-ad657025bda1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:04.948651 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d167f6e8-0271-44f1-a290-ad657025bda1 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:04.964559 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 364/712] 10.222.0.66 () {56 vars in 1148 bytes} [Mon Sep 19 10:14:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:14:04.965942 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d167f6e8-0271-44f1-a290-ad657025bda1 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:05.024908 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9533dd61-d9e8-496e-9386-008e4418b2a7 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:05.044623 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:05.069921 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:05.072851 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a97bcb-0326-4adb-889c-7eee6ad778fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:05.074190 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a97bcb-0326-4adb-889c-7eee6ad778fb None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:05.074676 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a97bcb-0326-4adb-889c-7eee6ad778fb None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:05.075389 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a97bcb-0326-4adb-889c-7eee6ad778fb None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:05.076156 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a97bcb-0326-4adb-889c-7eee6ad778fb None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:05.078428 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a97bcb-0326-4adb-889c-7eee6ad778fb None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:05.084052 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d167f6e8-0271-44f1-a290-ad657025bda1 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:05.093998 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-c2a97bcb-0326-4adb-889c-7eee6ad778fb None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 19 10:14:05.093998 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:14:05.093998 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 10:14:05.093998 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 10:14:05.093998 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 10:14:05.093998 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 10:14:05.093998 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 10:14:05.093998 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 10:14:05.093998 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 19 10:14:05.093998 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Sep 19 10:14:05.093998 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 10:14:05.093998 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Sep 19 10:14:05.093998 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:14:05.093998 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:14:05.093998 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:14:05.093998 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:14:05.093998 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:14:05.095020 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:14:05.095020 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:14:05.095020 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:14:05.095020 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:14:05.095020 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:14:05.095020 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:14:05.095020 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 10:14:05.095020 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 10:14:05.095020 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 10:14:05.095020 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 10:14:05.095020 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:14:05.095020 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:14:05.095020 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:14:05.095020 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:14:05.095020 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:14:05.095020 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:14:05.095920 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:14:05.095920 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Sep 19 10:14:05.095920 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:14:05.095920 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:14:05.095920 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:14:05.095920 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:14:05.095920 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:14:05.095920 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:14:05.095920 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:14:05.095920 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:14:05.095920 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 10:14:05.095920 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 10:14:05.095920 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 19 10:14:05.095920 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Sep 19 10:14:05.098816 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 349/713] 10.222.0.66 () {56 vars in 1129 bytes} [Mon Sep 19 10:14:04 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:14:05.099448 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a97bcb-0326-4adb-889c-7eee6ad778fb None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:05.126089 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0571e2-d3f6-442f-b4f4-e4c53b1ccd53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:05.126800 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0571e2-d3f6-442f-b4f4-e4c53b1ccd53 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:05.127078 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0571e2-d3f6-442f-b4f4-e4c53b1ccd53 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:05.127392 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0571e2-d3f6-442f-b4f4-e4c53b1ccd53 None admin] PATH_INFO: `/v3/services/network` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:05.128023 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0571e2-d3f6-442f-b4f4-e4c53b1ccd53 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:05.130116 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0571e2-d3f6-442f-b4f4-e4c53b1ccd53 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:05.143263 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-5e0571e2-d3f6-442f-b4f4-e4c53b1ccd53 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 19 10:14:05.143263 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:14:05.143263 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 10:14:05.143263 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 10:14:05.143263 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 10:14:05.143263 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 10:14:05.143263 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 10:14:05.143263 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 10:14:05.143263 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 19 10:14:05.143263 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 19 10:14:05.143263 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 10:14:05.143263 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 19 10:14:05.143263 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:14:05.143263 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:14:05.143263 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:14:05.143263 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:14:05.143263 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:14:05.144326 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:14:05.144326 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:14:05.144326 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:14:05.144326 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:14:05.144326 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:14:05.144326 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:14:05.144326 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 10:14:05.144326 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 10:14:05.144326 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 10:14:05.144326 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 10:14:05.144326 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:14:05.144326 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:14:05.144326 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:14:05.144326 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:14:05.144326 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:14:05.144326 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:14:05.145773 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:14:05.145773 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 19 10:14:05.145773 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:14:05.145773 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:14:05.145773 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:14:05.145773 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:14:05.145773 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:14:05.145773 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:14:05.145773 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:14:05.145773 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:14:05.145773 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 10:14:05.145773 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 10:14:05.145773 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 19 10:14:05.145773 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 19 10:14:05.145773 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 365/714] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Sep 19 10:14:04 2022] GET /identity/v3/services/network => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:14:05.146554 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0571e2-d3f6-442f-b4f4-e4c53b1ccd53 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:05.235409 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a97bcb-0326-4adb-889c-7eee6ad778fb None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:05.266005 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0571e2-d3f6-442f-b4f4-e4c53b1ccd53 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:05.276686 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c61292-7d62-4fe2-b25b-e321e10a3f77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:05.277399 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c61292-7d62-4fe2-b25b-e321e10a3f77 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:05.277685 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c61292-7d62-4fe2-b25b-e321e10a3f77 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:05.277961 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c61292-7d62-4fe2-b25b-e321e10a3f77 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:05.278786 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c61292-7d62-4fe2-b25b-e321e10a3f77 None admin] RBAC: Adding query filter params (role.id=5c8b89fae4fa45bd944cbeaf442136e1, scope.project.id=be6b93ef3359434d9c776343f0aea333, user.id=15c70bfb085a44e9b84942b480ff22f1) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:14:05.279102 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c61292-7d62-4fe2-b25b-e321e10a3f77 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:05.280598 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c61292-7d62-4fe2-b25b-e321e10a3f77 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:05.288570 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 350/715] 10.222.0.66 () {56 vars in 1374 bytes} [Mon Sep 19 10:14:05 2022] GET /identity/v3/role_assignments?user.id=15c70bfb085a44e9b84942b480ff22f1&scope.project.id=be6b93ef3359434d9c776343f0aea333&role.id=5c8b89fae4fa45bd944cbeaf442136e1 => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:14:05.289404 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c61292-7d62-4fe2-b25b-e321e10a3f77 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:05.326905 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:05.347718 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8d1598-c2bf-4cb2-b890-24a5d85427df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:05.348906 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8d1598-c2bf-4cb2-b890-24a5d85427df None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:05.349184 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8d1598-c2bf-4cb2-b890-24a5d85427df None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:05.349453 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8d1598-c2bf-4cb2-b890-24a5d85427df None admin] PATH_INFO: `/v3/services` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:05.350083 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8d1598-c2bf-4cb2-b890-24a5d85427df None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:14:05.350381 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8d1598-c2bf-4cb2-b890-24a5d85427df None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:05.351764 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8d1598-c2bf-4cb2-b890-24a5d85427df None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:05.362792 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 366/716] 10.222.0.66 () {56 vars in 1124 bytes} [Mon Sep 19 10:14:05 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:14:05.368616 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8d1598-c2bf-4cb2-b890-24a5d85427df None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:05.392463 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:05.472292 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c61292-7d62-4fe2-b25b-e321e10a3f77 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:05.526472 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8d1598-c2bf-4cb2-b890-24a5d85427df None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:05.550726 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd65d8d3-bd52-48cb-8c4e-4c7607143378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:05.551903 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd65d8d3-bd52-48cb-8c4e-4c7607143378 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:05.552259 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd65d8d3-bd52-48cb-8c4e-4c7607143378 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:05.552474 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd65d8d3-bd52-48cb-8c4e-4c7607143378 None admin] PATH_INFO: `/v3/services` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:05.553110 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd65d8d3-bd52-48cb-8c4e-4c7607143378 None admin] RBAC: Adding query filter params (name=network) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:14:05.553407 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd65d8d3-bd52-48cb-8c4e-4c7607143378 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:05.554816 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd65d8d3-bd52-48cb-8c4e-4c7607143378 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:05.569351 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 351/717] 10.222.0.66 () {56 vars in 1112 bytes} [Mon Sep 19 10:14:05 2022] GET /identity/v3/services?name=network => generated 124 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:14:05.576386 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd65d8d3-bd52-48cb-8c4e-4c7607143378 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:05.606818 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcda141-895e-4b50-831e-f2d5515222db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:05.607908 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcda141-895e-4b50-831e-f2d5515222db None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:05.608465 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcda141-895e-4b50-831e-f2d5515222db None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:05.608739 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcda141-895e-4b50-831e-f2d5515222db None admin] PATH_INFO: `/v3/services` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:05.609380 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcda141-895e-4b50-831e-f2d5515222db None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:14:05.609942 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcda141-895e-4b50-831e-f2d5515222db None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:05.612010 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcda141-895e-4b50-831e-f2d5515222db None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:05.627441 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 367/718] 10.222.0.66 () {56 vars in 1124 bytes} [Mon Sep 19 10:14:05 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 10:14:05.702204 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:05.713426 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a6624a-f56e-4d8c-8a65-84fdc0684a69 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:05.713766 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a6624a-f56e-4d8c-8a65-84fdc0684a69 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:05.713983 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a6624a-f56e-4d8c-8a65-84fdc0684a69 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:05.715679 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 368/719] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:14:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:14:05.717505 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd65d8d3-bd52-48cb-8c4e-4c7607143378 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:05.721152 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeb9086-9297-4841-a397-9b378db490e9 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:05.721446 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeb9086-9297-4841-a397-9b378db490e9 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:05.721695 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeb9086-9297-4841-a397-9b378db490e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:05.751135 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-fbeb9086-9297-4841-a397-9b378db490e9 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:14:05.754597 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-fbeb9086-9297-4841-a397-9b378db490e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:14:05.799463 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf0d798-69d5-48da-917f-781af553ae00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:05.800085 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf0d798-69d5-48da-917f-781af553ae00 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:05.800449 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf0d798-69d5-48da-917f-781af553ae00 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:05.800734 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf0d798-69d5-48da-917f-781af553ae00 None admin] PATH_INFO: `/v3/services` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:05.802075 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf0d798-69d5-48da-917f-781af553ae00 None admin] RBAC: Adding query filter params (type=network) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:14:05.802387 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf0d798-69d5-48da-917f-781af553ae00 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:05.803796 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf0d798-69d5-48da-917f-781af553ae00 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:05.813902 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 352/720] 10.222.0.66 () {56 vars in 1112 bytes} [Mon Sep 19 10:14:05 2022] GET /identity/v3/services?type=network => generated 124 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:14:05.879235 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 369/721] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:14:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 10:14:06.168060 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf0d798-69d5-48da-917f-781af553ae00 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:06.293060 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf0d798-69d5-48da-917f-781af553ae00 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:06.342556 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd86c6ae-ae82-4f77-8e81-f4d4f505203e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:06.343335 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd86c6ae-ae82-4f77-8e81-f4d4f505203e None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:06.343545 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd86c6ae-ae82-4f77-8e81-f4d4f505203e None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:06.343824 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd86c6ae-ae82-4f77-8e81-f4d4f505203e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:06.360376 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd86c6ae-ae82-4f77-8e81-f4d4f505203e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 10:14:06.366428 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-cd86c6ae-ae82-4f77-8e81-f4d4f505203e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 10:14:06.366428 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:14:06.366428 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:14:06.366428 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:14:06.366428 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:14:06.366428 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:14:06.366428 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:14:06.366428 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:14:06.366428 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:14:06.366428 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:14:06.366428 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:14:06.366428 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:14:06.366428 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 10:14:06.366428 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 10:14:06.366428 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 10:14:06.366428 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 10:14:06.367377 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 10:14:06.367377 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 10:14:06.367377 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 10:14:06.367377 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 10:14:06.367377 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:14:06.367377 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:14:06.367377 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:14:06.367377 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:14:06.367377 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:14:06.367377 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:14:06.367377 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:14:06.367377 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Sep 19 10:14:06.367377 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:14:06.367377 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:14:06.367377 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:14:06.367377 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:14:06.368694 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:14:06.368694 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:14:06.368694 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:14:06.368694 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:14:06.368694 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 10:14:06.368694 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 10:14:06.368694 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 10:14:06.368694 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 10:14:06.368694 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 10:14:06.368694 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 10:14:06.368694 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 10:14:06.368694 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Sep 19 10:14:06.368694 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 353/722] 10.222.0.66 () {56 vars in 1096 bytes} [Mon Sep 19 10:14:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:14:06.373753 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeb9086-9297-4841-a397-9b378db490e9 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:06.385870 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:06.489553 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc18f386-6d34-4e7c-96ab-6e770feb0042 None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:06.489728 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc18f386-6d34-4e7c-96ab-6e770feb0042 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:06.490006 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc18f386-6d34-4e7c-96ab-6e770feb0042 None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:06.491722 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 354/723] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:14:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:14:06.497730 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a4cecc-d34c-43db-b6a8-f978b72d84f8 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:06.498010 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a4cecc-d34c-43db-b6a8-f978b72d84f8 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:06.498284 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a4cecc-d34c-43db-b6a8-f978b72d84f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:06.528732 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeb9086-9297-4841-a397-9b378db490e9 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:06.531540 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-76a4cecc-d34c-43db-b6a8-f978b72d84f8 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:14:06.532996 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-76a4cecc-d34c-43db-b6a8-f978b72d84f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:14:06.552862 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:06.606997 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0cec27-2632-4642-b272-fe9a642d73b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:06.609036 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0cec27-2632-4642-b272-fe9a642d73b0 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:06.609577 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0cec27-2632-4642-b272-fe9a642d73b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:06.611141 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0cec27-2632-4642-b272-fe9a642d73b0 None admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:06.611990 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0cec27-2632-4642-b272-fe9a642d73b0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:14:06.614535 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0cec27-2632-4642-b272-fe9a642d73b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:06.616153 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0cec27-2632-4642-b272-fe9a642d73b0 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:06.626055 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 370/724] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Sep 19 10:14:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:14:06.632143 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0cec27-2632-4642-b272-fe9a642d73b0 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:06.693816 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 355/725] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:14:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 10:14:06.712271 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:06.746531 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0cec27-2632-4642-b272-fe9a642d73b0 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:06.782072 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2a8dfc-0607-47fd-838c-c1134f7e7f2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:06.783027 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2a8dfc-0607-47fd-838c-c1134f7e7f2f None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:06.783455 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2a8dfc-0607-47fd-838c-c1134f7e7f2f None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:06.783875 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2a8dfc-0607-47fd-838c-c1134f7e7f2f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:06.798701 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2a8dfc-0607-47fd-838c-c1134f7e7f2f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:06.800408 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2a8dfc-0607-47fd-838c-c1134f7e7f2f None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:06.817200 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-3d2a8dfc-0607-47fd-838c-c1134f7e7f2f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 10:14:06.817200 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:14:06.817200 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:14:06.817200 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:14:06.817200 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:14:06.817200 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:14:06.817200 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:14:06.817200 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:14:06.817200 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:14:06.817200 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:14:06.817200 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:14:06.817200 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:14:06.817200 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 10:14:06.817200 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 10:14:06.817200 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 10:14:06.817200 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 10:14:06.818424 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:14:06.818424 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:14:06.818424 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:14:06.818424 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:14:06.818424 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:14:06.818424 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:14:06.818424 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:14:06.818424 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 19 10:14:06.818424 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:14:06.818424 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:14:06.818424 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:14:06.818424 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:14:06.818424 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:14:06.818424 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:14:06.818424 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:14:06.818424 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:14:06.818424 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 10:14:06.819539 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 10:14:06.819539 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 10:14:06.819539 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 19 10:14:06.821502 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 371/726] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 19 10:14:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:14:06.827740 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a4cecc-d34c-43db-b6a8-f978b72d84f8 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:06.956718 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a4cecc-d34c-43db-b6a8-f978b72d84f8 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:06.992753 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e289352-dffd-4193-a2af-ba1a08fe2b2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:06.993598 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e289352-dffd-4193-a2af-ba1a08fe2b2b None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:06.994049 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e289352-dffd-4193-a2af-ba1a08fe2b2b None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:06.994468 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e289352-dffd-4193-a2af-ba1a08fe2b2b None admin] PATH_INFO: `/v3/domains` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:06.995248 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e289352-dffd-4193-a2af-ba1a08fe2b2b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:14:06.995694 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e289352-dffd-4193-a2af-ba1a08fe2b2b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:06.997306 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e289352-dffd-4193-a2af-ba1a08fe2b2b None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:07.014189 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 356/727] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Sep 19 10:14:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:14:07.020082 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2a8dfc-0607-47fd-838c-c1134f7e7f2f None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:07.059596 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e289352-dffd-4193-a2af-ba1a08fe2b2b None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:07.076180 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:07.140320 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2a8dfc-0607-47fd-838c-c1134f7e7f2f None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:07.168488 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:07.177996 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126cdead-a194-4bab-a75e-2eceb0e73247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:07.178637 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126cdead-a194-4bab-a75e-2eceb0e73247 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:07.178924 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126cdead-a194-4bab-a75e-2eceb0e73247 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:07.179206 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126cdead-a194-4bab-a75e-2eceb0e73247 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:07.187443 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126cdead-a194-4bab-a75e-2eceb0e73247 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:07.189298 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126cdead-a194-4bab-a75e-2eceb0e73247 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:07.201997 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-126cdead-a194-4bab-a75e-2eceb0e73247 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 19 10:14:07.201997 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:14:07.201997 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:14:07.201997 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:14:07.201997 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:14:07.201997 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:14:07.201997 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:14:07.201997 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:14:07.201997 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:14:07.201997 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:14:07.201997 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:14:07.201997 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:14:07.201997 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 10:14:07.201997 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 10:14:07.201997 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 10:14:07.201997 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 10:14:07.202932 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:14:07.202932 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:14:07.202932 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 10:14:07.202932 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 10:14:07.202932 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 10:14:07.202932 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 10:14:07.202932 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:14:07.202932 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:14:07.202932 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:14:07.202932 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:14:07.202932 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:14:07.202932 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 19 10:14:07.202932 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:14:07.202932 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:14:07.202932 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:14:07.202932 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:14:07.202932 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:14:07.202932 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:14:07.205192 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:14:07.205192 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:14:07.205192 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 10:14:07.205192 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 10:14:07.205192 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 10:14:07.205192 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 10:14:07.205192 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 10:14:07.205192 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 10:14:07.205192 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 19 10:14:07.205192 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 19 10:14:07.205192 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 372/728] 10.222.0.66 () {56 vars in 1096 bytes} [Mon Sep 19 10:14:07 2022] GET /identity/v3/users/swift => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:14:07.210169 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126cdead-a194-4bab-a75e-2eceb0e73247 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:07.337333 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126cdead-a194-4bab-a75e-2eceb0e73247 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:07.350936 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e289352-dffd-4193-a2af-ba1a08fe2b2b None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:07.379474 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936a757d-dfa1-4745-87e9-f9021264af6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:07.380134 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936a757d-dfa1-4745-87e9-f9021264af6c None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:07.380405 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936a757d-dfa1-4745-87e9-f9021264af6c None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:07.380679 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936a757d-dfa1-4745-87e9-f9021264af6c None admin] PATH_INFO: `/v3/users` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:07.381409 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936a757d-dfa1-4745-87e9-f9021264af6c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:14:07.381714 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936a757d-dfa1-4745-87e9-f9021264af6c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:07.383152 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936a757d-dfa1-4745-87e9-f9021264af6c None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:07.402124 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 373/729] 10.222.0.66 () {56 vars in 1135 bytes} [Mon Sep 19 10:14:07 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 10:14:07.408047 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936a757d-dfa1-4745-87e9-f9021264af6c None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:07.435682 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460c119a-5182-425f-a929-d498eeb2b4d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:07.436700 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460c119a-5182-425f-a929-d498eeb2b4d7 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:07.437188 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460c119a-5182-425f-a929-d498eeb2b4d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:07.437785 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460c119a-5182-425f-a929-d498eeb2b4d7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:07.458626 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:07.465150 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460c119a-5182-425f-a929-d498eeb2b4d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 10:14:07.477766 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-460c119a-5182-425f-a929-d498eeb2b4d7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 10:14:07.477766 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:14:07.477766 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:14:07.477766 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:14:07.477766 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:14:07.477766 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:14:07.477766 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:14:07.477766 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:14:07.477766 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:14:07.477766 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:14:07.477766 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:14:07.477766 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:14:07.477766 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 10:14:07.477766 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 10:14:07.477766 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 10:14:07.477766 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 10:14:07.478730 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 10:14:07.478730 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 10:14:07.478730 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 10:14:07.478730 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 10:14:07.478730 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:14:07.478730 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:14:07.478730 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:14:07.478730 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:14:07.478730 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:14:07.478730 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:14:07.478730 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:14:07.478730 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Sep 19 10:14:07.478730 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:14:07.478730 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:14:07.478730 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:14:07.478730 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:14:07.479550 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:14:07.479550 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:14:07.479550 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:14:07.479550 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:14:07.479550 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 10:14:07.479550 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 10:14:07.479550 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 10:14:07.479550 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 10:14:07.479550 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 10:14:07.479550 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 10:14:07.479550 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 10:14:07.479550 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Sep 19 10:14:07.483156 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 357/730] 10.222.0.66 () {56 vars in 1102 bytes} [Mon Sep 19 10:14:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 424 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 10:14:07.489306 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460c119a-5182-425f-a929-d498eeb2b4d7 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:07.517713 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936a757d-dfa1-4745-87e9-f9021264af6c None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:07.561836 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26423db-0eb1-433a-9faf-07a58a56553d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:07.562457 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26423db-0eb1-433a-9faf-07a58a56553d None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:07.562731 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26423db-0eb1-433a-9faf-07a58a56553d None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:07.563007 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26423db-0eb1-433a-9faf-07a58a56553d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:07.635045 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:07.636816 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26423db-0eb1-433a-9faf-07a58a56553d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:07.638297 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26423db-0eb1-433a-9faf-07a58a56553d None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:07.685855 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:07.695857 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460c119a-5182-425f-a929-d498eeb2b4d7 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:07.734502 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e4c14b-b104-4596-9d12-576a2703e8b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:07.735136 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e4c14b-b104-4596-9d12-576a2703e8b8 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:07.735574 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e4c14b-b104-4596-9d12-576a2703e8b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:07.735857 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e4c14b-b104-4596-9d12-576a2703e8b8 None admin] PATH_INFO: `/v3/roles` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:07.736576 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e4c14b-b104-4596-9d12-576a2703e8b8 None admin] RBAC: Adding query filter params (name=service) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:14:07.736885 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e4c14b-b104-4596-9d12-576a2703e8b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:07.738848 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e4c14b-b104-4596-9d12-576a2703e8b8 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:07.750416 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 358/731] 10.222.0.66 () {56 vars in 1103 bytes} [Mon Sep 19 10:14:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 10:14:07.757656 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e4c14b-b104-4596-9d12-576a2703e8b8 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:07.838720 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 374/732] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Sep 19 10:14:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 19 10:14:07.844523 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26423db-0eb1-433a-9faf-07a58a56553d None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:07.871428 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e4c14b-b104-4596-9d12-576a2703e8b8 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:07.902519 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:07.911220 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c48d32b-d9e2-48d9-b4a4-fccb56081109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:07.911861 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c48d32b-d9e2-48d9-b4a4-fccb56081109 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:07.912148 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c48d32b-d9e2-48d9-b4a4-fccb56081109 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:07.912457 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c48d32b-d9e2-48d9-b4a4-fccb56081109 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:07.929334 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c48d32b-d9e2-48d9-b4a4-fccb56081109 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:07.931296 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c48d32b-d9e2-48d9-b4a4-fccb56081109 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:07.951800 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-9c48d32b-d9e2-48d9-b4a4-fccb56081109 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 10:14:07.951800 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:14:07.951800 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:14:07.951800 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:14:07.951800 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:14:07.951800 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:14:07.951800 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:14:07.951800 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:14:07.951800 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:14:07.951800 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:14:07.951800 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:14:07.951800 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:14:07.951800 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 10:14:07.951800 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 10:14:07.951800 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 10:14:07.951800 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 10:14:07.952904 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:14:07.952904 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:14:07.952904 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:14:07.952904 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:14:07.952904 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:14:07.952904 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:14:07.952904 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:14:07.952904 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Sep 19 10:14:07.952904 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:14:07.952904 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:14:07.952904 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:14:07.952904 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:14:07.952904 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:14:07.952904 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:14:07.952904 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:14:07.952904 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:14:07.952904 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 10:14:07.953799 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 10:14:07.953799 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 10:14:07.953799 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Sep 19 10:14:07.953799 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 359/733] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 19 10:14:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:14:07.954655 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b142b4a-59c6-4043-a5f4-e7300402e450 None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:07.954962 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b142b4a-59c6-4043-a5f4-e7300402e450 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:07.956594 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b142b4a-59c6-4043-a5f4-e7300402e450 None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:07.962851 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 360/734] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:14:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:14:07.965623 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b142b4a-59c6-4043-a5f4-e7300402e450 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:08.013107 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26423db-0eb1-433a-9faf-07a58a56553d None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:08.059617 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3e88af-1d5d-4abe-b47d-a076ba547149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:08.060776 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3e88af-1d5d-4abe-b47d-a076ba547149 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:08.061062 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3e88af-1d5d-4abe-b47d-a076ba547149 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:08.061338 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3e88af-1d5d-4abe-b47d-a076ba547149 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:08.076284 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3e88af-1d5d-4abe-b47d-a076ba547149 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:08.078018 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3e88af-1d5d-4abe-b47d-a076ba547149 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:08.080660 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:08.090529 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b142b4a-59c6-4043-a5f4-e7300402e450 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:08.099967 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-ff3e88af-1d5d-4abe-b47d-a076ba547149 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 10:14:08.099967 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:14:08.099967 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:14:08.099967 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:14:08.099967 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:14:08.099967 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:14:08.099967 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:14:08.099967 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:14:08.099967 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:14:08.099967 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:14:08.099967 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:14:08.099967 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:14:08.099967 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 10:14:08.099967 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 10:14:08.099967 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 10:14:08.099967 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 10:14:08.100988 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:14:08.100988 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:14:08.100988 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:14:08.100988 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:14:08.100988 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:14:08.100988 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:14:08.100988 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:14:08.100988 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 19 10:14:08.100988 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:14:08.100988 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:14:08.100988 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:14:08.100988 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:14:08.100988 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:14:08.100988 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:14:08.100988 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:14:08.100988 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:14:08.100988 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 10:14:08.101901 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 10:14:08.101901 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 10:14:08.101901 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 19 10:14:08.101901 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 375/735] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 19 10:14:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:14:08.102604 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa25c20-7c36-4a90-8c1f-5bb5a55debf7 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:08.102888 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa25c20-7c36-4a90-8c1f-5bb5a55debf7 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:08.103161 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa25c20-7c36-4a90-8c1f-5bb5a55debf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:08.128061 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-0aa25c20-7c36-4a90-8c1f-5bb5a55debf7 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:14:08.129853 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-0aa25c20-7c36-4a90-8c1f-5bb5a55debf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:14:08.132341 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296ac7f2-dc1a-4b89-85e3-2b2138d4b782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:08.133241 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296ac7f2-dc1a-4b89-85e3-2b2138d4b782 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:08.133721 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296ac7f2-dc1a-4b89-85e3-2b2138d4b782 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:08.134218 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296ac7f2-dc1a-4b89-85e3-2b2138d4b782 None admin] PATH_INFO: `/v3/domains` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:08.135052 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296ac7f2-dc1a-4b89-85e3-2b2138d4b782 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:14:08.135616 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296ac7f2-dc1a-4b89-85e3-2b2138d4b782 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:08.137272 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296ac7f2-dc1a-4b89-85e3-2b2138d4b782 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:08.156318 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 361/736] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Sep 19 10:14:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:14:08.157525 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296ac7f2-dc1a-4b89-85e3-2b2138d4b782 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:08.203989 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:08.232474 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 376/737] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:14:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 10:14:08.233768 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa25c20-7c36-4a90-8c1f-5bb5a55debf7 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:08.286031 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296ac7f2-dc1a-4b89-85e3-2b2138d4b782 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:08.334843 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc59a8a-e2a7-4311-bd41-20783f91d965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:08.335458 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc59a8a-e2a7-4311-bd41-20783f91d965 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:08.335741 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc59a8a-e2a7-4311-bd41-20783f91d965 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:08.336018 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc59a8a-e2a7-4311-bd41-20783f91d965 None admin] PATH_INFO: `/v3/domains` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:08.336689 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc59a8a-e2a7-4311-bd41-20783f91d965 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:14:08.336993 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc59a8a-e2a7-4311-bd41-20783f91d965 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:08.338377 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc59a8a-e2a7-4311-bd41-20783f91d965 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:08.358234 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 362/738] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Sep 19 10:14:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:14:08.363764 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc59a8a-e2a7-4311-bd41-20783f91d965 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:08.454298 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa25c20-7c36-4a90-8c1f-5bb5a55debf7 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:08.504523 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:08.524389 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:08.527094 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1e4bdd-86fc-4d95-807c-2c2b41e48928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:08.527821 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1e4bdd-86fc-4d95-807c-2c2b41e48928 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:08.528106 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1e4bdd-86fc-4d95-807c-2c2b41e48928 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:08.528509 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1e4bdd-86fc-4d95-807c-2c2b41e48928 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:08.530489 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc59a8a-e2a7-4311-bd41-20783f91d965 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:08.536643 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1e4bdd-86fc-4d95-807c-2c2b41e48928 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:08.538092 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1e4bdd-86fc-4d95-807c-2c2b41e48928 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:08.551831 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-1a1e4bdd-86fc-4d95-807c-2c2b41e48928 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 19 10:14:08.551831 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:14:08.551831 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:14:08.551831 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:14:08.551831 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:14:08.551831 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:14:08.551831 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:14:08.551831 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:14:08.551831 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:14:08.551831 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:14:08.551831 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:14:08.551831 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:14:08.551831 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 10:14:08.551831 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 10:14:08.551831 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 10:14:08.551831 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 10:14:08.552842 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:14:08.552842 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:14:08.552842 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 10:14:08.552842 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 10:14:08.552842 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 10:14:08.552842 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 10:14:08.552842 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:14:08.552842 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:14:08.552842 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:14:08.552842 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:14:08.552842 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:14:08.552842 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 19 10:14:08.552842 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:14:08.552842 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:14:08.552842 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:14:08.552842 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:14:08.552842 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:14:08.552842 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:14:08.553765 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:14:08.553765 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:14:08.553765 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 10:14:08.553765 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 10:14:08.553765 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 10:14:08.553765 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 10:14:08.553765 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 10:14:08.553765 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 10:14:08.553765 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 19 10:14:08.553765 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 19 10:14:08.557844 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 377/739] 10.222.0.66 () {56 vars in 1117 bytes} [Mon Sep 19 10:14:08 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:14:08.559216 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c27c5a3-44fb-48ec-9617-9e5668cbec4b None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:08.559494 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c27c5a3-44fb-48ec-9617-9e5668cbec4b None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:08.559881 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c27c5a3-44fb-48ec-9617-9e5668cbec4b None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:08.561387 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 378/740] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:14:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:14:08.562105 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c27c5a3-44fb-48ec-9617-9e5668cbec4b None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:08.574635 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e98ff58-077e-4da3-be91-2e2433fa6f69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:08.575635 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e98ff58-077e-4da3-be91-2e2433fa6f69 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:08.576131 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e98ff58-077e-4da3-be91-2e2433fa6f69 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:08.576735 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e98ff58-077e-4da3-be91-2e2433fa6f69 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:08.584338 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e98ff58-077e-4da3-be91-2e2433fa6f69 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:08.586036 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e98ff58-077e-4da3-be91-2e2433fa6f69 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:08.597375 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-7e98ff58-077e-4da3-be91-2e2433fa6f69 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 10:14:08.597375 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:14:08.597375 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:14:08.597375 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:14:08.597375 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:14:08.597375 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:14:08.597375 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:14:08.597375 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:14:08.597375 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:14:08.597375 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:14:08.597375 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:14:08.597375 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:14:08.597375 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 10:14:08.597375 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 10:14:08.597375 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 10:14:08.598782 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 10:14:08.598782 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:14:08.598782 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:14:08.598782 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:14:08.598782 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:14:08.598782 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:14:08.598782 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:14:08.598782 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:14:08.598782 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Sep 19 10:14:08.598782 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:14:08.598782 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:14:08.598782 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:14:08.598782 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:14:08.598782 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:14:08.598782 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:14:08.598782 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:14:08.598782 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:14:08.599724 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 10:14:08.599724 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 10:14:08.599724 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 10:14:08.599724 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 10:14:08.599724 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 10:14:08.599724 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 10:14:08.599724 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 10:14:08.599724 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Sep 19 10:14:08.599724 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 363/741] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Sep 19 10:14:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 10:14:08.600864 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4cecf9-017a-4ab7-ab00-0e132720aee1 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:08.600864 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4cecf9-017a-4ab7-ab00-0e132720aee1 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:08.601064 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4cecf9-017a-4ab7-ab00-0e132720aee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:08.619352 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-cf4cecf9-017a-4ab7-ab00-0e132720aee1 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:14:08.620698 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-cf4cecf9-017a-4ab7-ab00-0e132720aee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:14:08.679155 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c27c5a3-44fb-48ec-9617-9e5668cbec4b None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:08.689039 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 364/742] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:14:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 10:14:08.690197 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4cecf9-017a-4ab7-ab00-0e132720aee1 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:08.724506 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7218bdba-c0c4-4990-8bdc-5427dae87ff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:08.725066 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7218bdba-c0c4-4990-8bdc-5427dae87ff7 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:08.725344 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7218bdba-c0c4-4990-8bdc-5427dae87ff7 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:08.725615 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7218bdba-c0c4-4990-8bdc-5427dae87ff7 None admin] PATH_INFO: `/v3/users` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:08.726328 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7218bdba-c0c4-4990-8bdc-5427dae87ff7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:14:08.726631 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7218bdba-c0c4-4990-8bdc-5427dae87ff7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:08.728066 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7218bdba-c0c4-4990-8bdc-5427dae87ff7 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:08.750533 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 379/743] 10.222.0.66 () {56 vars in 1149 bytes} [Mon Sep 19 10:14:08 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:14:08.751825 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228be8db-3fcc-4236-a2cc-961f355a31b6 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:08.752114 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228be8db-3fcc-4236-a2cc-961f355a31b6 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:08.752417 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228be8db-3fcc-4236-a2cc-961f355a31b6 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:08.756497 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 380/744] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:14:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:14:08.756497 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228be8db-3fcc-4236-a2cc-961f355a31b6 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:08.787976 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:08.800145 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4cecf9-017a-4ab7-ab00-0e132720aee1 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:08.804014 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:08.836701 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713ee0f9-d2c1-47ad-96d4-693bb9242698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:08.837332 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713ee0f9-d2c1-47ad-96d4-693bb9242698 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:08.837611 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713ee0f9-d2c1-47ad-96d4-693bb9242698 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:08.837882 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713ee0f9-d2c1-47ad-96d4-693bb9242698 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:08.849134 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713ee0f9-d2c1-47ad-96d4-693bb9242698 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 10:14:08.854347 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-713ee0f9-d2c1-47ad-96d4-693bb9242698 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 10:14:08.854347 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:14:08.854347 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:14:08.854347 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:14:08.854347 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:14:08.854347 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:14:08.854347 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:14:08.854347 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:14:08.854347 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:14:08.854347 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:14:08.854347 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:14:08.854347 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:14:08.854347 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 10:14:08.854347 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 10:14:08.854347 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 10:14:08.854347 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 10:14:08.855271 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 10:14:08.855271 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 10:14:08.855271 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 10:14:08.855271 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 10:14:08.855271 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:14:08.855271 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:14:08.855271 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:14:08.855271 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:14:08.855271 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:14:08.855271 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:14:08.855271 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:14:08.855271 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Sep 19 10:14:08.855271 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:14:08.855271 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:14:08.855271 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:14:08.855271 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:14:08.856245 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:14:08.856245 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:14:08.856245 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:14:08.856245 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:14:08.856245 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 10:14:08.856245 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 10:14:08.856245 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 10:14:08.856245 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 10:14:08.856245 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 10:14:08.856245 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 10:14:08.856245 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 10:14:08.856245 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Sep 19 10:14:08.856245 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 365/745] 10.222.0.66 () {56 vars in 1096 bytes} [Mon Sep 19 10:14:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:14:08.856245 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713ee0f9-d2c1-47ad-96d4-693bb9242698 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:08.871445 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228be8db-3fcc-4236-a2cc-961f355a31b6 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:08.911507 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee8591a-09e7-46e2-9c9b-dbc98433f6d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:08.912130 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee8591a-09e7-46e2-9c9b-dbc98433f6d7 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:08.912441 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee8591a-09e7-46e2-9c9b-dbc98433f6d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:08.912716 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee8591a-09e7-46e2-9c9b-dbc98433f6d7 None admin] PATH_INFO: `/v3/projects` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:08.913408 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee8591a-09e7-46e2-9c9b-dbc98433f6d7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:14:08.913716 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee8591a-09e7-46e2-9c9b-dbc98433f6d7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:08.915637 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee8591a-09e7-46e2-9c9b-dbc98433f6d7 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:08.927914 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 381/746] 10.222.0.66 () {56 vars in 1148 bytes} [Mon Sep 19 10:14:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:14:08.929164 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d955a0fa-8a2b-464c-a7cd-47157844c5f3 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:08.929450 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d955a0fa-8a2b-464c-a7cd-47157844c5f3 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:08.929726 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d955a0fa-8a2b-464c-a7cd-47157844c5f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:08.949172 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-d955a0fa-8a2b-464c-a7cd-47157844c5f3 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:14:08.950375 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-d955a0fa-8a2b-464c-a7cd-47157844c5f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:14:08.967619 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713ee0f9-d2c1-47ad-96d4-693bb9242698 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:09.001883 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1182abb-be47-4850-a36c-79471d6691b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:09.002414 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1182abb-be47-4850-a36c-79471d6691b0 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:09.002697 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1182abb-be47-4850-a36c-79471d6691b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:09.002975 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1182abb-be47-4850-a36c-79471d6691b0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:09.017216 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 382/747] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:14:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 10:14:09.018318 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d955a0fa-8a2b-464c-a7cd-47157844c5f3 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:09.025322 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:09.051533 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:09.091255 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1182abb-be47-4850-a36c-79471d6691b0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:09.092887 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1182abb-be47-4850-a36c-79471d6691b0 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:09.124133 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d955a0fa-8a2b-464c-a7cd-47157844c5f3 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:09.162481 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62175888-ee88-4809-9a77-5d96d1e4aeb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:09.163261 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62175888-ee88-4809-9a77-5d96d1e4aeb3 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:09.163538 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62175888-ee88-4809-9a77-5d96d1e4aeb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:09.163881 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62175888-ee88-4809-9a77-5d96d1e4aeb3 None admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:09.164695 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62175888-ee88-4809-9a77-5d96d1e4aeb3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:14:09.165067 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62175888-ee88-4809-9a77-5d96d1e4aeb3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:09.167437 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62175888-ee88-4809-9a77-5d96d1e4aeb3 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:09.180963 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 383/748] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Sep 19 10:14:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:14:09.180963 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62175888-ee88-4809-9a77-5d96d1e4aeb3 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:09.284808 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:09.293718 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62175888-ee88-4809-9a77-5d96d1e4aeb3 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:09.312265 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 366/749] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Sep 19 10:14:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 10:14:09.313120 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1182abb-be47-4850-a36c-79471d6691b0 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:09.328095 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860acef6-a838-48c8-94f2-cac5df4c1223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:09.328734 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860acef6-a838-48c8-94f2-cac5df4c1223 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:09.329018 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860acef6-a838-48c8-94f2-cac5df4c1223 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:09.329378 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860acef6-a838-48c8-94f2-cac5df4c1223 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:09.330490 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860acef6-a838-48c8-94f2-cac5df4c1223 None admin] RBAC: Adding query filter params (role.id=5c8b89fae4fa45bd944cbeaf442136e1, scope.project.id=be6b93ef3359434d9c776343f0aea333, user.id=6677354e36614c9fb3d03413749be5ca) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:14:09.331003 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860acef6-a838-48c8-94f2-cac5df4c1223 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:09.333916 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860acef6-a838-48c8-94f2-cac5df4c1223 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:09.339313 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 384/750] 10.222.0.66 () {56 vars in 1374 bytes} [Mon Sep 19 10:14:09 2022] GET /identity/v3/role_assignments?user.id=6677354e36614c9fb3d03413749be5ca&scope.project.id=be6b93ef3359434d9c776343f0aea333&role.id=5c8b89fae4fa45bd944cbeaf442136e1 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:14:09.340092 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860acef6-a838-48c8-94f2-cac5df4c1223 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:09.389119 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:09.450030 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1182abb-be47-4850-a36c-79471d6691b0 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:09.457142 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860acef6-a838-48c8-94f2-cac5df4c1223 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:09.489696 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10be308-b94f-412a-aeaf-bc2cd5883be5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:09.490450 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10be308-b94f-412a-aeaf-bc2cd5883be5 None admin] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:09.490733 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10be308-b94f-412a-aeaf-bc2cd5883be5 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:09.491010 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10be308-b94f-412a-aeaf-bc2cd5883be5 None admin] PATH_INFO: `/v3/services` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:09.491679 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10be308-b94f-412a-aeaf-bc2cd5883be5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:09.493111 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10be308-b94f-412a-aeaf-bc2cd5883be5 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:09.495490 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb933864-db99-4b75-85e8-f422ff21a8cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:09.496251 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb933864-db99-4b75-85e8-f422ff21a8cd None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:09.496595 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb933864-db99-4b75-85e8-f422ff21a8cd None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:09.496943 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb933864-db99-4b75-85e8-f422ff21a8cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:09.510403 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb933864-db99-4b75-85e8-f422ff21a8cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:09.511888 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb933864-db99-4b75-85e8-f422ff21a8cd None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:09.515154 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 367/751] 10.222.0.66 () {60 vars in 1141 bytes} [Mon Sep 19 10:14:09 2022] POST /identity/v3/services => generated 240 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:14:09.516478 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10be308-b94f-412a-aeaf-bc2cd5883be5 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:09.530657 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-cb933864-db99-4b75-85e8-f422ff21a8cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 10:14:09.530657 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:14:09.530657 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:14:09.530657 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:14:09.530657 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:14:09.530657 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:14:09.530657 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:14:09.530657 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:14:09.530657 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:14:09.530657 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:14:09.530657 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:14:09.530657 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:14:09.530657 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 10:14:09.530657 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 10:14:09.530657 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 10:14:09.530657 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 10:14:09.531732 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:14:09.531732 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:14:09.531732 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:14:09.531732 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:14:09.531732 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:14:09.531732 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:14:09.531732 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:14:09.531732 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 19 10:14:09.531732 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:14:09.531732 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:14:09.531732 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:14:09.531732 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:14:09.531732 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:14:09.531732 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:14:09.531732 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:14:09.531732 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:14:09.531732 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 10:14:09.532700 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 10:14:09.532700 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 10:14:09.532700 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 19 10:14:09.532700 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 385/752] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 19 10:14:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:14:09.533481 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb933864-db99-4b75-85e8-f422ff21a8cd None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:09.549318 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:09.653740 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb933864-db99-4b75-85e8-f422ff21a8cd None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:09.707709 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10be308-b94f-412a-aeaf-bc2cd5883be5 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:09.709414 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7211da43-0d10-48d7-850e-07baaa72caf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:09.710115 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7211da43-0d10-48d7-850e-07baaa72caf7 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:09.710400 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7211da43-0d10-48d7-850e-07baaa72caf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:09.710676 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7211da43-0d10-48d7-850e-07baaa72caf7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:09.721279 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:09.730219 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7211da43-0d10-48d7-850e-07baaa72caf7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:09.732852 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7211da43-0d10-48d7-850e-07baaa72caf7 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:09.749892 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-7211da43-0d10-48d7-850e-07baaa72caf7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 10:14:09.749892 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:14:09.749892 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:14:09.749892 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:14:09.749892 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:14:09.749892 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:14:09.749892 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:14:09.749892 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:14:09.749892 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:14:09.749892 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:14:09.749892 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:14:09.749892 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:14:09.749892 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 10:14:09.749892 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 10:14:09.749892 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 10:14:09.749892 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 10:14:09.751069 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:14:09.751069 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:14:09.751069 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:14:09.751069 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:14:09.751069 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:14:09.751069 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:14:09.751069 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:14:09.751069 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 19 10:14:09.751069 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:14:09.751069 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:14:09.751069 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:14:09.751069 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:14:09.751069 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:14:09.751069 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:14:09.751069 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:14:09.751069 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:14:09.751069 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 10:14:09.756703 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 10:14:09.756703 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 10:14:09.756703 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 19 10:14:09.756703 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 386/753] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 19 10:14:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:14:09.756703 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7211da43-0d10-48d7-850e-07baaa72caf7 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:09.772099 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b8d209-26d8-408a-b293-4fe9717d145a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:09.773423 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b8d209-26d8-408a-b293-4fe9717d145a None admin] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:09.773704 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b8d209-26d8-408a-b293-4fe9717d145a None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:09.773979 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b8d209-26d8-408a-b293-4fe9717d145a None admin] PATH_INFO: `/v3/services` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:09.775412 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b8d209-26d8-408a-b293-4fe9717d145a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:09.776431 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b8d209-26d8-408a-b293-4fe9717d145a None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:09.796514 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 368/754] 10.222.0.66 () {60 vars in 1141 bytes} [Mon Sep 19 10:14:09 2022] POST /identity/v3/services => generated 251 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:14:09.797757 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b8d209-26d8-408a-b293-4fe9717d145a None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:09.860640 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:09.950153 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7211da43-0d10-48d7-850e-07baaa72caf7 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:09.999348 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b8d209-26d8-408a-b293-4fe9717d145a None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:10.024782 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc8a6ef-2050-44a5-ae63-4a9f1d2308fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:10.025406 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc8a6ef-2050-44a5-ae63-4a9f1d2308fd None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:10.025720 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc8a6ef-2050-44a5-ae63-4a9f1d2308fd None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:10.026076 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc8a6ef-2050-44a5-ae63-4a9f1d2308fd None admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:10.026722 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc8a6ef-2050-44a5-ae63-4a9f1d2308fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:14:10.027141 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc8a6ef-2050-44a5-ae63-4a9f1d2308fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:10.028542 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc8a6ef-2050-44a5-ae63-4a9f1d2308fd None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:10.045230 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 387/755] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Sep 19 10:14:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:14:10.052736 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89e70b4-039c-4550-a177-01f1f3829f52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:10.053168 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc8a6ef-2050-44a5-ae63-4a9f1d2308fd None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:10.053886 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89e70b4-039c-4550-a177-01f1f3829f52 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:10.054387 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89e70b4-039c-4550-a177-01f1f3829f52 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:10.054862 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89e70b4-039c-4550-a177-01f1f3829f52 None admin] PATH_INFO: `/v3/domains` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:10.055722 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89e70b4-039c-4550-a177-01f1f3829f52 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:14:10.056250 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89e70b4-039c-4550-a177-01f1f3829f52 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:10.057859 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89e70b4-039c-4550-a177-01f1f3829f52 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:10.070292 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 369/756] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Sep 19 10:14:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:14:10.077184 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89e70b4-039c-4550-a177-01f1f3829f52 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:10.107629 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:10.191953 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc8a6ef-2050-44a5-ae63-4a9f1d2308fd None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:10.206757 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89e70b4-039c-4550-a177-01f1f3829f52 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:10.211498 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:10.230551 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68ca086-7d4f-4303-9977-143746507450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:10.231280 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68ca086-7d4f-4303-9977-143746507450 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:10.231634 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68ca086-7d4f-4303-9977-143746507450 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:10.231977 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68ca086-7d4f-4303-9977-143746507450 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:10.239675 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68ca086-7d4f-4303-9977-143746507450 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:10.241290 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68ca086-7d4f-4303-9977-143746507450 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:10.257208 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-d68ca086-7d4f-4303-9977-143746507450 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 19 10:14:10.257208 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:14:10.257208 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:14:10.257208 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:14:10.257208 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:14:10.257208 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:14:10.257208 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:14:10.257208 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:14:10.257208 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:14:10.257208 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:14:10.257208 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:14:10.257208 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:14:10.257208 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 10:14:10.257208 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 10:14:10.257208 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 10:14:10.257208 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 10:14:10.258224 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:14:10.258224 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:14:10.258224 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 10:14:10.258224 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 10:14:10.258224 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 10:14:10.258224 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 10:14:10.258224 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:14:10.258224 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:14:10.258224 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:14:10.258224 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:14:10.258224 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:14:10.258224 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 19 10:14:10.258224 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:14:10.258224 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:14:10.258224 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:14:10.258224 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:14:10.258224 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:14:10.258224 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:14:10.259177 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:14:10.259177 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:14:10.259177 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 10:14:10.259177 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 10:14:10.259177 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 10:14:10.259177 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 10:14:10.259177 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 10:14:10.259177 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 10:14:10.259177 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 19 10:14:10.259177 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 19 10:14:10.259177 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 388/757] 10.222.0.66 () {56 vars in 1093 bytes} [Mon Sep 19 10:14:10 2022] GET /identity/v3/users/nova => generated 82 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:14:10.261135 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54799542-3c86-49e5-b71a-b85103819dfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:10.261856 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54799542-3c86-49e5-b71a-b85103819dfc None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:10.262200 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54799542-3c86-49e5-b71a-b85103819dfc None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:10.262535 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54799542-3c86-49e5-b71a-b85103819dfc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:10.263955 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68ca086-7d4f-4303-9977-143746507450 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:10.281472 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54799542-3c86-49e5-b71a-b85103819dfc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:10.283130 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54799542-3c86-49e5-b71a-b85103819dfc None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:10.306237 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-54799542-3c86-49e5-b71a-b85103819dfc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 10:14:10.306237 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:14:10.306237 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:14:10.306237 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:14:10.306237 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:14:10.306237 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:14:10.306237 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:14:10.306237 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:14:10.306237 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:14:10.306237 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:14:10.306237 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:14:10.306237 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:14:10.306237 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 10:14:10.306237 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 10:14:10.306237 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 10:14:10.307388 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 10:14:10.307388 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:14:10.307388 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:14:10.307388 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:14:10.307388 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:14:10.307388 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:14:10.307388 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:14:10.307388 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:14:10.307388 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Sep 19 10:14:10.307388 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:14:10.307388 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:14:10.307388 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:14:10.307388 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:14:10.307388 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:14:10.307388 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:14:10.307388 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:14:10.307388 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:14:10.313041 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 10:14:10.313041 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 10:14:10.313041 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 10:14:10.313041 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 10:14:10.313041 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 10:14:10.313041 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 10:14:10.313041 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 10:14:10.313041 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Sep 19 10:14:10.313041 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 370/758] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Sep 19 10:14:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:14:10.315752 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54799542-3c86-49e5-b71a-b85103819dfc None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:10.443306 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68ca086-7d4f-4303-9977-143746507450 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:10.478899 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:10.512751 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54799542-3c86-49e5-b71a-b85103819dfc None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:10.525976 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7884241b-66ef-4f86-ab18-1001c2fb3256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:10.526727 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7884241b-66ef-4f86-ab18-1001c2fb3256 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:10.527110 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7884241b-66ef-4f86-ab18-1001c2fb3256 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:10.527487 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7884241b-66ef-4f86-ab18-1001c2fb3256 None admin] PATH_INFO: `/v3/users` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:10.528361 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7884241b-66ef-4f86-ab18-1001c2fb3256 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:14:10.528757 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7884241b-66ef-4f86-ab18-1001c2fb3256 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:10.530285 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7884241b-66ef-4f86-ab18-1001c2fb3256 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:10.555566 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dd5895-ef67-4b23-b5c4-dfc04f12e816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:10.561039 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dd5895-ef67-4b23-b5c4-dfc04f12e816 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:10.561559 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dd5895-ef67-4b23-b5c4-dfc04f12e816 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:10.562044 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dd5895-ef67-4b23-b5c4-dfc04f12e816 None admin] PATH_INFO: `/v3/projects` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:10.562923 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dd5895-ef67-4b23-b5c4-dfc04f12e816 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:14:10.563384 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dd5895-ef67-4b23-b5c4-dfc04f12e816 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:10.565051 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dd5895-ef67-4b23-b5c4-dfc04f12e816 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:10.575157 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 389/759] 10.222.0.66 () {56 vars in 1133 bytes} [Mon Sep 19 10:14:10 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 10:14:10.585273 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7884241b-66ef-4f86-ab18-1001c2fb3256 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:10.592330 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 371/760] 10.222.0.66 () {56 vars in 1148 bytes} [Mon Sep 19 10:14:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 10:14:10.595893 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dd5895-ef67-4b23-b5c4-dfc04f12e816 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:10.692467 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:10.725474 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dd5895-ef67-4b23-b5c4-dfc04f12e816 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:10.763354 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457fafed-2295-4908-889d-d89459f02490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:10.764322 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457fafed-2295-4908-889d-d89459f02490 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:10.764785 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457fafed-2295-4908-889d-d89459f02490 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:10.765234 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457fafed-2295-4908-889d-d89459f02490 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:10.766217 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457fafed-2295-4908-889d-d89459f02490 None admin] RBAC: Adding query filter params (role.id=75952bc2767d49c1a6e49840d8a8f349, scope.project.id=be6b93ef3359434d9c776343f0aea333, user.id=e4d1160b71a84e2fa44a8ca6edf1846e) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:14:10.766721 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457fafed-2295-4908-889d-d89459f02490 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:10.768490 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457fafed-2295-4908-889d-d89459f02490 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:10.778845 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 372/761] 10.222.0.66 () {56 vars in 1374 bytes} [Mon Sep 19 10:14:10 2022] GET /identity/v3/role_assignments?user.id=e4d1160b71a84e2fa44a8ca6edf1846e&scope.project.id=be6b93ef3359434d9c776343f0aea333&role.id=75952bc2767d49c1a6e49840d8a8f349 => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 10:14:10.806706 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7884241b-66ef-4f86-ab18-1001c2fb3256 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:10.855898 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a20402-34a9-41ee-91a9-e28b918c8d22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:10.856590 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a20402-34a9-41ee-91a9-e28b918c8d22 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:10.856872 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a20402-34a9-41ee-91a9-e28b918c8d22 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:10.857147 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a20402-34a9-41ee-91a9-e28b918c8d22 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:10.869442 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a20402-34a9-41ee-91a9-e28b918c8d22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:10.870923 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a20402-34a9-41ee-91a9-e28b918c8d22 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:10.887485 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-88a20402-34a9-41ee-91a9-e28b918c8d22 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 10:14:10.887485 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:14:10.887485 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:14:10.887485 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:14:10.887485 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:14:10.887485 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:14:10.887485 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:14:10.887485 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:14:10.887485 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:14:10.887485 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:14:10.887485 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:14:10.887485 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:14:10.887485 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 10:14:10.887485 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 10:14:10.887485 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 10:14:10.887485 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 10:14:10.888520 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:14:10.888520 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:14:10.888520 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:14:10.888520 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:14:10.888520 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:14:10.888520 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:14:10.888520 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:14:10.888520 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 19 10:14:10.888520 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:14:10.888520 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:14:10.888520 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:14:10.888520 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:14:10.888520 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:14:10.888520 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:14:10.888520 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:14:10.888520 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:14:10.888520 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 10:14:10.890041 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 10:14:10.890041 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 10:14:10.890041 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 19 10:14:10.890041 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 390/762] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 19 10:14:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:14:10.894316 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457fafed-2295-4908-889d-d89459f02490 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:10.918456 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:11.032093 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457fafed-2295-4908-889d-d89459f02490 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:11.070746 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e49e96-0324-4427-94a7-2f1ba6a9da83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:11.071764 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e49e96-0324-4427-94a7-2f1ba6a9da83 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:11.072277 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e49e96-0324-4427-94a7-2f1ba6a9da83 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:11.072751 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e49e96-0324-4427-94a7-2f1ba6a9da83 None admin] PATH_INFO: `/v3/domains` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:11.073622 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e49e96-0324-4427-94a7-2f1ba6a9da83 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:14:11.074141 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e49e96-0324-4427-94a7-2f1ba6a9da83 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:11.075716 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e49e96-0324-4427-94a7-2f1ba6a9da83 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:11.090160 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 373/763] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Sep 19 10:14:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:14:11.095283 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a20402-34a9-41ee-91a9-e28b918c8d22 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:11.197396 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:11.215023 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a20402-34a9-41ee-91a9-e28b918c8d22 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:11.260102 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d56ca1-b46c-45b8-ba57-b050d159dc6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:11.261157 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d56ca1-b46c-45b8-ba57-b050d159dc6c None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:11.261641 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d56ca1-b46c-45b8-ba57-b050d159dc6c None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:11.262160 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d56ca1-b46c-45b8-ba57-b050d159dc6c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:11.271628 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d56ca1-b46c-45b8-ba57-b050d159dc6c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:11.273437 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d56ca1-b46c-45b8-ba57-b050d159dc6c None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:11.290043 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-57d56ca1-b46c-45b8-ba57-b050d159dc6c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 10:14:11.290043 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:14:11.290043 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:14:11.290043 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:14:11.290043 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:14:11.290043 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:14:11.290043 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:14:11.290043 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:14:11.290043 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:14:11.290043 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:14:11.290043 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:14:11.290043 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:14:11.290043 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 10:14:11.290043 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 10:14:11.290043 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 10:14:11.290978 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 10:14:11.290978 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:14:11.290978 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:14:11.290978 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:14:11.290978 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:14:11.290978 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:14:11.290978 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:14:11.290978 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:14:11.290978 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 19 10:14:11.290978 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:14:11.290978 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:14:11.290978 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:14:11.290978 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:14:11.290978 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:14:11.290978 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:14:11.290978 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:14:11.290978 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:14:11.291858 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 10:14:11.291858 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 10:14:11.291858 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 10:14:11.291858 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 10:14:11.291858 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 10:14:11.291858 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 10:14:11.291858 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 10:14:11.291858 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 19 10:14:11.294023 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 391/764] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Sep 19 10:14:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 10:14:11.299923 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e49e96-0324-4427-94a7-2f1ba6a9da83 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:11.377421 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:11.415127 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e49e96-0324-4427-94a7-2f1ba6a9da83 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:11.451756 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a527b5e9-cdd0-4412-ae00-e3ec19a450ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:11.454871 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a527b5e9-cdd0-4412-ae00-e3ec19a450ea None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:11.455363 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a527b5e9-cdd0-4412-ae00-e3ec19a450ea None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:11.455939 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a527b5e9-cdd0-4412-ae00-e3ec19a450ea None admin] PATH_INFO: `/v3/projects` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:11.457444 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a527b5e9-cdd0-4412-ae00-e3ec19a450ea None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:14:11.457955 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a527b5e9-cdd0-4412-ae00-e3ec19a450ea None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:11.459618 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a527b5e9-cdd0-4412-ae00-e3ec19a450ea None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:11.473482 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 374/765] 10.222.0.66 () {56 vars in 1148 bytes} [Mon Sep 19 10:14:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:14:11.479584 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d56ca1-b46c-45b8-ba57-b050d159dc6c None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:11.644011 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d56ca1-b46c-45b8-ba57-b050d159dc6c None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:11.690991 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0775b8e7-05ce-4297-a7ef-ed0174a843a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:11.692312 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0775b8e7-05ce-4297-a7ef-ed0174a843a6 None admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:11.692595 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0775b8e7-05ce-4297-a7ef-ed0174a843a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:11.692872 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0775b8e7-05ce-4297-a7ef-ed0174a843a6 None admin] PATH_INFO: `/v3/projects/be6b93ef3359434d9c776343f0aea333/users/15c70bfb085a44e9b84942b480ff22f1/roles/5c8b89fae4fa45bd944cbeaf442136e1` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:11.697442 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0775b8e7-05ce-4297-a7ef-ed0174a843a6 None admin] RBAC: Authorizing `identity:create_grant(project_id=be6b93ef3359434d9c776343f0aea333, user_id=15c70bfb085a44e9b84942b480ff22f1, role_id=5c8b89fae4fa45bd944cbeaf442136e1)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:11.698889 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0775b8e7-05ce-4297-a7ef-ed0174a843a6 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:11.721513 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 392/766] 10.222.0.66 () {58 vars in 1439 bytes} [Mon Sep 19 10:14:11 2022] PUT /identity/v3/projects/be6b93ef3359434d9c776343f0aea333/users/15c70bfb085a44e9b84942b480ff22f1/roles/5c8b89fae4fa45bd944cbeaf442136e1 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:14:11.975130 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff34344-ea2e-4aeb-a8b8-5bc6572013b3 None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:11.975655 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff34344-ea2e-4aeb-a8b8-5bc6572013b3 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:11.975655 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff34344-ea2e-4aeb-a8b8-5bc6572013b3 None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:11.977493 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 375/767] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:14:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:14:11.983898 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db29c252-9387-4d70-ae00-52ea07069e20 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:11.984258 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db29c252-9387-4d70-ae00-52ea07069e20 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:11.984478 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db29c252-9387-4d70-ae00-52ea07069e20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:12.013841 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-db29c252-9387-4d70-ae00-52ea07069e20 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:14:12.015046 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-db29c252-9387-4d70-ae00-52ea07069e20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:14:12.017201 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:12.116970 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 393/768] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:14:11 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 10:14:12.197241 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10405a1f-70ea-44dc-9ff8-b5a9fe139434 None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:12.197526 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10405a1f-70ea-44dc-9ff8-b5a9fe139434 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:12.197789 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10405a1f-70ea-44dc-9ff8-b5a9fe139434 None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:12.199260 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 376/769] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:14:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:14:12.205755 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e47ba27-e8d0-4cc0-9dd5-050934589ccc None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:12.206285 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e47ba27-e8d0-4cc0-9dd5-050934589ccc None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:12.206734 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e47ba27-e8d0-4cc0-9dd5-050934589ccc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:12.228451 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-2e47ba27-e8d0-4cc0-9dd5-050934589ccc None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:14:12.229896 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-2e47ba27-e8d0-4cc0-9dd5-050934589ccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:14:12.325463 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 394/770] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:14:12 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 10:14:12.511419 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10405a1f-70ea-44dc-9ff8-b5a9fe139434 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:12.595229 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f6c08e-748e-4398-9ed8-1f83d48ea8fd None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:12.595611 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f6c08e-748e-4398-9ed8-1f83d48ea8fd None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:12.595960 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f6c08e-748e-4398-9ed8-1f83d48ea8fd None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:12.597874 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 395/771] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:14:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 10:14:12.603172 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df8bb44-280d-4de0-a135-3faef70635cf None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:12.603513 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df8bb44-280d-4de0-a135-3faef70635cf None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:12.603866 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df8bb44-280d-4de0-a135-3faef70635cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:12.639458 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-4df8bb44-280d-4de0-a135-3faef70635cf None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:14:12.640732 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-4df8bb44-280d-4de0-a135-3faef70635cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:14:12.645076 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10405a1f-70ea-44dc-9ff8-b5a9fe139434 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:12.707012 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:12.713860 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c622b5f1-8fc7-4d78-8b74-19bf2e6349a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:12.714555 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c622b5f1-8fc7-4d78-8b74-19bf2e6349a9 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:12.714840 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c622b5f1-8fc7-4d78-8b74-19bf2e6349a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:12.715111 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c622b5f1-8fc7-4d78-8b74-19bf2e6349a9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:12.725740 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:12.730488 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c622b5f1-8fc7-4d78-8b74-19bf2e6349a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 10:14:12.733598 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 396/772] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:14:12 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 10:14:12.739305 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df8bb44-280d-4de0-a135-3faef70635cf None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:12.739437 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-c622b5f1-8fc7-4d78-8b74-19bf2e6349a9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 10:14:12.739437 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:14:12.739437 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:14:12.739437 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:14:12.739437 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:14:12.739437 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:14:12.739437 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:14:12.739437 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:14:12.739437 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:14:12.739437 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:14:12.739437 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:14:12.739437 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:14:12.739437 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 10:14:12.739437 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 10:14:12.739437 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 10:14:12.739437 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 10:14:12.740635 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 10:14:12.740635 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 10:14:12.740635 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 10:14:12.740635 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 10:14:12.740635 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:14:12.740635 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:14:12.740635 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:14:12.740635 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:14:12.740635 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:14:12.740635 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:14:12.740635 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:14:12.740635 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Sep 19 10:14:12.740635 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:14:12.740635 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:14:12.740635 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:14:12.740635 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:14:12.741594 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:14:12.741594 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:14:12.741594 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:14:12.741594 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:14:12.741594 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 10:14:12.741594 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 10:14:12.741594 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 10:14:12.741594 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 10:14:12.741594 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 10:14:12.741594 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 10:14:12.741594 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 10:14:12.741594 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Sep 19 10:14:12.741594 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 377/773] 10.222.0.66 () {56 vars in 1096 bytes} [Mon Sep 19 10:14:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:14:12.753436 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c622b5f1-8fc7-4d78-8b74-19bf2e6349a9 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:12.859811 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c622b5f1-8fc7-4d78-8b74-19bf2e6349a9 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:12.907075 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df8bb44-280d-4de0-a135-3faef70635cf None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:12.907315 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c00b71-60e2-4085-a6f7-4bc262df87ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:12.907705 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c00b71-60e2-4085-a6f7-4bc262df87ff None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:12.907990 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c00b71-60e2-4085-a6f7-4bc262df87ff None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:12.908286 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c00b71-60e2-4085-a6f7-4bc262df87ff None admin] PATH_INFO: `/v3/roles` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:12.908954 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c00b71-60e2-4085-a6f7-4bc262df87ff None admin] RBAC: Adding query filter params (name=admin) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:14:12.909253 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c00b71-60e2-4085-a6f7-4bc262df87ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:12.911183 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c00b71-60e2-4085-a6f7-4bc262df87ff None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:12.933553 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 378/774] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Sep 19 10:14:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:14:12.937441 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c00b71-60e2-4085-a6f7-4bc262df87ff None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:12.949029 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e25d63f-fe3a-462d-bb7f-56f7a3d0886c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:12.950077 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e25d63f-fe3a-462d-bb7f-56f7a3d0886c None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:12.950510 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e25d63f-fe3a-462d-bb7f-56f7a3d0886c None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:12.950936 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e25d63f-fe3a-462d-bb7f-56f7a3d0886c None admin] PATH_INFO: `/v3/services/network` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:12.951775 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e25d63f-fe3a-462d-bb7f-56f7a3d0886c None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:12.953342 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e25d63f-fe3a-462d-bb7f-56f7a3d0886c None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:12.963081 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-4e25d63f-fe3a-462d-bb7f-56f7a3d0886c None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 19 10:14:12.963081 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:14:12.963081 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 10:14:12.963081 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 10:14:12.963081 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 10:14:12.963081 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 10:14:12.963081 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 10:14:12.963081 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 10:14:12.963081 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 19 10:14:12.963081 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 19 10:14:12.963081 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 10:14:12.963081 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 19 10:14:12.963081 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:14:12.963081 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:14:12.963081 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:14:12.963081 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:14:12.963081 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:14:12.964312 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:14:12.964312 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:14:12.964312 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:14:12.964312 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:14:12.964312 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:14:12.964312 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:14:12.964312 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 10:14:12.964312 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 10:14:12.964312 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 10:14:12.964312 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 10:14:12.964312 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:14:12.964312 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:14:12.964312 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:14:12.964312 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:14:12.964312 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:14:12.964312 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:14:12.965231 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:14:12.965231 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 19 10:14:12.965231 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:14:12.965231 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:14:12.965231 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:14:12.965231 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:14:12.965231 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:14:12.965231 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:14:12.965231 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:14:12.965231 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:14:12.965231 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 10:14:12.965231 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 10:14:12.965231 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 19 10:14:12.965231 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 19 10:14:12.967552 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 397/775] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Sep 19 10:14:12 2022] GET /identity/v3/services/network => generated 88 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:14:12.976378 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e25d63f-fe3a-462d-bb7f-56f7a3d0886c None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:13.032977 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:13.044486 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:13.102314 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e25d63f-fe3a-462d-bb7f-56f7a3d0886c None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:13.149537 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72e4165-a368-4a58-94b5-5416a026617f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:13.150433 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72e4165-a368-4a58-94b5-5416a026617f None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:13.150882 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72e4165-a368-4a58-94b5-5416a026617f None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:13.151305 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72e4165-a368-4a58-94b5-5416a026617f None admin] PATH_INFO: `/v3/services` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:13.152080 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72e4165-a368-4a58-94b5-5416a026617f None admin] RBAC: Adding query filter params (name=network) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:14:13.152825 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72e4165-a368-4a58-94b5-5416a026617f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:13.155043 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c00b71-60e2-4085-a6f7-4bc262df87ff None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:13.156637 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72e4165-a368-4a58-94b5-5416a026617f None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:13.164476 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 398/776] 10.222.0.66 () {56 vars in 1112 bytes} [Mon Sep 19 10:14:12 2022] GET /identity/v3/services?name=network => generated 124 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 10:14:13.170290 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72e4165-a368-4a58-94b5-5416a026617f None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:13.226517 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25f2e32-08b5-4758-95c1-ee7b8b9326a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:13.228130 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25f2e32-08b5-4758-95c1-ee7b8b9326a3 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:13.228659 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25f2e32-08b5-4758-95c1-ee7b8b9326a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:13.229235 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25f2e32-08b5-4758-95c1-ee7b8b9326a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:13.241155 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25f2e32-08b5-4758-95c1-ee7b8b9326a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:13.242861 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25f2e32-08b5-4758-95c1-ee7b8b9326a3 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:13.270368 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-f25f2e32-08b5-4758-95c1-ee7b8b9326a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 10:14:13.270368 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:14:13.270368 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:14:13.270368 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:14:13.270368 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:14:13.270368 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:14:13.270368 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:14:13.270368 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:14:13.270368 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:14:13.270368 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:14:13.270368 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:14:13.270368 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:14:13.270368 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 10:14:13.270368 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 10:14:13.270368 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 10:14:13.270368 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 10:14:13.271574 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:14:13.271574 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:14:13.271574 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:14:13.271574 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:14:13.271574 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:14:13.271574 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:14:13.271574 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:14:13.271574 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Sep 19 10:14:13.271574 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:14:13.271574 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:14:13.271574 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:14:13.271574 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:14:13.271574 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:14:13.271574 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:14:13.271574 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:14:13.271574 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:14:13.271574 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 10:14:13.272662 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 10:14:13.272662 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 10:14:13.272662 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Sep 19 10:14:13.275561 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 379/777] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 19 10:14:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 338 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 10:14:13.276665 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25f2e32-08b5-4758-95c1-ee7b8b9326a3 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:13.335664 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72e4165-a368-4a58-94b5-5416a026617f None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:13.368748 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:13.379990 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeb813c-c964-4785-b62e-aa3340bae3ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:13.380919 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeb813c-c964-4785-b62e-aa3340bae3ec None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:13.381350 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeb813c-c964-4785-b62e-aa3340bae3ec None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:13.381793 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeb813c-c964-4785-b62e-aa3340bae3ec None admin] PATH_INFO: `/v3/services` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:13.382571 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eeb813c-c964-4785-b62e-aa3340bae3ec None admin] RBAC: Adding query filter params (type=network) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:14:13.383130 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eeb813c-c964-4785-b62e-aa3340bae3ec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:13.384718 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eeb813c-c964-4785-b62e-aa3340bae3ec None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:13.391500 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 399/778] 10.222.0.66 () {56 vars in 1112 bytes} [Mon Sep 19 10:14:13 2022] GET /identity/v3/services?type=network => generated 350 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 10:14:13.393049 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeb813c-c964-4785-b62e-aa3340bae3ec None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:13.394028 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:13.398287 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25f2e32-08b5-4758-95c1-ee7b8b9326a3 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:13.447366 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcde427-a17e-45b0-aef4-db63286ea4c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:13.447919 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcde427-a17e-45b0-aef4-db63286ea4c0 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:13.448225 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcde427-a17e-45b0-aef4-db63286ea4c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:13.448545 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcde427-a17e-45b0-aef4-db63286ea4c0 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:13.449140 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcde427-a17e-45b0-aef4-db63286ea4c0 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:13.450599 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcde427-a17e-45b0-aef4-db63286ea4c0 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:13.459851 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-1fcde427-a17e-45b0-aef4-db63286ea4c0 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 19 10:14:13.459851 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:14:13.459851 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 10:14:13.459851 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 10:14:13.459851 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 10:14:13.459851 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 10:14:13.459851 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 10:14:13.459851 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 10:14:13.459851 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 19 10:14:13.459851 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Sep 19 10:14:13.459851 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 10:14:13.459851 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Sep 19 10:14:13.459851 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:14:13.459851 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:14:13.459851 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:14:13.459851 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:14:13.459851 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:14:13.460906 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:14:13.460906 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:14:13.460906 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:14:13.460906 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:14:13.460906 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:14:13.460906 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:14:13.460906 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 10:14:13.460906 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 10:14:13.460906 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 10:14:13.460906 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 10:14:13.460906 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:14:13.460906 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:14:13.460906 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:14:13.460906 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:14:13.460906 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:14:13.460906 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:14:13.461755 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:14:13.461755 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Sep 19 10:14:13.461755 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:14:13.461755 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:14:13.461755 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:14:13.461755 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:14:13.461755 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:14:13.461755 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:14:13.461755 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:14:13.461755 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:14:13.461755 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 10:14:13.461755 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 10:14:13.461755 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 19 10:14:13.461755 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Sep 19 10:14:13.465915 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 380/779] 10.222.0.66 () {56 vars in 1129 bytes} [Mon Sep 19 10:14:13 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:14:13.467018 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcde427-a17e-45b0-aef4-db63286ea4c0 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:13.530313 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeb813c-c964-4785-b62e-aa3340bae3ec None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:13.568071 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39caeb9c-8e6b-4d34-8bae-1845f4345599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:13.568706 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39caeb9c-8e6b-4d34-8bae-1845f4345599 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:13.569227 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39caeb9c-8e6b-4d34-8bae-1845f4345599 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:13.569500 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39caeb9c-8e6b-4d34-8bae-1845f4345599 None admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:13.570675 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39caeb9c-8e6b-4d34-8bae-1845f4345599 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:14:13.571092 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39caeb9c-8e6b-4d34-8bae-1845f4345599 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:13.572482 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39caeb9c-8e6b-4d34-8bae-1845f4345599 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:13.572819 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcde427-a17e-45b0-aef4-db63286ea4c0 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:13.587372 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 400/780] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Sep 19 10:14:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:14:13.588796 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39caeb9c-8e6b-4d34-8bae-1845f4345599 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:13.612115 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b3e287-2cdf-446d-bb76-9a6865813442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:13.613612 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b3e287-2cdf-446d-bb76-9a6865813442 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:13.613888 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b3e287-2cdf-446d-bb76-9a6865813442 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:13.614178 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b3e287-2cdf-446d-bb76-9a6865813442 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:13.615039 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b3e287-2cdf-446d-bb76-9a6865813442 None admin] RBAC: Adding query filter params (interface=public, service_id=25928b945b024a7699f9a7a7791bd87a, region_id=RegionOne) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:14:13.615173 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b3e287-2cdf-446d-bb76-9a6865813442 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:13.616538 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b3e287-2cdf-446d-bb76-9a6865813442 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:13.623973 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 381/781] 10.222.0.66 () {56 vars in 1251 bytes} [Mon Sep 19 10:14:13 2022] GET /identity/v3/endpoints?service_id=25928b945b024a7699f9a7a7791bd87a&interface=public®ion_id=RegionOne => generated 194 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:14:13.625596 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264d09c5-c4e0-4e7f-a28b-91583cbce1b0 None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:13.625955 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264d09c5-c4e0-4e7f-a28b-91583cbce1b0 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:13.626317 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264d09c5-c4e0-4e7f-a28b-91583cbce1b0 None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:13.627746 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 382/782] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:14:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:14:13.629517 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264d09c5-c4e0-4e7f-a28b-91583cbce1b0 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:13.646388 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:13.667477 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:13.715590 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39caeb9c-8e6b-4d34-8bae-1845f4345599 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:13.753194 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc051019-c67e-4af7-b1f9-527f9fb9001a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:13.753912 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc051019-c67e-4af7-b1f9-527f9fb9001a None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:13.754090 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc051019-c67e-4af7-b1f9-527f9fb9001a None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:13.754356 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc051019-c67e-4af7-b1f9-527f9fb9001a None admin] PATH_INFO: `/v3/services` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:13.754973 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc051019-c67e-4af7-b1f9-527f9fb9001a None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:14:13.755270 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc051019-c67e-4af7-b1f9-527f9fb9001a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:13.755800 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264d09c5-c4e0-4e7f-a28b-91583cbce1b0 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:13.756673 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc051019-c67e-4af7-b1f9-527f9fb9001a None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:13.762212 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 401/783] 10.222.0.66 () {56 vars in 1124 bytes} [Mon Sep 19 10:14:13 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:14:13.765057 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc051019-c67e-4af7-b1f9-527f9fb9001a None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:13.793812 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d03879-4652-4520-8883-fc4b16c367d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:13.794899 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d03879-4652-4520-8883-fc4b16c367d5 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:13.795014 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d03879-4652-4520-8883-fc4b16c367d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:13.795225 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d03879-4652-4520-8883-fc4b16c367d5 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:13.802580 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d03879-4652-4520-8883-fc4b16c367d5 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:13.804046 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d03879-4652-4520-8883-fc4b16c367d5 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:13.819437 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-e7d03879-4652-4520-8883-fc4b16c367d5 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 19 10:14:13.819437 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:14:13.819437 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:14:13.819437 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:14:13.819437 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:14:13.819437 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:14:13.819437 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:14:13.819437 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:14:13.819437 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:14:13.819437 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:14:13.819437 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:14:13.819437 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:14:13.819437 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 10:14:13.819437 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 10:14:13.819437 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 10:14:13.819437 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 10:14:13.820468 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:14:13.820468 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:14:13.820468 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 10:14:13.820468 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 10:14:13.820468 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 10:14:13.820468 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 10:14:13.820468 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:14:13.820468 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:14:13.820468 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:14:13.820468 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:14:13.820468 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:14:13.820468 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Sep 19 10:14:13.820468 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:14:13.820468 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:14:13.820468 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:14:13.820468 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:14:13.820468 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:14:13.820468 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:14:13.821444 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:14:13.821444 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:14:13.821444 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 10:14:13.821444 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 10:14:13.821444 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 10:14:13.821444 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 10:14:13.821444 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 10:14:13.821444 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 10:14:13.821444 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 19 10:14:13.821444 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Sep 19 10:14:13.821444 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 383/784] 10.222.0.66 () {56 vars in 1096 bytes} [Mon Sep 19 10:14:13 2022] GET /identity/v3/users/swift => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:14:13.822026 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c117ac-f6bc-4640-9516-a46d6b4349bd None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:13.822621 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c117ac-f6bc-4640-9516-a46d6b4349bd None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:13.822621 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c117ac-f6bc-4640-9516-a46d6b4349bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:13.842815 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-e6c117ac-f6bc-4640-9516-a46d6b4349bd None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:14:13.844011 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-e6c117ac-f6bc-4640-9516-a46d6b4349bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:14:13.884995 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc051019-c67e-4af7-b1f9-527f9fb9001a None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:13.906252 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:13.920320 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 384/785] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:14:13 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 10:14:13.921217 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c117ac-f6bc-4640-9516-a46d6b4349bd None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:13.931695 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25b104d-866b-493a-a577-2e62e4abaa1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:13.932346 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25b104d-866b-493a-a577-2e62e4abaa1c None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:13.932631 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25b104d-866b-493a-a577-2e62e4abaa1c None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:13.932920 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25b104d-866b-493a-a577-2e62e4abaa1c None admin] PATH_INFO: `/v3/services` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:13.933981 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25b104d-866b-493a-a577-2e62e4abaa1c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:13.935722 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25b104d-866b-493a-a577-2e62e4abaa1c None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:13.952223 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 402/786] 10.222.0.66 () {56 vars in 1087 bytes} [Mon Sep 19 10:14:13 2022] GET /identity/v3/services => generated 772 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:14:13.952223 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25b104d-866b-493a-a577-2e62e4abaa1c None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:13.959942 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:14.149508 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c117ac-f6bc-4640-9516-a46d6b4349bd None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:14.160398 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25b104d-866b-493a-a577-2e62e4abaa1c None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:14.192527 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e7daf7-53ed-4422-a98a-6d75f91be688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:14.193198 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e7daf7-53ed-4422-a98a-6d75f91be688 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:14.193561 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e7daf7-53ed-4422-a98a-6d75f91be688 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:14.193752 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e7daf7-53ed-4422-a98a-6d75f91be688 None admin] PATH_INFO: `/v3/services` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:14.194388 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e7daf7-53ed-4422-a98a-6d75f91be688 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:14:14.194688 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e7daf7-53ed-4422-a98a-6d75f91be688 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:14.196334 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e7daf7-53ed-4422-a98a-6d75f91be688 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:14.202153 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 385/787] 10.222.0.66 () {56 vars in 1124 bytes} [Mon Sep 19 10:14:13 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:14:14.203155 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e7daf7-53ed-4422-a98a-6d75f91be688 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:14.204704 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6ba99a-472e-441f-9e92-f5d9e064bd6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:14.205561 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6ba99a-472e-441f-9e92-f5d9e064bd6b None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:14.205982 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6ba99a-472e-441f-9e92-f5d9e064bd6b None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:14.206412 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6ba99a-472e-441f-9e92-f5d9e064bd6b None admin] PATH_INFO: `/v3/users` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:14.207330 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6ba99a-472e-441f-9e92-f5d9e064bd6b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:14:14.207631 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6ba99a-472e-441f-9e92-f5d9e064bd6b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:14.209111 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6ba99a-472e-441f-9e92-f5d9e064bd6b None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:14.231393 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 403/788] 10.222.0.66 () {56 vars in 1135 bytes} [Mon Sep 19 10:14:13 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:14:14.232324 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6ba99a-472e-441f-9e92-f5d9e064bd6b None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:14.283858 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:14.314927 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:14.338620 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e7daf7-53ed-4422-a98a-6d75f91be688 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:14.362512 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6ba99a-472e-441f-9e92-f5d9e064bd6b None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:14.376810 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bf321b-1d5e-42f3-87df-a9d7418b2db9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:14.377904 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bf321b-1d5e-42f3-87df-a9d7418b2db9 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:14.378389 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bf321b-1d5e-42f3-87df-a9d7418b2db9 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:14.378966 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bf321b-1d5e-42f3-87df-a9d7418b2db9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:14.392158 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bf321b-1d5e-42f3-87df-a9d7418b2db9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 10:14:14.398839 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-b7bf321b-1d5e-42f3-87df-a9d7418b2db9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 10:14:14.398839 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:14:14.398839 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:14:14.398839 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:14:14.398839 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:14:14.398839 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:14:14.398839 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:14:14.398839 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:14:14.398839 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:14:14.398839 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:14:14.398839 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:14:14.398839 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:14:14.398839 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 10:14:14.398839 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 10:14:14.398839 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 10:14:14.398839 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 10:14:14.399899 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 10:14:14.399899 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 10:14:14.399899 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 10:14:14.399899 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 10:14:14.399899 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:14:14.399899 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:14:14.399899 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:14:14.399899 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:14:14.399899 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:14:14.399899 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:14:14.399899 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:14:14.399899 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Sep 19 10:14:14.399899 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:14:14.399899 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:14:14.399899 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:14:14.399899 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:14:14.400794 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:14:14.400794 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:14:14.400794 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:14:14.400794 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:14:14.400794 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 10:14:14.400794 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 10:14:14.400794 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 10:14:14.400794 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 10:14:14.400794 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 10:14:14.400794 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 10:14:14.400794 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 10:14:14.400794 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Sep 19 10:14:14.401944 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 386/789] 10.222.0.66 () {56 vars in 1102 bytes} [Mon Sep 19 10:14:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:14:14.402949 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bf321b-1d5e-42f3-87df-a9d7418b2db9 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:14.404815 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0854679a-1307-4d96-91ab-561da343055d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:14.405437 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0854679a-1307-4d96-91ab-561da343055d None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:14.405774 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0854679a-1307-4d96-91ab-561da343055d None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:14.406131 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0854679a-1307-4d96-91ab-561da343055d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:14.406849 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0854679a-1307-4d96-91ab-561da343055d None admin] RBAC: Adding query filter params (interface=public, service_id=6abdc454edf048cb8f5ffa8ba791b098, region_id=RegionOne) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:14:14.407270 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0854679a-1307-4d96-91ab-561da343055d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:14.408798 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0854679a-1307-4d96-91ab-561da343055d None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:14.418198 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 404/790] 10.222.0.66 () {56 vars in 1251 bytes} [Mon Sep 19 10:14:14 2022] GET /identity/v3/endpoints?service_id=6abdc454edf048cb8f5ffa8ba791b098&interface=public®ion_id=RegionOne => generated 194 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:14:14.419352 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0854679a-1307-4d96-91ab-561da343055d None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:14.519320 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bf321b-1d5e-42f3-87df-a9d7418b2db9 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:14.560218 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb54cd7b-dc34-4720-b314-e07ef0c3b7b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:14.560218 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb54cd7b-dc34-4720-b314-e07ef0c3b7b6 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:14.560218 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb54cd7b-dc34-4720-b314-e07ef0c3b7b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:14.560218 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb54cd7b-dc34-4720-b314-e07ef0c3b7b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:14.573124 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb54cd7b-dc34-4720-b314-e07ef0c3b7b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:14.574611 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb54cd7b-dc34-4720-b314-e07ef0c3b7b6 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:14.576975 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:14.591672 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-cb54cd7b-dc34-4720-b314-e07ef0c3b7b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 10:14:14.591672 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:14:14.591672 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:14:14.591672 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:14:14.591672 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:14:14.591672 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:14:14.591672 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:14:14.591672 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:14:14.591672 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:14:14.591672 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:14:14.591672 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:14:14.591672 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:14:14.591672 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 10:14:14.591672 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 10:14:14.591672 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 10:14:14.591672 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 10:14:14.592991 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:14:14.592991 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:14:14.592991 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:14:14.592991 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:14:14.592991 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:14:14.592991 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:14:14.592991 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:14:14.592991 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Sep 19 10:14:14.592991 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:14:14.592991 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:14:14.592991 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:14:14.592991 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:14:14.592991 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:14:14.592991 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:14:14.592991 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:14:14.592991 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:14:14.592991 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 10:14:14.594254 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 10:14:14.594254 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 10:14:14.594254 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Sep 19 10:14:14.597980 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 387/791] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 19 10:14:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:14:14.599733 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7fe7e8-7c48-4577-aad7-2ae2df4c78f0 None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:14.600021 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7fe7e8-7c48-4577-aad7-2ae2df4c78f0 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:14.600350 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7fe7e8-7c48-4577-aad7-2ae2df4c78f0 None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:14.601820 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 388/792] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:14:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:14:14.606226 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7fe7e8-7c48-4577-aad7-2ae2df4c78f0 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:14.641997 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:14.645416 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0854679a-1307-4d96-91ab-561da343055d None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:14.686466 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b43bfd-0c7e-4669-bfc1-cb9042c38203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:14.686996 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b43bfd-0c7e-4669-bfc1-cb9042c38203 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:14.687303 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b43bfd-0c7e-4669-bfc1-cb9042c38203 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:14.687576 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b43bfd-0c7e-4669-bfc1-cb9042c38203 None admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:14.688282 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b43bfd-0c7e-4669-bfc1-cb9042c38203 None admin] RBAC: Adding query filter params (name=service) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:14:14.688586 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b43bfd-0c7e-4669-bfc1-cb9042c38203 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:14.690753 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b43bfd-0c7e-4669-bfc1-cb9042c38203 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:14.702539 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 405/793] 10.222.0.66 () {56 vars in 1103 bytes} [Mon Sep 19 10:14:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:14:14.702539 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b43bfd-0c7e-4669-bfc1-cb9042c38203 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:14.734821 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7fe7e8-7c48-4577-aad7-2ae2df4c78f0 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:14.774868 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414788e4-432e-447c-ad41-8aa9610bc73f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:14.775810 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414788e4-432e-447c-ad41-8aa9610bc73f None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:14.776309 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414788e4-432e-447c-ad41-8aa9610bc73f None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:14.776577 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414788e4-432e-447c-ad41-8aa9610bc73f None admin] PATH_INFO: `/v3/services` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:14.777190 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414788e4-432e-447c-ad41-8aa9610bc73f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:14.778565 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414788e4-432e-447c-ad41-8aa9610bc73f None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:14.792608 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 389/794] 10.222.0.66 () {56 vars in 1087 bytes} [Mon Sep 19 10:14:14 2022] GET /identity/v3/services => generated 772 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:14:14.794316 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b568b4-2e46-4c2c-b360-35c7bc091950 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:14.794606 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b568b4-2e46-4c2c-b360-35c7bc091950 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:14.794876 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b568b4-2e46-4c2c-b360-35c7bc091950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:14.815415 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-82b568b4-2e46-4c2c-b360-35c7bc091950 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:14:14.816623 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-82b568b4-2e46-4c2c-b360-35c7bc091950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:14:14.819282 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b43bfd-0c7e-4669-bfc1-cb9042c38203 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:14.862741 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53f5e6b-3fa2-4a84-8e86-8a2965b99f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:14.864018 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53f5e6b-3fa2-4a84-8e86-8a2965b99f2b None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:14.864430 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53f5e6b-3fa2-4a84-8e86-8a2965b99f2b None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:14.864765 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53f5e6b-3fa2-4a84-8e86-8a2965b99f2b None admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:14.865494 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53f5e6b-3fa2-4a84-8e86-8a2965b99f2b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:14:14.865864 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53f5e6b-3fa2-4a84-8e86-8a2965b99f2b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:14.867574 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53f5e6b-3fa2-4a84-8e86-8a2965b99f2b None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:14.881216 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 406/795] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Sep 19 10:14:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:14:14.885424 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53f5e6b-3fa2-4a84-8e86-8a2965b99f2b None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:14.896427 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:14.917046 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:14.923290 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 390/796] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:14:14 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 10:14:14.924730 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b568b4-2e46-4c2c-b360-35c7bc091950 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:15.047282 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53f5e6b-3fa2-4a84-8e86-8a2965b99f2b None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:15.047768 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b568b4-2e46-4c2c-b360-35c7bc091950 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:15.085081 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b99daf2-1488-4cd7-a2dc-998b34fb6807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:15.085969 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b99daf2-1488-4cd7-a2dc-998b34fb6807 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:15.086241 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b99daf2-1488-4cd7-a2dc-998b34fb6807 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:15.086506 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b99daf2-1488-4cd7-a2dc-998b34fb6807 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:15.090090 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e6f92f-db78-4a08-b050-f4e9bd3d40a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:15.090779 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e6f92f-db78-4a08-b050-f4e9bd3d40a7 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:15.091060 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e6f92f-db78-4a08-b050-f4e9bd3d40a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:15.091332 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e6f92f-db78-4a08-b050-f4e9bd3d40a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:15.093740 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b99daf2-1488-4cd7-a2dc-998b34fb6807 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:15.095508 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b99daf2-1488-4cd7-a2dc-998b34fb6807 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:15.104432 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e6f92f-db78-4a08-b050-f4e9bd3d40a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:15.105879 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e6f92f-db78-4a08-b050-f4e9bd3d40a7 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:15.110751 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-4b99daf2-1488-4cd7-a2dc-998b34fb6807 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 10:14:15.110751 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:14:15.110751 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:14:15.110751 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:14:15.110751 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:14:15.110751 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:14:15.110751 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:14:15.110751 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:14:15.110751 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:14:15.110751 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:14:15.110751 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:14:15.110751 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:14:15.110751 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 10:14:15.110751 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 10:14:15.110751 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 10:14:15.111617 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 10:14:15.111617 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:14:15.111617 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:14:15.111617 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:14:15.111617 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:14:15.111617 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:14:15.111617 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:14:15.111617 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:14:15.111617 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Sep 19 10:14:15.111617 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:14:15.111617 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:14:15.111617 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:14:15.111617 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:14:15.111617 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:14:15.111617 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:14:15.111617 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:14:15.111617 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:14:15.112536 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 10:14:15.112536 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 10:14:15.112536 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 10:14:15.112536 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 10:14:15.112536 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 10:14:15.112536 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 10:14:15.112536 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 10:14:15.112536 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Sep 19 10:14:15.112536 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 391/797] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Sep 19 10:14:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:14:15.119573 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b99daf2-1488-4cd7-a2dc-998b34fb6807 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:15.125878 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-d9e6f92f-db78-4a08-b050-f4e9bd3d40a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 10:14:15.125878 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:14:15.125878 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:14:15.125878 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:14:15.125878 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:14:15.125878 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:14:15.125878 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:14:15.125878 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:14:15.125878 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:14:15.125878 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:14:15.125878 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:14:15.125878 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:14:15.125878 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 10:14:15.125878 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 10:14:15.125878 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 10:14:15.125878 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 10:14:15.127975 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:14:15.127975 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:14:15.127975 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:14:15.127975 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:14:15.127975 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:14:15.127975 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:14:15.127975 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:14:15.127975 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 19 10:14:15.127975 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:14:15.127975 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:14:15.127975 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:14:15.127975 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:14:15.127975 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:14:15.127975 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:14:15.127975 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:14:15.127975 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:14:15.127975 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 10:14:15.130646 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 10:14:15.130646 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 10:14:15.130646 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 19 10:14:15.130646 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 407/798] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 19 10:14:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:14:15.136702 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e6f92f-db78-4a08-b050-f4e9bd3d40a7 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:15.220534 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:15.228030 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:15.258795 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e6f92f-db78-4a08-b050-f4e9bd3d40a7 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:15.302713 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cb3962-330b-47de-8eb1-a6453fb55d36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:15.303580 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cb3962-330b-47de-8eb1-a6453fb55d36 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:15.304012 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cb3962-330b-47de-8eb1-a6453fb55d36 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:15.306020 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cb3962-330b-47de-8eb1-a6453fb55d36 None admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:15.306825 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cb3962-330b-47de-8eb1-a6453fb55d36 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:14:15.307273 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cb3962-330b-47de-8eb1-a6453fb55d36 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:15.309861 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cb3962-330b-47de-8eb1-a6453fb55d36 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:15.328184 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b99daf2-1488-4cd7-a2dc-998b34fb6807 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:15.337283 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 408/799] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Sep 19 10:14:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 10:14:15.338518 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cb3962-330b-47de-8eb1-a6453fb55d36 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:15.365924 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19c8c3a-c439-48a7-91eb-3b0648df0c26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:15.366560 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19c8c3a-c439-48a7-91eb-3b0648df0c26 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:15.366838 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19c8c3a-c439-48a7-91eb-3b0648df0c26 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:15.367110 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19c8c3a-c439-48a7-91eb-3b0648df0c26 None admin] PATH_INFO: `/v3/projects` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:15.367803 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19c8c3a-c439-48a7-91eb-3b0648df0c26 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:14:15.368105 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19c8c3a-c439-48a7-91eb-3b0648df0c26 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:15.369574 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19c8c3a-c439-48a7-91eb-3b0648df0c26 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:15.386605 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 392/800] 10.222.0.66 () {56 vars in 1148 bytes} [Mon Sep 19 10:14:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 10:14:15.386605 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19c8c3a-c439-48a7-91eb-3b0648df0c26 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:15.477492 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cb3962-330b-47de-8eb1-a6453fb55d36 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:15.506433 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19c8c3a-c439-48a7-91eb-3b0648df0c26 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:15.518792 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:15.519549 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37dd061-ee51-4e31-a312-7126ac6ed79a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:15.520808 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37dd061-ee51-4e31-a312-7126ac6ed79a None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:15.521431 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37dd061-ee51-4e31-a312-7126ac6ed79a None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:15.522124 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37dd061-ee51-4e31-a312-7126ac6ed79a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:15.526976 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:15.542229 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37dd061-ee51-4e31-a312-7126ac6ed79a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 10:14:15.548271 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-e37dd061-ee51-4e31-a312-7126ac6ed79a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 10:14:15.548271 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:14:15.548271 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:14:15.548271 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:14:15.548271 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:14:15.548271 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:14:15.548271 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:14:15.548271 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:14:15.548271 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:14:15.548271 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:14:15.548271 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:14:15.548271 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:14:15.548271 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 10:14:15.548271 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 10:14:15.548271 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 10:14:15.548271 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 10:14:15.549394 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 10:14:15.549394 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 10:14:15.549394 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 10:14:15.549394 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 10:14:15.549394 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:14:15.549394 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:14:15.549394 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:14:15.549394 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:14:15.549394 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:14:15.549394 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:14:15.549394 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:14:15.549394 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 19 10:14:15.549394 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:14:15.549394 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:14:15.549394 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:14:15.549394 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:14:15.550377 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:14:15.550377 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:14:15.550377 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:14:15.550377 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:14:15.550377 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 10:14:15.550377 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 10:14:15.550377 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 10:14:15.550377 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 10:14:15.550377 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 10:14:15.550377 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 10:14:15.550377 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 10:14:15.550377 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 19 10:14:15.552021 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 409/801] 10.222.0.66 () {56 vars in 1096 bytes} [Mon Sep 19 10:14:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:14:15.553251 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37dd061-ee51-4e31-a312-7126ac6ed79a None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:15.555170 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cf14ee-c328-4ef6-bfe3-946353441a74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:15.556004 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cf14ee-c328-4ef6-bfe3-946353441a74 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:15.556884 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cf14ee-c328-4ef6-bfe3-946353441a74 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:15.557332 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cf14ee-c328-4ef6-bfe3-946353441a74 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:15.567417 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cf14ee-c328-4ef6-bfe3-946353441a74 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:15.569629 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cf14ee-c328-4ef6-bfe3-946353441a74 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:15.586977 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-e8cf14ee-c328-4ef6-bfe3-946353441a74 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 19 10:14:15.586977 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:14:15.586977 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:14:15.586977 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:14:15.586977 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:14:15.586977 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:14:15.586977 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:14:15.586977 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:14:15.586977 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:14:15.586977 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:14:15.586977 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:14:15.586977 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:14:15.586977 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 10:14:15.586977 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 10:14:15.586977 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 10:14:15.586977 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 10:14:15.587954 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:14:15.587954 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:14:15.587954 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 10:14:15.587954 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 10:14:15.587954 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 10:14:15.587954 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 10:14:15.587954 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:14:15.587954 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:14:15.587954 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:14:15.587954 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:14:15.587954 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:14:15.587954 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Sep 19 10:14:15.587954 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:14:15.587954 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:14:15.587954 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:14:15.587954 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:14:15.587954 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:14:15.587954 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:14:15.588914 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:14:15.588914 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:14:15.588914 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 10:14:15.588914 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 10:14:15.588914 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 10:14:15.588914 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 10:14:15.588914 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 10:14:15.588914 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 10:14:15.588914 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 19 10:14:15.588914 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Sep 19 10:14:15.590139 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 393/802] 10.222.0.66 () {56 vars in 1117 bytes} [Mon Sep 19 10:14:15 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:14:15.590535 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cf14ee-c328-4ef6-bfe3-946353441a74 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:15.672675 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37dd061-ee51-4e31-a312-7126ac6ed79a None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:15.707495 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cf14ee-c328-4ef6-bfe3-946353441a74 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:15.715078 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53568185-830c-4c69-9261-fdef46478ab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:15.716195 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53568185-830c-4c69-9261-fdef46478ab1 None admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:15.716195 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53568185-830c-4c69-9261-fdef46478ab1 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:15.716522 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53568185-830c-4c69-9261-fdef46478ab1 None admin] PATH_INFO: `/v3/projects/be6b93ef3359434d9c776343f0aea333/users/6677354e36614c9fb3d03413749be5ca/roles/5c8b89fae4fa45bd944cbeaf442136e1` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:15.718703 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53568185-830c-4c69-9261-fdef46478ab1 None admin] RBAC: Authorizing `identity:create_grant(project_id=be6b93ef3359434d9c776343f0aea333, user_id=6677354e36614c9fb3d03413749be5ca, role_id=5c8b89fae4fa45bd944cbeaf442136e1)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:15.720301 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53568185-830c-4c69-9261-fdef46478ab1 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:15.738004 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 410/803] 10.222.0.66 () {58 vars in 1439 bytes} [Mon Sep 19 10:14:15 2022] PUT /identity/v3/projects/be6b93ef3359434d9c776343f0aea333/users/6677354e36614c9fb3d03413749be5ca/roles/5c8b89fae4fa45bd944cbeaf442136e1 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:14:15.739171 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53568185-830c-4c69-9261-fdef46478ab1 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:15.756620 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914fea32-fefe-4c0f-88cf-24ad9d154242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:15.757304 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914fea32-fefe-4c0f-88cf-24ad9d154242 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:15.757597 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914fea32-fefe-4c0f-88cf-24ad9d154242 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:15.757872 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914fea32-fefe-4c0f-88cf-24ad9d154242 None admin] PATH_INFO: `/v3/roles` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:15.759305 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914fea32-fefe-4c0f-88cf-24ad9d154242 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:14:15.759621 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914fea32-fefe-4c0f-88cf-24ad9d154242 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:15.761419 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914fea32-fefe-4c0f-88cf-24ad9d154242 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:15.773786 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 394/804] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Sep 19 10:14:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:14:15.780484 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914fea32-fefe-4c0f-88cf-24ad9d154242 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:15.852301 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:15.856129 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:15.937332 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53568185-830c-4c69-9261-fdef46478ab1 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:15.980891 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914fea32-fefe-4c0f-88cf-24ad9d154242 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:15.991748 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343a6bd1-62be-4cd2-9102-33a3bdfee847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:15.992381 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343a6bd1-62be-4cd2-9102-33a3bdfee847 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:15.992657 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343a6bd1-62be-4cd2-9102-33a3bdfee847 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:15.992924 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343a6bd1-62be-4cd2-9102-33a3bdfee847 None admin] PATH_INFO: `/v3/users` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:15.993641 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343a6bd1-62be-4cd2-9102-33a3bdfee847 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:14:15.993935 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343a6bd1-62be-4cd2-9102-33a3bdfee847 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:15.995475 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343a6bd1-62be-4cd2-9102-33a3bdfee847 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:16.017302 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 411/805] 10.222.0.66 () {56 vars in 1149 bytes} [Mon Sep 19 10:14:15 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:14:16.023302 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343a6bd1-62be-4cd2-9102-33a3bdfee847 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:16.026827 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af529c28-fdce-468f-aed4-f319dee8545b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:16.027740 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af529c28-fdce-468f-aed4-f319dee8545b None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:16.028327 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af529c28-fdce-468f-aed4-f319dee8545b None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:16.028809 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af529c28-fdce-468f-aed4-f319dee8545b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:16.040801 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af529c28-fdce-468f-aed4-f319dee8545b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:16.042618 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af529c28-fdce-468f-aed4-f319dee8545b None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:16.058736 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-af529c28-fdce-468f-aed4-f319dee8545b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 10:14:16.058736 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:14:16.058736 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:14:16.058736 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:14:16.058736 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:14:16.058736 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:14:16.058736 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:14:16.058736 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:14:16.058736 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:14:16.058736 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:14:16.058736 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:14:16.058736 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:14:16.058736 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 10:14:16.058736 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 10:14:16.058736 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 10:14:16.058736 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 10:14:16.059735 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:14:16.059735 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:14:16.059735 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:14:16.059735 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:14:16.059735 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:14:16.059735 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:14:16.059735 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:14:16.059735 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Sep 19 10:14:16.059735 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:14:16.059735 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:14:16.059735 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:14:16.059735 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:14:16.059735 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:14:16.059735 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:14:16.059735 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:14:16.059735 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:14:16.059735 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 10:14:16.060664 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 10:14:16.060664 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 10:14:16.060664 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Sep 19 10:14:16.064330 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 395/806] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 19 10:14:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:14:16.068113 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af529c28-fdce-468f-aed4-f319dee8545b None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:16.171263 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:16.191978 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af529c28-fdce-468f-aed4-f319dee8545b None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:16.196154 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343a6bd1-62be-4cd2-9102-33a3bdfee847 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:16.212639 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:16.233719 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56a0493-3d3f-4a4b-a962-7a09038718fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:16.236114 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56a0493-3d3f-4a4b-a962-7a09038718fb None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:16.237313 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56a0493-3d3f-4a4b-a962-7a09038718fb None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:16.238219 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56a0493-3d3f-4a4b-a962-7a09038718fb None admin] PATH_INFO: `/v3/domains` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:16.239643 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56a0493-3d3f-4a4b-a962-7a09038718fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:14:16.240636 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56a0493-3d3f-4a4b-a962-7a09038718fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:16.243587 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56a0493-3d3f-4a4b-a962-7a09038718fb None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:16.244395 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ff6651-2119-4898-b4c1-892ec7d6668f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:16.246460 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ff6651-2119-4898-b4c1-892ec7d6668f None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:16.246925 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ff6651-2119-4898-b4c1-892ec7d6668f None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:16.248079 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ff6651-2119-4898-b4c1-892ec7d6668f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:16.273521 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ff6651-2119-4898-b4c1-892ec7d6668f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:16.275732 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 396/807] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Sep 19 10:14:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 10:14:16.277685 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ff6651-2119-4898-b4c1-892ec7d6668f None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:16.282279 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56a0493-3d3f-4a4b-a962-7a09038718fb None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:16.313917 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-04ff6651-2119-4898-b4c1-892ec7d6668f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 10:14:16.313917 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:14:16.313917 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:14:16.313917 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:14:16.313917 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:14:16.313917 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:14:16.313917 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:14:16.313917 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:14:16.313917 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:14:16.313917 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:14:16.313917 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:14:16.313917 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:14:16.313917 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 10:14:16.313917 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 10:14:16.313917 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 10:14:16.313917 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 10:14:16.315214 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:14:16.315214 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:14:16.315214 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:14:16.315214 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:14:16.315214 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:14:16.315214 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:14:16.315214 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:14:16.315214 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 19 10:14:16.315214 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:14:16.315214 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:14:16.315214 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:14:16.315214 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:14:16.315214 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:14:16.315214 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:14:16.315214 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:14:16.315214 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:14:16.315214 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 10:14:16.316397 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 10:14:16.316397 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 10:14:16.316397 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 19 10:14:16.318463 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 412/808] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 19 10:14:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 10:14:16.323782 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ff6651-2119-4898-b4c1-892ec7d6668f None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:16.442375 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56a0493-3d3f-4a4b-a962-7a09038718fb None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:16.477067 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ff6651-2119-4898-b4c1-892ec7d6668f None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:16.484080 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0572902-2e03-4f5e-b62a-d9e52469d4d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:16.484801 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0572902-2e03-4f5e-b62a-d9e52469d4d3 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:16.485086 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0572902-2e03-4f5e-b62a-d9e52469d4d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:16.485361 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0572902-2e03-4f5e-b62a-d9e52469d4d3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:16.495509 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0572902-2e03-4f5e-b62a-d9e52469d4d3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:16.497420 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0572902-2e03-4f5e-b62a-d9e52469d4d3 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:16.511977 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-b0572902-2e03-4f5e-b62a-d9e52469d4d3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 19 10:14:16.511977 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:14:16.511977 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:14:16.511977 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:14:16.511977 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:14:16.511977 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:14:16.511977 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:14:16.511977 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:14:16.511977 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:14:16.511977 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:14:16.511977 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:14:16.511977 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:14:16.511977 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 10:14:16.511977 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 10:14:16.511977 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 10:14:16.511977 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 10:14:16.513166 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:14:16.513166 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:14:16.513166 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 10:14:16.513166 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 10:14:16.513166 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 10:14:16.513166 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 10:14:16.513166 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:14:16.513166 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:14:16.513166 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:14:16.513166 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:14:16.513166 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:14:16.513166 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Sep 19 10:14:16.513166 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:14:16.513166 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:14:16.513166 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:14:16.513166 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:14:16.513166 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:14:16.513166 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:14:16.514290 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:14:16.514290 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:14:16.514290 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 10:14:16.514290 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 10:14:16.514290 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 10:14:16.514290 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 10:14:16.514290 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 10:14:16.514290 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 10:14:16.514290 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 19 10:14:16.514290 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Sep 19 10:14:16.516562 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 397/809] 10.222.0.66 () {56 vars in 1093 bytes} [Mon Sep 19 10:14:16 2022] GET /identity/v3/users/nova => generated 82 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:14:16.518280 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8e7110-b64f-448d-bdc8-efbf3966c479 None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:16.518881 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8e7110-b64f-448d-bdc8-efbf3966c479 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:16.519520 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8e7110-b64f-448d-bdc8-efbf3966c479 None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:16.521356 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5589f6e1-8647-45d7-a3ba-be782d5736b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:16.522026 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 398/810] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:14:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:14:16.522135 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5589f6e1-8647-45d7-a3ba-be782d5736b6 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:16.523013 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8e7110-b64f-448d-bdc8-efbf3966c479 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:16.526506 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5589f6e1-8647-45d7-a3ba-be782d5736b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:16.526884 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5589f6e1-8647-45d7-a3ba-be782d5736b6 None admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:16.527694 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:16.528876 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5589f6e1-8647-45d7-a3ba-be782d5736b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:14:16.529340 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5589f6e1-8647-45d7-a3ba-be782d5736b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:16.531031 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5589f6e1-8647-45d7-a3ba-be782d5736b6 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:16.546196 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 413/811] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Sep 19 10:14:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:14:16.547918 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d65d611-4a16-4f73-abdb-83b9b3fc1f88 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:16.548373 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d65d611-4a16-4f73-abdb-83b9b3fc1f88 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:16.548789 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d65d611-4a16-4f73-abdb-83b9b3fc1f88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:16.571404 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-1d65d611-4a16-4f73-abdb-83b9b3fc1f88 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:14:16.572937 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-1d65d611-4a16-4f73-abdb-83b9b3fc1f88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:14:16.593145 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:16.653838 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8e7110-b64f-448d-bdc8-efbf3966c479 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:16.660624 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 414/812] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:14:16 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 10:14:16.660624 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d65d611-4a16-4f73-abdb-83b9b3fc1f88 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:16.748996 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7837127-e362-47e0-9ee2-ea8ba155e036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:16.749540 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7837127-e362-47e0-9ee2-ea8ba155e036 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:16.749826 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7837127-e362-47e0-9ee2-ea8ba155e036 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:16.750102 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7837127-e362-47e0-9ee2-ea8ba155e036 None admin] PATH_INFO: `/v3/users` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:16.750841 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7837127-e362-47e0-9ee2-ea8ba155e036 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:14:16.751146 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7837127-e362-47e0-9ee2-ea8ba155e036 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:16.752614 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7837127-e362-47e0-9ee2-ea8ba155e036 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:16.803046 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 399/813] 10.222.0.66 () {56 vars in 1133 bytes} [Mon Sep 19 10:14:16 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:14:16.809102 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7837127-e362-47e0-9ee2-ea8ba155e036 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:16.811233 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d65d611-4a16-4f73-abdb-83b9b3fc1f88 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:16.870955 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a226f8-6b6f-4614-8bb6-612ad43eb7cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:16.871706 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a226f8-6b6f-4614-8bb6-612ad43eb7cb None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:16.871872 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a226f8-6b6f-4614-8bb6-612ad43eb7cb None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:16.872140 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a226f8-6b6f-4614-8bb6-612ad43eb7cb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:16.890530 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a226f8-6b6f-4614-8bb6-612ad43eb7cb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:16.892306 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a226f8-6b6f-4614-8bb6-612ad43eb7cb None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:16.905699 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-66a226f8-6b6f-4614-8bb6-612ad43eb7cb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 10:14:16.905699 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:14:16.905699 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:14:16.905699 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:14:16.905699 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:14:16.905699 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:14:16.905699 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:14:16.905699 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:14:16.905699 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:14:16.905699 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:14:16.905699 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:14:16.905699 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:14:16.905699 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 10:14:16.905699 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 10:14:16.905699 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 10:14:16.906630 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 10:14:16.906630 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:14:16.906630 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:14:16.906630 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:14:16.906630 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:14:16.906630 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:14:16.906630 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:14:16.906630 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:14:16.906630 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 19 10:14:16.906630 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:14:16.906630 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:14:16.906630 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:14:16.906630 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:14:16.906630 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:14:16.906630 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:14:16.906630 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:14:16.906630 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:14:16.907540 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 10:14:16.907540 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 10:14:16.907540 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 10:14:16.907540 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 10:14:16.907540 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 10:14:16.907540 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 10:14:16.907540 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 10:14:16.907540 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 19 10:14:16.907540 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 415/814] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Sep 19 10:14:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:14:16.913212 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a226f8-6b6f-4614-8bb6-612ad43eb7cb None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:16.940010 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:16.951562 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:17.003393 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7837127-e362-47e0-9ee2-ea8ba155e036 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:17.042508 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4bd5d3-1ba8-4b50-a7cf-9e01f91f6170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:17.043133 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4bd5d3-1ba8-4b50-a7cf-9e01f91f6170 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:17.043412 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4bd5d3-1ba8-4b50-a7cf-9e01f91f6170 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:17.043690 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4bd5d3-1ba8-4b50-a7cf-9e01f91f6170 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:17.057091 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a226f8-6b6f-4614-8bb6-612ad43eb7cb None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:17.095117 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58b079f-bb5c-4c24-bc7c-bf4cd459a0bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:17.096716 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58b079f-bb5c-4c24-bc7c-bf4cd459a0bc None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:17.097204 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58b079f-bb5c-4c24-bc7c-bf4cd459a0bc None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:17.097979 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58b079f-bb5c-4c24-bc7c-bf4cd459a0bc None admin] PATH_INFO: `/v3/projects` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:17.098970 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58b079f-bb5c-4c24-bc7c-bf4cd459a0bc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:14:17.099531 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58b079f-bb5c-4c24-bc7c-bf4cd459a0bc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:17.101300 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58b079f-bb5c-4c24-bc7c-bf4cd459a0bc None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:17.116279 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 416/815] 10.222.0.66 () {56 vars in 1148 bytes} [Mon Sep 19 10:14:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:14:17.117482 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58b079f-bb5c-4c24-bc7c-bf4cd459a0bc None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:17.121376 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4bd5d3-1ba8-4b50-a7cf-9e01f91f6170 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:17.123011 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4bd5d3-1ba8-4b50-a7cf-9e01f91f6170 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:17.189485 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:17.211374 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:17.242071 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 400/816] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Sep 19 10:14:16 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 19 10:14:17.242864 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4bd5d3-1ba8-4b50-a7cf-9e01f91f6170 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:17.245937 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58b079f-bb5c-4c24-bc7c-bf4cd459a0bc None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:17.286752 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf407a9-ef4c-4558-8c0c-403ca8df250f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:17.287884 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf407a9-ef4c-4558-8c0c-403ca8df250f None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:17.288441 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf407a9-ef4c-4558-8c0c-403ca8df250f None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:17.288913 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf407a9-ef4c-4558-8c0c-403ca8df250f None admin] PATH_INFO: `/v3/services/network` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:17.289712 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf407a9-ef4c-4558-8c0c-403ca8df250f None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:17.291385 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf407a9-ef4c-4558-8c0c-403ca8df250f None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:17.303137 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-2bf407a9-ef4c-4558-8c0c-403ca8df250f None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 19 10:14:17.303137 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:14:17.303137 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 10:14:17.303137 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 10:14:17.303137 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 10:14:17.303137 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 10:14:17.303137 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 10:14:17.303137 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 10:14:17.303137 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 19 10:14:17.303137 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 19 10:14:17.303137 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 10:14:17.303137 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 19 10:14:17.303137 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:14:17.303137 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:14:17.303137 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:14:17.303137 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:14:17.303137 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:14:17.304215 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:14:17.304215 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:14:17.304215 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:14:17.304215 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:14:17.304215 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:14:17.304215 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:14:17.304215 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 10:14:17.304215 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 10:14:17.304215 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 10:14:17.304215 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 10:14:17.304215 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:14:17.304215 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:14:17.304215 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:14:17.304215 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:14:17.304215 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:14:17.304215 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:14:17.305048 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:14:17.305048 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 19 10:14:17.305048 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:14:17.305048 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:14:17.305048 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:14:17.305048 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:14:17.305048 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:14:17.305048 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:14:17.305048 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:14:17.305048 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:14:17.305048 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 10:14:17.305048 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 10:14:17.305048 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 19 10:14:17.305048 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 19 10:14:17.312795 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 417/817] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Sep 19 10:14:17 2022] GET /identity/v3/services/network => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:14:17.312795 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf407a9-ef4c-4558-8c0c-403ca8df250f None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:17.366707 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4bd5d3-1ba8-4b50-a7cf-9e01f91f6170 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:17.404560 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d29fe6-6e9a-4f09-a350-b2bdd3c2a09c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:17.405226 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d29fe6-6e9a-4f09-a350-b2bdd3c2a09c None admin] REQUEST_METHOD: `PUT` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:17.405508 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d29fe6-6e9a-4f09-a350-b2bdd3c2a09c None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:17.406065 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d29fe6-6e9a-4f09-a350-b2bdd3c2a09c None admin] PATH_INFO: `/v3/projects/be6b93ef3359434d9c776343f0aea333/users/e4d1160b71a84e2fa44a8ca6edf1846e/roles/75952bc2767d49c1a6e49840d8a8f349` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:17.418460 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf407a9-ef4c-4558-8c0c-403ca8df250f None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:17.421029 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d29fe6-6e9a-4f09-a350-b2bdd3c2a09c None admin] RBAC: Authorizing `identity:create_grant(project_id=be6b93ef3359434d9c776343f0aea333, user_id=e4d1160b71a84e2fa44a8ca6edf1846e, role_id=75952bc2767d49c1a6e49840d8a8f349)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:17.422481 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d29fe6-6e9a-4f09-a350-b2bdd3c2a09c None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:17.437865 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 401/818] 10.222.0.66 () {58 vars in 1439 bytes} [Mon Sep 19 10:14:17 2022] PUT /identity/v3/projects/be6b93ef3359434d9c776343f0aea333/users/e4d1160b71a84e2fa44a8ca6edf1846e/roles/75952bc2767d49c1a6e49840d8a8f349 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:14:17.439346 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d29fe6-6e9a-4f09-a350-b2bdd3c2a09c None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:17.458252 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40694076-bfe7-4904-90d4-4602ed642df5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:17.458909 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40694076-bfe7-4904-90d4-4602ed642df5 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:17.459192 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40694076-bfe7-4904-90d4-4602ed642df5 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:17.459470 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40694076-bfe7-4904-90d4-4602ed642df5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:17.463718 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:17.469740 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:17.477968 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40694076-bfe7-4904-90d4-4602ed642df5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:17.479490 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40694076-bfe7-4904-90d4-4602ed642df5 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:17.505277 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-40694076-bfe7-4904-90d4-4602ed642df5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 10:14:17.505277 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:14:17.505277 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:14:17.505277 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:14:17.505277 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:14:17.505277 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:14:17.505277 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:14:17.505277 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:14:17.505277 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:14:17.505277 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:14:17.505277 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:14:17.505277 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:14:17.505277 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 10:14:17.505277 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 10:14:17.505277 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 10:14:17.505277 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 10:14:17.506270 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:14:17.506270 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:14:17.506270 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:14:17.506270 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:14:17.506270 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:14:17.506270 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:14:17.506270 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:14:17.506270 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 19 10:14:17.506270 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:14:17.506270 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:14:17.506270 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:14:17.506270 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:14:17.506270 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:14:17.506270 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:14:17.506270 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:14:17.506270 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:14:17.506270 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 10:14:17.507214 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 10:14:17.507214 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 10:14:17.507214 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 19 10:14:17.514507 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 418/819] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 19 10:14:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:14:17.515431 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4f5499-8bcc-4124-b4e9-cc75645581a0 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:17.516279 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4f5499-8bcc-4124-b4e9-cc75645581a0 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:17.516578 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4f5499-8bcc-4124-b4e9-cc75645581a0 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:17.518181 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 419/820] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:14:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:14:17.520681 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4f5499-8bcc-4124-b4e9-cc75645581a0 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:17.605306 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d29fe6-6e9a-4f09-a350-b2bdd3c2a09c None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:17.656840 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b247927e-c0a4-47b8-a106-fbec7ed311e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:17.657752 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b247927e-c0a4-47b8-a106-fbec7ed311e3 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:17.658283 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b247927e-c0a4-47b8-a106-fbec7ed311e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:17.658742 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b247927e-c0a4-47b8-a106-fbec7ed311e3 None admin] PATH_INFO: `/v3/services` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:17.659371 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b247927e-c0a4-47b8-a106-fbec7ed311e3 None admin] RBAC: Adding query filter params (name=network) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:14:17.659671 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b247927e-c0a4-47b8-a106-fbec7ed311e3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:17.661623 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b247927e-c0a4-47b8-a106-fbec7ed311e3 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:17.665316 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4f5499-8bcc-4124-b4e9-cc75645581a0 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:17.666672 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 402/821] 10.222.0.66 () {56 vars in 1112 bytes} [Mon Sep 19 10:14:17 2022] GET /identity/v3/services?name=network => generated 124 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:14:17.667913 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91f6216-e711-452c-87ec-dc5153881acd None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:17.668705 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91f6216-e711-452c-87ec-dc5153881acd None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:17.668705 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91f6216-e711-452c-87ec-dc5153881acd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:17.694647 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-b91f6216-e711-452c-87ec-dc5153881acd None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:14:17.696040 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-b91f6216-e711-452c-87ec-dc5153881acd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:14:17.717050 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be7a5f9-9e19-438a-9f38-62d6adc97808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:17.717833 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be7a5f9-9e19-438a-9f38-62d6adc97808 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:17.718210 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be7a5f9-9e19-438a-9f38-62d6adc97808 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:17.718580 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be7a5f9-9e19-438a-9f38-62d6adc97808 None admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:17.719321 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be7a5f9-9e19-438a-9f38-62d6adc97808 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:14:17.719713 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be7a5f9-9e19-438a-9f38-62d6adc97808 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:17.721219 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be7a5f9-9e19-438a-9f38-62d6adc97808 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:17.735915 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 420/822] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Sep 19 10:14:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:14:17.736927 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be7a5f9-9e19-438a-9f38-62d6adc97808 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:17.773292 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 403/823] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:14:17 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 10:14:17.774744 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91f6216-e711-452c-87ec-dc5153881acd None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:17.778292 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:17.790710 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:17.860888 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be7a5f9-9e19-438a-9f38-62d6adc97808 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:17.907110 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91f6216-e711-452c-87ec-dc5153881acd None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:17.931718 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec84afc-214f-4f79-9914-f15a3dd77f8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:17.933127 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec84afc-214f-4f79-9914-f15a3dd77f8a None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:17.934323 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec84afc-214f-4f79-9914-f15a3dd77f8a None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:17.934806 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec84afc-214f-4f79-9914-f15a3dd77f8a None admin] PATH_INFO: `/v3/services` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:17.935824 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec84afc-214f-4f79-9914-f15a3dd77f8a None admin] RBAC: Adding query filter params (type=network) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:14:17.937844 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec84afc-214f-4f79-9914-f15a3dd77f8a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:17.939516 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec84afc-214f-4f79-9914-f15a3dd77f8a None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:17.951550 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 421/824] 10.222.0.66 () {56 vars in 1112 bytes} [Mon Sep 19 10:14:17 2022] GET /identity/v3/services?type=network => generated 350 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:14:17.957596 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec84afc-214f-4f79-9914-f15a3dd77f8a None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:17.979550 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89217cc1-3dec-4c22-a714-e9f0f679944c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:17.982275 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89217cc1-3dec-4c22-a714-e9f0f679944c None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:17.983342 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89217cc1-3dec-4c22-a714-e9f0f679944c None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:17.983826 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89217cc1-3dec-4c22-a714-e9f0f679944c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:17.998106 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89217cc1-3dec-4c22-a714-e9f0f679944c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:18.001323 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89217cc1-3dec-4c22-a714-e9f0f679944c None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:18.024342 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-89217cc1-3dec-4c22-a714-e9f0f679944c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 10:14:18.024342 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:14:18.024342 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:14:18.024342 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:14:18.024342 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:14:18.024342 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:14:18.024342 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:14:18.024342 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:14:18.024342 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:14:18.024342 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:14:18.024342 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:14:18.024342 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:14:18.024342 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 10:14:18.024342 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 10:14:18.024342 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 10:14:18.025305 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 10:14:18.025305 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:14:18.025305 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:14:18.025305 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:14:18.025305 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:14:18.025305 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:14:18.025305 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:14:18.025305 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:14:18.025305 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Sep 19 10:14:18.025305 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:14:18.025305 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:14:18.025305 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:14:18.025305 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:14:18.025305 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:14:18.025305 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:14:18.025305 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:14:18.025305 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:14:18.026200 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 10:14:18.026200 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 10:14:18.026200 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 10:14:18.026200 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 10:14:18.026200 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 10:14:18.026200 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 10:14:18.026200 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 10:14:18.026200 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Sep 19 10:14:18.035803 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 404/825] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Sep 19 10:14:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:14:18.038625 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89217cc1-3dec-4c22-a714-e9f0f679944c None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:18.134247 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec84afc-214f-4f79-9914-f15a3dd77f8a None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:18.134439 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:18.150970 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:18.174822 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4db28fb-443b-4698-807c-2a5daa61d88d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:18.175460 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4db28fb-443b-4698-807c-2a5daa61d88d None admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:18.175740 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4db28fb-443b-4698-807c-2a5daa61d88d None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:18.175959 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89217cc1-3dec-4c22-a714-e9f0f679944c None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:18.176063 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4db28fb-443b-4698-807c-2a5daa61d88d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:18.176694 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4db28fb-443b-4698-807c-2a5daa61d88d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:18.179052 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4db28fb-443b-4698-807c-2a5daa61d88d None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:18.203983 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 422/826] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 19 10:14:17 2022] POST /identity/v3/endpoints => generated 337 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 10:14:18.205040 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4db28fb-443b-4698-807c-2a5daa61d88d None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:18.238163 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38431090-5037-4107-baba-2eac2a9de47c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:18.238883 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38431090-5037-4107-baba-2eac2a9de47c None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:18.239167 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38431090-5037-4107-baba-2eac2a9de47c None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:18.239445 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38431090-5037-4107-baba-2eac2a9de47c None admin] PATH_INFO: `/v3/projects` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:18.240215 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38431090-5037-4107-baba-2eac2a9de47c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:14:18.240522 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38431090-5037-4107-baba-2eac2a9de47c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:18.242032 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38431090-5037-4107-baba-2eac2a9de47c None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:18.260685 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 405/827] 10.222.0.66 () {56 vars in 1148 bytes} [Mon Sep 19 10:14:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:14:18.262267 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da260d47-cc51-4f5e-ab28-383b7e9d9847 None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:18.262696 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da260d47-cc51-4f5e-ab28-383b7e9d9847 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:18.262892 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da260d47-cc51-4f5e-ab28-383b7e9d9847 None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:18.268626 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 406/828] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:14:18 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:14:18.270471 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da260d47-cc51-4f5e-ab28-383b7e9d9847 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:18.367184 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4db28fb-443b-4698-807c-2a5daa61d88d None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:18.410726 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da260d47-cc51-4f5e-ab28-383b7e9d9847 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:18.415284 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a38c71-9058-4e00-a418-edd4c81d29aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:18.415922 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a38c71-9058-4e00-a418-edd4c81d29aa None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:18.416240 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a38c71-9058-4e00-a418-edd4c81d29aa None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:18.416504 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a38c71-9058-4e00-a418-edd4c81d29aa None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:18.417095 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a38c71-9058-4e00-a418-edd4c81d29aa None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:18.418474 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a38c71-9058-4e00-a418-edd4c81d29aa None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:18.428837 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-94a38c71-9058-4e00-a418-edd4c81d29aa None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 19 10:14:18.428837 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:14:18.428837 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 10:14:18.428837 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 10:14:18.428837 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 10:14:18.428837 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 10:14:18.428837 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 10:14:18.428837 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 10:14:18.428837 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 19 10:14:18.428837 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 19 10:14:18.428837 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 10:14:18.428837 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 19 10:14:18.428837 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:14:18.428837 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:14:18.428837 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:14:18.428837 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:14:18.428837 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:14:18.429870 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:14:18.429870 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:14:18.429870 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:14:18.429870 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:14:18.429870 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:14:18.429870 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:14:18.429870 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 10:14:18.429870 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 10:14:18.429870 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 10:14:18.429870 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 10:14:18.429870 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:14:18.429870 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:14:18.429870 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:14:18.429870 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:14:18.429870 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:14:18.429870 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:14:18.431315 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:14:18.431315 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 19 10:14:18.431315 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:14:18.431315 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:14:18.431315 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:14:18.431315 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:14:18.431315 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:14:18.431315 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:14:18.431315 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:14:18.431315 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:14:18.431315 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 10:14:18.431315 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 10:14:18.431315 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 19 10:14:18.431315 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 19 10:14:18.431315 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 423/829] 10.222.0.66 () {56 vars in 1129 bytes} [Mon Sep 19 10:14:18 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:14:18.432231 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3e8775-c189-4fb1-8862-30609413de07 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:18.432231 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3e8775-c189-4fb1-8862-30609413de07 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:18.432231 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3e8775-c189-4fb1-8862-30609413de07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:18.443637 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:18.452720 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-8e3e8775-c189-4fb1-8862-30609413de07 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:14:18.454167 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-8e3e8775-c189-4fb1-8862-30609413de07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:14:18.464528 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2497f81-140f-4c56-aabe-65df320f7cdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:18.465254 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2497f81-140f-4c56-aabe-65df320f7cdd None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:18.465538 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2497f81-140f-4c56-aabe-65df320f7cdd None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:18.465814 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2497f81-140f-4c56-aabe-65df320f7cdd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:18.466600 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2497f81-140f-4c56-aabe-65df320f7cdd None admin] RBAC: Adding query filter params (role.id=5c8b89fae4fa45bd944cbeaf442136e1, scope.project.id=be6b93ef3359434d9c776343f0aea333, user.id=15c70bfb085a44e9b84942b480ff22f1) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:14:18.466912 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2497f81-140f-4c56-aabe-65df320f7cdd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:18.468446 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2497f81-140f-4c56-aabe-65df320f7cdd None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:18.476269 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 407/830] 10.222.0.66 () {56 vars in 1374 bytes} [Mon Sep 19 10:14:18 2022] GET /identity/v3/role_assignments?user.id=15c70bfb085a44e9b84942b480ff22f1&scope.project.id=be6b93ef3359434d9c776343f0aea333&role.id=5c8b89fae4fa45bd944cbeaf442136e1 => generated 608 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:14:18.477109 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2497f81-140f-4c56-aabe-65df320f7cdd None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:18.492039 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:18.543578 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 424/831] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:14:18 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 10:14:18.611882 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2497f81-140f-4c56-aabe-65df320f7cdd None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:18.656715 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbbab23-2010-4a9a-aa2e-d285da9953c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:18.657193 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbbab23-2010-4a9a-aa2e-d285da9953c5 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:18.657476 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbbab23-2010-4a9a-aa2e-d285da9953c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:18.657752 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbbab23-2010-4a9a-aa2e-d285da9953c5 None admin] PATH_INFO: `/v3/services` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:18.658415 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbbab23-2010-4a9a-aa2e-d285da9953c5 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:14:18.658719 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbbab23-2010-4a9a-aa2e-d285da9953c5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:18.660419 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbbab23-2010-4a9a-aa2e-d285da9953c5 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:18.666340 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 408/832] 10.222.0.66 () {56 vars in 1124 bytes} [Mon Sep 19 10:14:18 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:14:18.677741 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3e8775-c189-4fb1-8862-30609413de07 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:18.791805 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3e8775-c189-4fb1-8862-30609413de07 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:18.828345 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c4580f-3f83-4242-a366-10917674fe1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:18.829299 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c4580f-3f83-4242-a366-10917674fe1e None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:18.829785 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c4580f-3f83-4242-a366-10917674fe1e None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:18.830285 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c4580f-3f83-4242-a366-10917674fe1e None admin] PATH_INFO: `/v3/services` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:18.831216 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c4580f-3f83-4242-a366-10917674fe1e None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:14:18.832311 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c4580f-3f83-4242-a366-10917674fe1e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:18.833882 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c4580f-3f83-4242-a366-10917674fe1e None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:18.839383 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 425/833] 10.222.0.66 () {56 vars in 1124 bytes} [Mon Sep 19 10:14:18 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:14:18.845232 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbbab23-2010-4a9a-aa2e-d285da9953c5 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:18.854961 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c4580f-3f83-4242-a366-10917674fe1e None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:18.888818 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:18.907250 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:18.976699 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c4580f-3f83-4242-a366-10917674fe1e None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:18.978129 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbbab23-2010-4a9a-aa2e-d285da9953c5 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:19.020430 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdf2187-4b6c-41d6-8cd3-76a62159cdc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:19.021182 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdf2187-4b6c-41d6-8cd3-76a62159cdc7 None admin] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:19.021450 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d764be-218b-475d-bd9a-545e4a26deba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:19.021715 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdf2187-4b6c-41d6-8cd3-76a62159cdc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:19.022090 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdf2187-4b6c-41d6-8cd3-76a62159cdc7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:19.022574 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d764be-218b-475d-bd9a-545e4a26deba None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:19.022946 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdf2187-4b6c-41d6-8cd3-76a62159cdc7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:19.023167 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d764be-218b-475d-bd9a-545e4a26deba None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:19.023582 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d764be-218b-475d-bd9a-545e4a26deba None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:19.024664 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdf2187-4b6c-41d6-8cd3-76a62159cdc7 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:19.035965 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d764be-218b-475d-bd9a-545e4a26deba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 10:14:19.042421 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-18d764be-218b-475d-bd9a-545e4a26deba None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 10:14:19.042421 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:14:19.042421 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:14:19.042421 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:14:19.042421 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:14:19.042421 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:14:19.042421 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:14:19.042421 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:14:19.042421 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:14:19.042421 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:14:19.042421 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:14:19.042421 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:14:19.042421 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 10:14:19.042421 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 10:14:19.042421 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 10:14:19.042421 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 10:14:19.043394 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 10:14:19.043394 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 10:14:19.043394 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 10:14:19.043394 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 10:14:19.043394 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:14:19.043394 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:14:19.043394 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:14:19.043394 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:14:19.043394 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:14:19.043394 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:14:19.043394 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:14:19.043394 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 19 10:14:19.043394 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:14:19.043394 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:14:19.043394 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:14:19.043394 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:14:19.044506 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:14:19.044506 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:14:19.044506 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:14:19.044506 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:14:19.044506 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 10:14:19.044506 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 10:14:19.044506 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 10:14:19.044506 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 10:14:19.044506 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 10:14:19.044506 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 10:14:19.044506 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 10:14:19.044506 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 19 10:14:19.047050 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 426/834] 10.222.0.66 () {56 vars in 1096 bytes} [Mon Sep 19 10:14:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 10:14:19.058051 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 409/835] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 19 10:14:18 2022] POST /identity/v3/endpoints => generated 346 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:14:19.058276 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d764be-218b-475d-bd9a-545e4a26deba None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:19.166150 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:19.183357 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d764be-218b-475d-bd9a-545e4a26deba None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:19.230764 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e065253-e330-4c70-af1b-8c624b3e6652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:19.231377 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e065253-e330-4c70-af1b-8c624b3e6652 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:19.231673 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e065253-e330-4c70-af1b-8c624b3e6652 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:19.231942 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e065253-e330-4c70-af1b-8c624b3e6652 None admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:19.232709 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e065253-e330-4c70-af1b-8c624b3e6652 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:14:19.233013 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e065253-e330-4c70-af1b-8c624b3e6652 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:19.234516 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e065253-e330-4c70-af1b-8c624b3e6652 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:19.245613 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 427/836] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Sep 19 10:14:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 10:14:19.251496 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdf2187-4b6c-41d6-8cd3-76a62159cdc7 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:19.369617 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdf2187-4b6c-41d6-8cd3-76a62159cdc7 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:19.373965 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:19.412965 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00a85a3-ca03-4dcc-b335-f79d6a929669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:19.414016 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00a85a3-ca03-4dcc-b335-f79d6a929669 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:19.414522 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00a85a3-ca03-4dcc-b335-f79d6a929669 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:19.415009 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00a85a3-ca03-4dcc-b335-f79d6a929669 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:19.427306 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00a85a3-ca03-4dcc-b335-f79d6a929669 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:19.429108 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00a85a3-ca03-4dcc-b335-f79d6a929669 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:19.445466 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-f00a85a3-ca03-4dcc-b335-f79d6a929669 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 10:14:19.445466 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:14:19.445466 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:14:19.445466 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:14:19.445466 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:14:19.445466 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:14:19.445466 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:14:19.445466 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:14:19.445466 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:14:19.445466 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:14:19.445466 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:14:19.445466 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:14:19.445466 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 10:14:19.445466 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 10:14:19.445466 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 10:14:19.445466 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 10:14:19.446438 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:14:19.446438 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:14:19.446438 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:14:19.446438 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:14:19.446438 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:14:19.446438 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:14:19.446438 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:14:19.446438 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Sep 19 10:14:19.446438 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:14:19.446438 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:14:19.446438 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:14:19.446438 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:14:19.446438 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:14:19.446438 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:14:19.446438 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:14:19.446438 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:14:19.446438 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 10:14:19.447317 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 10:14:19.447317 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 10:14:19.447317 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Sep 19 10:14:19.449412 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 410/837] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 19 10:14:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:14:19.455252 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e065253-e330-4c70-af1b-8c624b3e6652 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:19.557523 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e065253-e330-4c70-af1b-8c624b3e6652 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:19.593797 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb65f949-c9e4-467e-8075-5d1accef1ba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:19.594817 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb65f949-c9e4-467e-8075-5d1accef1ba0 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:19.595309 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb65f949-c9e4-467e-8075-5d1accef1ba0 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:19.595826 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb65f949-c9e4-467e-8075-5d1accef1ba0 None admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:19.596779 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb65f949-c9e4-467e-8075-5d1accef1ba0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:14:19.597459 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb65f949-c9e4-467e-8075-5d1accef1ba0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:19.599227 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb65f949-c9e4-467e-8075-5d1accef1ba0 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:19.612387 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 428/838] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Sep 19 10:14:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:14:19.618983 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00a85a3-ca03-4dcc-b335-f79d6a929669 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:19.729897 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00a85a3-ca03-4dcc-b335-f79d6a929669 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:19.771214 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430b6c6c-6ac3-422f-ade4-a784bd41369d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:19.771858 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430b6c6c-6ac3-422f-ade4-a784bd41369d None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:19.772139 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430b6c6c-6ac3-422f-ade4-a784bd41369d None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:19.772448 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430b6c6c-6ac3-422f-ade4-a784bd41369d None admin] PATH_INFO: `/v3/users/swift` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:19.780602 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430b6c6c-6ac3-422f-ade4-a784bd41369d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:19.782106 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430b6c6c-6ac3-422f-ade4-a784bd41369d None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:19.794933 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-430b6c6c-6ac3-422f-ade4-a784bd41369d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 19 10:14:19.794933 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:14:19.794933 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:14:19.794933 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:14:19.794933 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:14:19.794933 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:14:19.794933 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:14:19.794933 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:14:19.794933 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:14:19.794933 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:14:19.794933 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:14:19.794933 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:14:19.794933 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 10:14:19.794933 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 10:14:19.794933 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 10:14:19.794933 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 10:14:19.795918 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:14:19.795918 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:14:19.795918 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 10:14:19.795918 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 10:14:19.795918 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 10:14:19.795918 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 10:14:19.795918 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:14:19.795918 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:14:19.795918 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:14:19.795918 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:14:19.795918 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:14:19.795918 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Sep 19 10:14:19.795918 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:14:19.795918 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:14:19.795918 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:14:19.795918 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:14:19.795918 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:14:19.795918 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:14:19.796889 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:14:19.796889 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:14:19.796889 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 10:14:19.796889 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 10:14:19.796889 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 10:14:19.796889 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 10:14:19.796889 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 10:14:19.796889 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 10:14:19.796889 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 19 10:14:19.796889 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Sep 19 10:14:19.796889 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 411/839] 10.222.0.66 () {56 vars in 1096 bytes} [Mon Sep 19 10:14:19 2022] GET /identity/v3/users/swift => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:14:19.802875 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb65f949-c9e4-467e-8075-5d1accef1ba0 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:19.812575 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:19.858123 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcef0b9-793d-4781-9e80-0f4b488a6a55 None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:19.858444 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcef0b9-793d-4781-9e80-0f4b488a6a55 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:19.858672 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcef0b9-793d-4781-9e80-0f4b488a6a55 None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:19.860373 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 412/840] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:14:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:14:19.865890 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adab7f95-7135-4269-813d-8e04424f73f2 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:19.866164 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adab7f95-7135-4269-813d-8e04424f73f2 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:19.866444 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adab7f95-7135-4269-813d-8e04424f73f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:19.886404 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-adab7f95-7135-4269-813d-8e04424f73f2 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:14:19.888225 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-adab7f95-7135-4269-813d-8e04424f73f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:14:19.901253 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:19.922688 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb65f949-c9e4-467e-8075-5d1accef1ba0 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:19.961786 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a37bc6-84ef-4a9f-93ff-22c8a5939d95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:19.962404 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a37bc6-84ef-4a9f-93ff-22c8a5939d95 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:19.962679 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a37bc6-84ef-4a9f-93ff-22c8a5939d95 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:19.962946 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a37bc6-84ef-4a9f-93ff-22c8a5939d95 None admin] PATH_INFO: `/v3/users` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:19.963659 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a37bc6-84ef-4a9f-93ff-22c8a5939d95 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:14:19.963959 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a37bc6-84ef-4a9f-93ff-22c8a5939d95 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:19.965547 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a37bc6-84ef-4a9f-93ff-22c8a5939d95 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:19.980279 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 413/841] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:14:19 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 10:14:19.984502 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 429/842] 10.222.0.66 () {56 vars in 1135 bytes} [Mon Sep 19 10:14:19 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:14:19.989858 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adab7f95-7135-4269-813d-8e04424f73f2 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:20.096882 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adab7f95-7135-4269-813d-8e04424f73f2 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:20.137525 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4aa22b0-c6a1-481a-a222-484c96a326ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:20.138142 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aa22b0-c6a1-481a-a222-484c96a326ad None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:20.138421 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aa22b0-c6a1-481a-a222-484c96a326ad None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:20.138693 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aa22b0-c6a1-481a-a222-484c96a326ad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:20.155156 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:20.211431 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4aa22b0-c6a1-481a-a222-484c96a326ad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:20.212928 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4aa22b0-c6a1-481a-a222-484c96a326ad None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:20.255705 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a37bc6-84ef-4a9f-93ff-22c8a5939d95 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:20.323460 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:20.331333 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 414/843] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Sep 19 10:14:19 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 19 10:14:20.338664 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4aa22b0-c6a1-481a-a222-484c96a326ad None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:20.380995 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a37bc6-84ef-4a9f-93ff-22c8a5939d95 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:20.396556 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:20.424487 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c68f023-9436-455c-8bad-227c274144d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:20.426087 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c68f023-9436-455c-8bad-227c274144d0 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:20.426572 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c68f023-9436-455c-8bad-227c274144d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:20.427047 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c68f023-9436-455c-8bad-227c274144d0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:20.447624 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c68f023-9436-455c-8bad-227c274144d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 10:14:20.452973 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-1c68f023-9436-455c-8bad-227c274144d0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 10:14:20.452973 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:14:20.452973 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:14:20.452973 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:14:20.452973 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:14:20.452973 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:14:20.452973 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:14:20.452973 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:14:20.452973 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:14:20.452973 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:14:20.452973 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:14:20.452973 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:14:20.452973 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 10:14:20.452973 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 10:14:20.452973 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 10:14:20.452973 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 10:14:20.453887 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 10:14:20.453887 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 10:14:20.453887 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 10:14:20.453887 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 10:14:20.453887 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:14:20.453887 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:14:20.453887 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:14:20.453887 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:14:20.453887 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:14:20.453887 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:14:20.453887 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:14:20.453887 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 19 10:14:20.453887 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:14:20.453887 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:14:20.453887 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:14:20.453887 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:14:20.454722 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:14:20.454722 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:14:20.454722 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:14:20.454722 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:14:20.454722 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 10:14:20.454722 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 10:14:20.454722 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 10:14:20.454722 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 10:14:20.454722 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 10:14:20.454722 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 10:14:20.454722 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 10:14:20.454722 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 19 10:14:20.457536 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 430/844] 10.222.0.66 () {56 vars in 1102 bytes} [Mon Sep 19 10:14:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 10:14:20.463999 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c68f023-9436-455c-8bad-227c274144d0 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:20.470685 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4aa22b0-c6a1-481a-a222-484c96a326ad None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:20.518197 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a103ad-368c-465e-be31-5fcce5d3bae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:20.519459 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a103ad-368c-465e-be31-5fcce5d3bae1 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:20.519895 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a103ad-368c-465e-be31-5fcce5d3bae1 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:20.520345 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a103ad-368c-465e-be31-5fcce5d3bae1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:20.535526 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a103ad-368c-465e-be31-5fcce5d3bae1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:20.538012 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a103ad-368c-465e-be31-5fcce5d3bae1 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:20.559311 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-e5a103ad-368c-465e-be31-5fcce5d3bae1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 10:14:20.559311 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:14:20.559311 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:14:20.559311 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:14:20.559311 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:14:20.559311 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:14:20.559311 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:14:20.559311 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:14:20.559311 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:14:20.559311 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:14:20.559311 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:14:20.559311 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:14:20.559311 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 10:14:20.559311 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 10:14:20.559311 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 10:14:20.559311 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 10:14:20.560547 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:14:20.560547 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:14:20.560547 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:14:20.560547 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:14:20.560547 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:14:20.560547 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:14:20.560547 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:14:20.560547 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Sep 19 10:14:20.560547 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:14:20.560547 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:14:20.560547 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:14:20.560547 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:14:20.560547 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:14:20.560547 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:14:20.560547 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:14:20.560547 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:14:20.560547 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 10:14:20.561652 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 10:14:20.561652 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 10:14:20.561652 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Sep 19 10:14:20.568054 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 415/845] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 19 10:14:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 10:14:20.568915 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a103ad-368c-465e-be31-5fcce5d3bae1 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:20.598470 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c68f023-9436-455c-8bad-227c274144d0 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:20.627727 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:20.642972 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c62aef-4577-4df8-9ac3-e2ddab003426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:20.644143 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c62aef-4577-4df8-9ac3-e2ddab003426 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:20.644883 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c62aef-4577-4df8-9ac3-e2ddab003426 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:20.645370 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c62aef-4577-4df8-9ac3-e2ddab003426 None admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:20.646558 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c62aef-4577-4df8-9ac3-e2ddab003426 None admin] RBAC: Adding query filter params (name=service) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:14:20.648013 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c62aef-4577-4df8-9ac3-e2ddab003426 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:20.649677 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c62aef-4577-4df8-9ac3-e2ddab003426 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:20.663230 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 431/846] 10.222.0.66 () {56 vars in 1103 bytes} [Mon Sep 19 10:14:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 10:14:20.672342 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c62aef-4577-4df8-9ac3-e2ddab003426 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:20.681878 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:20.686105 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a103ad-368c-465e-be31-5fcce5d3bae1 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:20.725943 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a511a4fb-3d4f-400e-8c8b-49d4473adb26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:20.726555 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a511a4fb-3d4f-400e-8c8b-49d4473adb26 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:20.726834 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a511a4fb-3d4f-400e-8c8b-49d4473adb26 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:20.727109 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a511a4fb-3d4f-400e-8c8b-49d4473adb26 None admin] PATH_INFO: `/v3/domains` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:20.727813 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a511a4fb-3d4f-400e-8c8b-49d4473adb26 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:14:20.728121 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a511a4fb-3d4f-400e-8c8b-49d4473adb26 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:20.729635 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a511a4fb-3d4f-400e-8c8b-49d4473adb26 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:20.744218 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 416/847] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Sep 19 10:14:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:14:20.750125 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a511a4fb-3d4f-400e-8c8b-49d4473adb26 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:20.806420 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c62aef-4577-4df8-9ac3-e2ddab003426 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:20.846319 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f466461-caf5-4ad9-b641-500b46262717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:20.847910 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f466461-caf5-4ad9-b641-500b46262717 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:20.848438 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f466461-caf5-4ad9-b641-500b46262717 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:20.848916 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f466461-caf5-4ad9-b641-500b46262717 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:20.862217 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a511a4fb-3d4f-400e-8c8b-49d4473adb26 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:20.862602 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f466461-caf5-4ad9-b641-500b46262717 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:20.865282 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f466461-caf5-4ad9-b641-500b46262717 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:20.885470 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-9f466461-caf5-4ad9-b641-500b46262717 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 10:14:20.885470 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:14:20.885470 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:14:20.885470 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:14:20.885470 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:14:20.885470 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:14:20.885470 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:14:20.885470 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:14:20.885470 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:14:20.885470 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:14:20.885470 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:14:20.885470 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:14:20.885470 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 10:14:20.885470 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 10:14:20.885470 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 10:14:20.885470 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 10:14:20.886460 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:14:20.886460 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:14:20.886460 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:14:20.886460 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:14:20.886460 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:14:20.886460 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:14:20.886460 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:14:20.886460 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 19 10:14:20.886460 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:14:20.886460 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:14:20.886460 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:14:20.886460 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:14:20.886460 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:14:20.886460 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:14:20.886460 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:14:20.886460 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:14:20.886460 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 10:14:20.887335 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 10:14:20.887335 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 10:14:20.887335 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 19 10:14:20.895833 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 432/848] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 19 10:14:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 10:14:20.897701 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f466461-caf5-4ad9-b641-500b46262717 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:20.908901 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335eb778-6ca2-4677-b5eb-9925aaa25a6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:20.911045 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335eb778-6ca2-4677-b5eb-9925aaa25a6e None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:20.911480 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335eb778-6ca2-4677-b5eb-9925aaa25a6e None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:20.912344 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335eb778-6ca2-4677-b5eb-9925aaa25a6e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:20.922099 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335eb778-6ca2-4677-b5eb-9925aaa25a6e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:20.924678 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335eb778-6ca2-4677-b5eb-9925aaa25a6e None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:20.940673 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-335eb778-6ca2-4677-b5eb-9925aaa25a6e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 10:14:20.940673 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:14:20.940673 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:14:20.940673 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:14:20.940673 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:14:20.940673 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:14:20.940673 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:14:20.940673 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:14:20.940673 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:14:20.940673 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:14:20.940673 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:14:20.940673 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:14:20.940673 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 10:14:20.940673 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 10:14:20.940673 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 10:14:20.941909 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 10:14:20.941909 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:14:20.941909 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:14:20.941909 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:14:20.941909 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:14:20.941909 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:14:20.941909 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:14:20.941909 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:14:20.941909 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Sep 19 10:14:20.941909 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:14:20.941909 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:14:20.941909 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:14:20.941909 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:14:20.941909 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:14:20.941909 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:14:20.941909 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:14:20.941909 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:14:20.943083 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 10:14:20.943083 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 10:14:20.943083 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 10:14:20.943083 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 10:14:20.943083 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 10:14:20.943083 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 10:14:20.943083 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 10:14:20.943083 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Sep 19 10:14:20.944486 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:20.946461 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 417/849] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Sep 19 10:14:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:14:20.955146 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335eb778-6ca2-4677-b5eb-9925aaa25a6e None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:20.988364 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:21.025271 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f466461-caf5-4ad9-b641-500b46262717 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:21.065743 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899fd300-9d83-422b-803d-214e00cb22c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:21.067322 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899fd300-9d83-422b-803d-214e00cb22c2 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:21.067840 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899fd300-9d83-422b-803d-214e00cb22c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:21.068332 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899fd300-9d83-422b-803d-214e00cb22c2 None admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:21.069165 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899fd300-9d83-422b-803d-214e00cb22c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:14:21.069661 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899fd300-9d83-422b-803d-214e00cb22c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:21.071085 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899fd300-9d83-422b-803d-214e00cb22c2 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:21.076460 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335eb778-6ca2-4677-b5eb-9925aaa25a6e None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:21.088888 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 433/850] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Sep 19 10:14:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 10:14:21.088888 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d01155d-57b9-4ecb-893a-bcb2c2f2ab92 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:21.088888 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d01155d-57b9-4ecb-893a-bcb2c2f2ab92 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:21.088888 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d01155d-57b9-4ecb-893a-bcb2c2f2ab92 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:21.088888 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 434/851] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:14:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:14:21.092422 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d01155d-57b9-4ecb-893a-bcb2c2f2ab92 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:21.117232 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6925de-0607-47ea-a02d-937b7cf282e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:21.117939 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6925de-0607-47ea-a02d-937b7cf282e4 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:21.118224 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6925de-0607-47ea-a02d-937b7cf282e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:21.118498 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6925de-0607-47ea-a02d-937b7cf282e4 None admin] PATH_INFO: `/v3/projects` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:21.119189 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6925de-0607-47ea-a02d-937b7cf282e4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:14:21.119494 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6925de-0607-47ea-a02d-937b7cf282e4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:21.121014 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6925de-0607-47ea-a02d-937b7cf282e4 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:21.138389 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 418/852] 10.222.0.66 () {56 vars in 1148 bytes} [Mon Sep 19 10:14:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:14:21.138389 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aeeba2-514a-4d8a-96b7-b9e30985f5f3 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:21.138389 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aeeba2-514a-4d8a-96b7-b9e30985f5f3 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:21.138389 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aeeba2-514a-4d8a-96b7-b9e30985f5f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:21.154851 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-34aeeba2-514a-4d8a-96b7-b9e30985f5f3 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:14:21.155817 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-34aeeba2-514a-4d8a-96b7-b9e30985f5f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:14:21.201156 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:21.207714 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d01155d-57b9-4ecb-893a-bcb2c2f2ab92 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:21.228811 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 419/853] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:14:21 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 10:14:21.229462 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34aeeba2-514a-4d8a-96b7-b9e30985f5f3 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:21.241521 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:21.269554 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06105d4-ab4e-4f78-a1f9-a28bd0805a1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:21.270894 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06105d4-ab4e-4f78-a1f9-a28bd0805a1b None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:21.271860 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06105d4-ab4e-4f78-a1f9-a28bd0805a1b None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:21.272539 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06105d4-ab4e-4f78-a1f9-a28bd0805a1b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:21.282544 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06105d4-ab4e-4f78-a1f9-a28bd0805a1b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:21.285576 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06105d4-ab4e-4f78-a1f9-a28bd0805a1b None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:21.305289 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-c06105d4-ab4e-4f78-a1f9-a28bd0805a1b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 19 10:14:21.305289 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:14:21.305289 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:14:21.305289 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:14:21.305289 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:14:21.305289 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:14:21.305289 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:14:21.305289 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:14:21.305289 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:14:21.305289 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:14:21.305289 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:14:21.305289 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:14:21.305289 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 10:14:21.305289 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 10:14:21.305289 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 10:14:21.305289 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 10:14:21.306373 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:14:21.306373 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:14:21.306373 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 10:14:21.306373 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 10:14:21.306373 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 10:14:21.306373 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 10:14:21.306373 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:14:21.306373 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:14:21.306373 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:14:21.306373 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:14:21.306373 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:14:21.306373 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 19 10:14:21.306373 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:14:21.306373 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:14:21.306373 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:14:21.306373 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:14:21.306373 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:14:21.306373 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:14:21.307397 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:14:21.307397 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:14:21.307397 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 10:14:21.307397 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 10:14:21.307397 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 10:14:21.307397 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 10:14:21.307397 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 10:14:21.307397 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 10:14:21.307397 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 19 10:14:21.307397 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 19 10:14:21.309907 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 435/854] 10.222.0.66 () {56 vars in 1117 bytes} [Mon Sep 19 10:14:21 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:14:21.316127 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06105d4-ab4e-4f78-a1f9-a28bd0805a1b None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:21.355661 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34aeeba2-514a-4d8a-96b7-b9e30985f5f3 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:21.392467 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ea8068-9e0a-4ac0-9047-1ef240f0300e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:21.393076 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ea8068-9e0a-4ac0-9047-1ef240f0300e None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:21.393369 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ea8068-9e0a-4ac0-9047-1ef240f0300e None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:21.393645 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ea8068-9e0a-4ac0-9047-1ef240f0300e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:21.394423 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ea8068-9e0a-4ac0-9047-1ef240f0300e None admin] RBAC: Adding query filter params (role.id=5c8b89fae4fa45bd944cbeaf442136e1, scope.project.id=be6b93ef3359434d9c776343f0aea333, user.id=6677354e36614c9fb3d03413749be5ca) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:14:21.394754 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ea8068-9e0a-4ac0-9047-1ef240f0300e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:21.396188 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ea8068-9e0a-4ac0-9047-1ef240f0300e None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:21.402279 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 420/855] 10.222.0.66 () {56 vars in 1374 bytes} [Mon Sep 19 10:14:21 2022] GET /identity/v3/role_assignments?user.id=6677354e36614c9fb3d03413749be5ca&scope.project.id=be6b93ef3359434d9c776343f0aea333&role.id=5c8b89fae4fa45bd944cbeaf442136e1 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:14:21.403460 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aaede9-bf3f-432a-a586-95ff701bd65f None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:21.403744 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aaede9-bf3f-432a-a586-95ff701bd65f None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:21.404021 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aaede9-bf3f-432a-a586-95ff701bd65f None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:21.405452 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 421/856] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:14:21 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:14:21.411596 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd19148-ab03-4f01-987e-279ec565ddc5 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:21.411882 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd19148-ab03-4f01-987e-279ec565ddc5 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:21.412190 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd19148-ab03-4f01-987e-279ec565ddc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:21.436549 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-8bd19148-ab03-4f01-987e-279ec565ddc5 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:14:21.438118 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-8bd19148-ab03-4f01-987e-279ec565ddc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:14:21.445268 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06105d4-ab4e-4f78-a1f9-a28bd0805a1b None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:21.492207 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524cd9b6-4fe0-485a-a85d-617f1ee90c85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:21.492207 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524cd9b6-4fe0-485a-a85d-617f1ee90c85 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:21.492207 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524cd9b6-4fe0-485a-a85d-617f1ee90c85 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:21.492207 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524cd9b6-4fe0-485a-a85d-617f1ee90c85 None admin] PATH_INFO: `/v3/users` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:21.492660 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524cd9b6-4fe0-485a-a85d-617f1ee90c85 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:14:21.492660 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524cd9b6-4fe0-485a-a85d-617f1ee90c85 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:21.492660 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524cd9b6-4fe0-485a-a85d-617f1ee90c85 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:21.512655 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 436/857] 10.222.0.66 () {56 vars in 1149 bytes} [Mon Sep 19 10:14:21 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 10:14:21.513906 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524cd9b6-4fe0-485a-a85d-617f1ee90c85 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:21.529984 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 422/858] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:14:21 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 10:14:21.531037 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd19148-ab03-4f01-987e-279ec565ddc5 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:21.533875 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:21.540605 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:21.654343 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524cd9b6-4fe0-485a-a85d-617f1ee90c85 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:21.670286 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd19148-ab03-4f01-987e-279ec565ddc5 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:21.700120 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bb19a9-db28-4d1e-9502-a8f2041383da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:21.700783 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bb19a9-db28-4d1e-9502-a8f2041383da None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:21.701065 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bb19a9-db28-4d1e-9502-a8f2041383da None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:21.701339 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bb19a9-db28-4d1e-9502-a8f2041383da None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:21.701918 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bb19a9-db28-4d1e-9502-a8f2041383da None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:21.703278 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bb19a9-db28-4d1e-9502-a8f2041383da None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:21.715749 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-68bb19a9-db28-4d1e-9502-a8f2041383da None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 19 10:14:21.715749 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:14:21.715749 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 10:14:21.715749 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 10:14:21.715749 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 10:14:21.715749 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 10:14:21.715749 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 10:14:21.715749 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 10:14:21.715749 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 19 10:14:21.715749 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 19 10:14:21.715749 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 10:14:21.715749 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 19 10:14:21.715749 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:14:21.715749 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:14:21.715749 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:14:21.715749 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:14:21.716820 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:14:21.716820 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:14:21.716820 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:14:21.716820 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:14:21.716820 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:14:21.716820 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:14:21.716820 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:14:21.716820 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 10:14:21.716820 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 10:14:21.716820 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 10:14:21.716820 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 10:14:21.716820 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:14:21.716820 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:14:21.716820 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:14:21.716820 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:14:21.716820 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:14:21.716820 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:14:21.717709 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:14:21.717709 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 19 10:14:21.717709 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:14:21.717709 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:14:21.717709 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:14:21.717709 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:14:21.717709 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:14:21.717709 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:14:21.717709 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:14:21.717709 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:14:21.717709 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 10:14:21.717709 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 10:14:21.717709 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 19 10:14:21.717709 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 19 10:14:21.717709 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 437/859] 10.222.0.66 () {56 vars in 1132 bytes} [Mon Sep 19 10:14:21 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:14:21.721093 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb6965a-4904-4bcd-adcc-9fdc204e72b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:21.721793 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb6965a-4904-4bcd-adcc-9fdc204e72b7 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:21.722261 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb6965a-4904-4bcd-adcc-9fdc204e72b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:21.723798 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb6965a-4904-4bcd-adcc-9fdc204e72b7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:21.723963 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bb19a9-db28-4d1e-9502-a8f2041383da None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:21.814036 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb6965a-4904-4bcd-adcc-9fdc204e72b7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:21.815621 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb6965a-4904-4bcd-adcc-9fdc204e72b7 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:21.819574 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:21.825256 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:21.848334 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bb19a9-db28-4d1e-9502-a8f2041383da None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:21.884015 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09ede89-163f-46f9-9d0c-059f5dd46f2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:21.884664 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09ede89-163f-46f9-9d0c-059f5dd46f2c None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:21.884949 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09ede89-163f-46f9-9d0c-059f5dd46f2c None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:21.885227 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09ede89-163f-46f9-9d0c-059f5dd46f2c None admin] PATH_INFO: `/v3/services` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:21.886097 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09ede89-163f-46f9-9d0c-059f5dd46f2c None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:14:21.886209 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09ede89-163f-46f9-9d0c-059f5dd46f2c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:21.887514 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09ede89-163f-46f9-9d0c-059f5dd46f2c None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:21.893156 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 438/860] 10.222.0.66 () {56 vars in 1126 bytes} [Mon Sep 19 10:14:21 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 10:14:21.893809 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09ede89-163f-46f9-9d0c-059f5dd46f2c None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:21.945846 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 423/861] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Sep 19 10:14:21 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 19 10:14:21.946619 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb6965a-4904-4bcd-adcc-9fdc204e72b7 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:22.015814 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09ede89-163f-46f9-9d0c-059f5dd46f2c None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:22.051926 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8ce6ab-93d7-4ff1-be86-ecf4a8541a6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:22.052610 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8ce6ab-93d7-4ff1-be86-ecf4a8541a6e None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:22.052910 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8ce6ab-93d7-4ff1-be86-ecf4a8541a6e None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:22.053129 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8ce6ab-93d7-4ff1-be86-ecf4a8541a6e None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:22.053713 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb6965a-4904-4bcd-adcc-9fdc204e72b7 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:22.053827 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8ce6ab-93d7-4ff1-be86-ecf4a8541a6e None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:22.055079 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8ce6ab-93d7-4ff1-be86-ecf4a8541a6e None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:22.055439 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:22.066001 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-1f8ce6ab-93d7-4ff1-be86-ecf4a8541a6e None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 19 10:14:22.066001 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:14:22.066001 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 10:14:22.066001 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 10:14:22.066001 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 10:14:22.066001 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 10:14:22.066001 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 10:14:22.066001 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 10:14:22.066001 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 19 10:14:22.066001 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 19 10:14:22.066001 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 10:14:22.066001 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 19 10:14:22.066001 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:14:22.066001 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:14:22.066001 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:14:22.066001 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:14:22.066001 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:14:22.067208 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:14:22.067208 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:14:22.067208 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:14:22.067208 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:14:22.067208 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:14:22.067208 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:14:22.067208 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 10:14:22.067208 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 10:14:22.067208 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 10:14:22.067208 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 10:14:22.067208 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:14:22.067208 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:14:22.067208 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:14:22.067208 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:14:22.067208 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:14:22.067208 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:14:22.068238 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:14:22.068238 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 19 10:14:22.068238 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:14:22.068238 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:14:22.068238 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:14:22.068238 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:14:22.068238 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:14:22.068238 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:14:22.068238 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:14:22.068238 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:14:22.068238 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 10:14:22.068238 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 10:14:22.068238 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 19 10:14:22.068238 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 19 10:14:22.072213 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 439/862] 10.222.0.66 () {56 vars in 1114 bytes} [Mon Sep 19 10:14:21 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:14:22.072213 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8ce6ab-93d7-4ff1-be86-ecf4a8541a6e None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:22.086267 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:22.095963 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f6172c-1a8b-4a39-987b-c61b9c2449ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:22.096616 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f6172c-1a8b-4a39-987b-c61b9c2449ce None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:22.096896 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f6172c-1a8b-4a39-987b-c61b9c2449ce None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:22.097686 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f6172c-1a8b-4a39-987b-c61b9c2449ce None admin] PATH_INFO: `/v3/services` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:22.098314 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f6172c-1a8b-4a39-987b-c61b9c2449ce None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:14:22.098615 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f6172c-1a8b-4a39-987b-c61b9c2449ce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:22.099983 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f6172c-1a8b-4a39-987b-c61b9c2449ce None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:22.105224 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 424/863] 10.222.0.66 () {56 vars in 1126 bytes} [Mon Sep 19 10:14:21 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:14:22.114407 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f6172c-1a8b-4a39-987b-c61b9c2449ce None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:22.204400 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8ce6ab-93d7-4ff1-be86-ecf4a8541a6e None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:22.243298 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f6172c-1a8b-4a39-987b-c61b9c2449ce None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:22.243540 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a58eb2-7312-40e3-853c-3c5574fce186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:22.244321 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a58eb2-7312-40e3-853c-3c5574fce186 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:22.244705 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a58eb2-7312-40e3-853c-3c5574fce186 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:22.245075 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a58eb2-7312-40e3-853c-3c5574fce186 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:22.257869 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a58eb2-7312-40e3-853c-3c5574fce186 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:22.259671 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a58eb2-7312-40e3-853c-3c5574fce186 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:22.276274 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-c1a58eb2-7312-40e3-853c-3c5574fce186 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 10:14:22.276274 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:14:22.276274 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:14:22.276274 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:14:22.276274 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:14:22.276274 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:14:22.276274 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:14:22.276274 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:14:22.276274 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:14:22.276274 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:14:22.276274 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:14:22.276274 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:14:22.276274 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 10:14:22.276274 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 10:14:22.276274 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 10:14:22.276274 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 10:14:22.277351 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:14:22.277351 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:14:22.277351 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:14:22.277351 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:14:22.277351 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:14:22.277351 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:14:22.277351 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:14:22.277351 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 19 10:14:22.277351 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:14:22.277351 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:14:22.277351 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:14:22.277351 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:14:22.277351 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:14:22.277351 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:14:22.277351 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:14:22.277351 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:14:22.277351 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 10:14:22.278257 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 10:14:22.278257 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 10:14:22.278257 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 19 10:14:22.278436 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 440/864] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 19 10:14:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:14:22.283705 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a58eb2-7312-40e3-853c-3c5574fce186 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:22.289121 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b50265d-3625-44a5-bea4-2282202cafce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:22.289894 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b50265d-3625-44a5-bea4-2282202cafce None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:22.290269 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b50265d-3625-44a5-bea4-2282202cafce None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:22.290655 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b50265d-3625-44a5-bea4-2282202cafce None admin] PATH_INFO: `/v3/services` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:22.291382 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b50265d-3625-44a5-bea4-2282202cafce None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:14:22.291780 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b50265d-3625-44a5-bea4-2282202cafce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:22.293933 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b50265d-3625-44a5-bea4-2282202cafce None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:22.299151 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 425/865] 10.222.0.66 () {56 vars in 1114 bytes} [Mon Sep 19 10:14:22 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:14:22.306376 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b50265d-3625-44a5-bea4-2282202cafce None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:22.341159 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:22.368202 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:22.417146 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a58eb2-7312-40e3-853c-3c5574fce186 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:22.448047 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b50265d-3625-44a5-bea4-2282202cafce None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:22.462299 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e22cb15-8fe4-43b0-a733-e5023801d7f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:22.463249 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e22cb15-8fe4-43b0-a733-e5023801d7f1 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:22.463665 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e22cb15-8fe4-43b0-a733-e5023801d7f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:22.464032 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e22cb15-8fe4-43b0-a733-e5023801d7f1 None admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:22.464842 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e22cb15-8fe4-43b0-a733-e5023801d7f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:14:22.465237 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e22cb15-8fe4-43b0-a733-e5023801d7f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:22.466765 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e22cb15-8fe4-43b0-a733-e5023801d7f1 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:22.481365 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 441/866] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Sep 19 10:14:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:14:22.486874 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e22cb15-8fe4-43b0-a733-e5023801d7f1 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:22.494161 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df60299-35a0-4261-8389-33276f9fdfa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:22.494781 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df60299-35a0-4261-8389-33276f9fdfa7 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:22.495052 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df60299-35a0-4261-8389-33276f9fdfa7 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:22.495319 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df60299-35a0-4261-8389-33276f9fdfa7 None admin] PATH_INFO: `/v3/services` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:22.495948 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df60299-35a0-4261-8389-33276f9fdfa7 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:14:22.496289 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df60299-35a0-4261-8389-33276f9fdfa7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:22.497665 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df60299-35a0-4261-8389-33276f9fdfa7 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:22.503028 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 426/867] 10.222.0.66 () {56 vars in 1114 bytes} [Mon Sep 19 10:14:22 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:14:22.612138 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e22cb15-8fe4-43b0-a733-e5023801d7f1 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:22.637439 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:22.658305 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b3cd2f-789c-48cc-b10a-13e5d9861fcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:22.658967 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b3cd2f-789c-48cc-b10a-13e5d9861fcd None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:22.659253 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b3cd2f-789c-48cc-b10a-13e5d9861fcd None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:22.659523 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b3cd2f-789c-48cc-b10a-13e5d9861fcd None admin] PATH_INFO: `/v3/projects/service` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:22.668085 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b3cd2f-789c-48cc-b10a-13e5d9861fcd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:22.675938 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b3cd2f-789c-48cc-b10a-13e5d9861fcd None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:22.691986 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-32b3cd2f-789c-48cc-b10a-13e5d9861fcd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 10:14:22.691986 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:14:22.691986 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:14:22.691986 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:14:22.691986 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:14:22.691986 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:14:22.691986 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:14:22.691986 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:14:22.691986 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:14:22.691986 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:14:22.691986 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:14:22.691986 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:14:22.691986 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 10:14:22.691986 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 10:14:22.691986 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 10:14:22.693020 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 10:14:22.693020 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:14:22.693020 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:14:22.693020 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:14:22.693020 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:14:22.693020 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:14:22.693020 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:14:22.693020 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:14:22.693020 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 19 10:14:22.693020 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:14:22.693020 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:14:22.693020 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:14:22.693020 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:14:22.693020 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:14:22.693020 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:14:22.693020 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:14:22.693020 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:14:22.693911 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 10:14:22.693911 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 10:14:22.693911 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 10:14:22.693911 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 10:14:22.693911 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 10:14:22.693911 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 10:14:22.693911 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 10:14:22.693911 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 19 10:14:22.693911 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 442/868] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Sep 19 10:14:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:14:22.699002 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df60299-35a0-4261-8389-33276f9fdfa7 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:22.804589 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:22.811473 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df60299-35a0-4261-8389-33276f9fdfa7 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:22.852874 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4ca781-20cf-4cf3-bafe-2a4be9cdf5d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:22.853739 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4ca781-20cf-4cf3-bafe-2a4be9cdf5d6 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:22.854165 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4ca781-20cf-4cf3-bafe-2a4be9cdf5d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:22.854669 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4ca781-20cf-4cf3-bafe-2a4be9cdf5d6 None admin] PATH_INFO: `/v3/projects` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:22.855565 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4ca781-20cf-4cf3-bafe-2a4be9cdf5d6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:14:22.856034 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4ca781-20cf-4cf3-bafe-2a4be9cdf5d6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:22.857665 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4ca781-20cf-4cf3-bafe-2a4be9cdf5d6 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:22.871079 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 427/869] 10.222.0.66 () {56 vars in 1148 bytes} [Mon Sep 19 10:14:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:14:22.877119 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b3cd2f-789c-48cc-b10a-13e5d9861fcd None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:22.986899 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b3cd2f-789c-48cc-b10a-13e5d9861fcd None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:23.022353 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97d405f-cd50-4cb2-b9b2-80cdc3de8c4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:23.022964 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97d405f-cd50-4cb2-b9b2-80cdc3de8c4e None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:23.023244 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97d405f-cd50-4cb2-b9b2-80cdc3de8c4e None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:23.023520 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97d405f-cd50-4cb2-b9b2-80cdc3de8c4e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:23.024278 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97d405f-cd50-4cb2-b9b2-80cdc3de8c4e None admin] RBAC: Adding query filter params (role.id=75952bc2767d49c1a6e49840d8a8f349, scope.project.id=be6b93ef3359434d9c776343f0aea333, user.id=e4d1160b71a84e2fa44a8ca6edf1846e) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:14:23.024592 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97d405f-cd50-4cb2-b9b2-80cdc3de8c4e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:23.026036 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97d405f-cd50-4cb2-b9b2-80cdc3de8c4e None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:23.032505 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 443/870] 10.222.0.66 () {56 vars in 1374 bytes} [Mon Sep 19 10:14:22 2022] GET /identity/v3/role_assignments?user.id=e4d1160b71a84e2fa44a8ca6edf1846e&scope.project.id=be6b93ef3359434d9c776343f0aea333&role.id=75952bc2767d49c1a6e49840d8a8f349 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:14:23.749763 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd0b477-1c6e-4bad-8a36-b35f801f2dfb None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:23.750309 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd0b477-1c6e-4bad-8a36-b35f801f2dfb None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:23.750309 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd0b477-1c6e-4bad-8a36-b35f801f2dfb None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:23.751766 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 428/871] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:14:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:14:23.757518 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1fddff-5572-42ae-9ee5-7645b40627e5 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:23.758346 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1fddff-5572-42ae-9ee5-7645b40627e5 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:23.758844 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1fddff-5572-42ae-9ee5-7645b40627e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:23.777540 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-8d1fddff-5572-42ae-9ee5-7645b40627e5 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:14:23.779064 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-8d1fddff-5572-42ae-9ee5-7645b40627e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:14:23.823227 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:23.857780 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 444/872] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:14:23 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 10:14:24.123495 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd0b477-1c6e-4bad-8a36-b35f801f2dfb None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:24.226723 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd0b477-1c6e-4bad-8a36-b35f801f2dfb None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:24.262631 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2929bc5-1e5d-4a1e-8793-0e401142338e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:24.263258 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2929bc5-1e5d-4a1e-8793-0e401142338e None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:24.263536 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2929bc5-1e5d-4a1e-8793-0e401142338e None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:24.263805 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2929bc5-1e5d-4a1e-8793-0e401142338e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:24.264407 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2929bc5-1e5d-4a1e-8793-0e401142338e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:24.265768 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2929bc5-1e5d-4a1e-8793-0e401142338e None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:24.274773 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-b2929bc5-1e5d-4a1e-8793-0e401142338e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 19 10:14:24.274773 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:14:24.274773 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 10:14:24.274773 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 10:14:24.274773 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 10:14:24.274773 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 10:14:24.274773 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 10:14:24.274773 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 10:14:24.274773 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 19 10:14:24.274773 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Sep 19 10:14:24.274773 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 10:14:24.274773 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Sep 19 10:14:24.274773 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:14:24.274773 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:14:24.274773 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:14:24.274773 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:14:24.274773 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:14:24.275756 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:14:24.275756 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:14:24.275756 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:14:24.275756 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:14:24.275756 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:14:24.275756 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:14:24.275756 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 10:14:24.275756 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 10:14:24.275756 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 10:14:24.275756 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 10:14:24.275756 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:14:24.275756 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:14:24.275756 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:14:24.275756 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:14:24.275756 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:14:24.275756 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:14:24.276593 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:14:24.276593 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Sep 19 10:14:24.276593 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:14:24.276593 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:14:24.276593 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:14:24.276593 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:14:24.276593 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:14:24.276593 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:14:24.276593 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:14:24.276593 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:14:24.276593 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 10:14:24.276593 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 10:14:24.276593 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 19 10:14:24.276593 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Sep 19 10:14:24.276593 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 429/873] 10.222.0.66 () {56 vars in 1126 bytes} [Mon Sep 19 10:14:24 2022] GET /identity/v3/services/object-store => generated 93 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:14:24.282205 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1fddff-5572-42ae-9ee5-7645b40627e5 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:24.387699 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1fddff-5572-42ae-9ee5-7645b40627e5 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:24.422523 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe9c604-8689-457f-9fc0-6c88cfca1b5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:24.423135 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe9c604-8689-457f-9fc0-6c88cfca1b5c None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:24.423416 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe9c604-8689-457f-9fc0-6c88cfca1b5c None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:24.423743 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe9c604-8689-457f-9fc0-6c88cfca1b5c None admin] PATH_INFO: `/v3/services` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:24.424500 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe9c604-8689-457f-9fc0-6c88cfca1b5c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:14:24.424848 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe9c604-8689-457f-9fc0-6c88cfca1b5c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:24.426831 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe9c604-8689-457f-9fc0-6c88cfca1b5c None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:24.431818 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 445/874] 10.222.0.66 () {56 vars in 1122 bytes} [Mon Sep 19 10:14:24 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:14:24.437179 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2929bc5-1e5d-4a1e-8793-0e401142338e None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:24.460032 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:24.465976 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0f62ac-294f-4158-9224-526be38e8a7d None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:24.467102 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0f62ac-294f-4158-9224-526be38e8a7d None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:24.467864 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0f62ac-294f-4158-9224-526be38e8a7d None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:24.469766 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 446/875] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:14:24 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:14:24.475484 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9e4770-0597-4287-aa44-037490e16f13 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:24.476014 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9e4770-0597-4287-aa44-037490e16f13 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:24.476477 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9e4770-0597-4287-aa44-037490e16f13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:24.499403 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-be9e4770-0597-4287-aa44-037490e16f13 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:14:24.501031 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-be9e4770-0597-4287-aa44-037490e16f13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:14:24.537912 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:24.550902 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2929bc5-1e5d-4a1e-8793-0e401142338e None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:24.583926 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 447/876] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:14:24 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 10:14:24.585306 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96d1cca-f9ac-40e3-ba3b-14a3e8eecd33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:24.585920 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96d1cca-f9ac-40e3-ba3b-14a3e8eecd33 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:24.586196 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96d1cca-f9ac-40e3-ba3b-14a3e8eecd33 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:24.586463 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96d1cca-f9ac-40e3-ba3b-14a3e8eecd33 None admin] PATH_INFO: `/v3/services` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:24.587084 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96d1cca-f9ac-40e3-ba3b-14a3e8eecd33 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:14:24.587382 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96d1cca-f9ac-40e3-ba3b-14a3e8eecd33 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:24.596213 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96d1cca-f9ac-40e3-ba3b-14a3e8eecd33 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:24.596213 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 430/877] 10.222.0.66 () {56 vars in 1122 bytes} [Mon Sep 19 10:14:24 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:14:24.832700 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8f6e69-943c-477a-804a-4cc9e5ee1a8f None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:24.833690 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8f6e69-943c-477a-804a-4cc9e5ee1a8f None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:24.834170 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8f6e69-943c-477a-804a-4cc9e5ee1a8f None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:24.835986 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 448/878] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:14:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:14:24.841570 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ec38e8-1d29-4f9c-9021-074d4653569d None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:24.842442 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ec38e8-1d29-4f9c-9021-074d4653569d None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:24.842919 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ec38e8-1d29-4f9c-9021-074d4653569d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:24.862342 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-58ec38e8-1d29-4f9c-9021-074d4653569d None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:14:24.863897 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-58ec38e8-1d29-4f9c-9021-074d4653569d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:14:24.869817 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8f6e69-943c-477a-804a-4cc9e5ee1a8f None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:24.939809 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 431/879] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:14:24 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 10:14:24.977661 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8f6e69-943c-477a-804a-4cc9e5ee1a8f None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:25.014511 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9627efc7-2f6a-4616-9d82-2384aa587bd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:25.015488 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9627efc7-2f6a-4616-9d82-2384aa587bd6 None admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:25.015973 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9627efc7-2f6a-4616-9d82-2384aa587bd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:25.016469 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9627efc7-2f6a-4616-9d82-2384aa587bd6 None admin] PATH_INFO: `/v3/services` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:25.017345 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9627efc7-2f6a-4616-9d82-2384aa587bd6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:25.018951 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9627efc7-2f6a-4616-9d82-2384aa587bd6 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:25.039306 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 449/880] 10.222.0.66 () {60 vars in 1141 bytes} [Mon Sep 19 10:14:24 2022] POST /identity/v3/services => generated 269 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 10:14:25.217100 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ec38e8-1d29-4f9c-9021-074d4653569d None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:25.234837 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:25.326573 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ec38e8-1d29-4f9c-9021-074d4653569d None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:25.355073 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40837eb-bb37-4c02-a342-9d4acae84acc None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:25.355422 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40837eb-bb37-4c02-a342-9d4acae84acc None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:25.355639 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40837eb-bb37-4c02-a342-9d4acae84acc None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:25.357281 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 450/881] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:14:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 10:14:25.362642 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026f2e54-c603-41ce-ac96-6780c4cabafd None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:25.363667 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026f2e54-c603-41ce-ac96-6780c4cabafd None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:25.364113 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026f2e54-c603-41ce-ac96-6780c4cabafd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:25.369118 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239d7ac8-b54b-4ca7-b8a5-967f85c58bc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:25.370106 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239d7ac8-b54b-4ca7-b8a5-967f85c58bc3 None admin] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:25.370564 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239d7ac8-b54b-4ca7-b8a5-967f85c58bc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:25.371185 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239d7ac8-b54b-4ca7-b8a5-967f85c58bc3 None admin] PATH_INFO: `/v3/services` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:25.372108 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239d7ac8-b54b-4ca7-b8a5-967f85c58bc3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:25.373694 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239d7ac8-b54b-4ca7-b8a5-967f85c58bc3 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:25.383717 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-026f2e54-c603-41ce-ac96-6780c4cabafd None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:14:25.384973 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-026f2e54-c603-41ce-ac96-6780c4cabafd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:14:25.394922 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 432/882] 10.222.0.66 () {60 vars in 1141 bytes} [Mon Sep 19 10:14:25 2022] POST /identity/v3/services => generated 251 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:14:25.423847 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:25.490588 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 451/883] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:14:25 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 10:14:25.775691 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239d7ac8-b54b-4ca7-b8a5-967f85c58bc3 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:25.847962 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:25.884979 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239d7ac8-b54b-4ca7-b8a5-967f85c58bc3 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:25.922288 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5104548-25cb-4d03-b5e0-3dbd69e794d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:25.922931 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5104548-25cb-4d03-b5e0-3dbd69e794d9 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:25.923211 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5104548-25cb-4d03-b5e0-3dbd69e794d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:25.923485 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5104548-25cb-4d03-b5e0-3dbd69e794d9 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:25.934521 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5104548-25cb-4d03-b5e0-3dbd69e794d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 10:14:25.939871 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-a5104548-25cb-4d03-b5e0-3dbd69e794d9 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 19 10:14:25.939871 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:14:25.939871 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:14:25.939871 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:14:25.939871 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:14:25.939871 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:14:25.939871 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:14:25.939871 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:14:25.939871 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:14:25.939871 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:14:25.939871 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:14:25.939871 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:14:25.939871 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 10:14:25.939871 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 10:14:25.939871 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 10:14:25.939871 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 10:14:25.941417 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 10:14:25.941417 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 10:14:25.941417 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 10:14:25.941417 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 10:14:25.941417 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:14:25.941417 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:14:25.941417 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:14:25.941417 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:14:25.941417 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:14:25.941417 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:14:25.941417 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:14:25.941417 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Sep 19 10:14:25.941417 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:14:25.941417 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:14:25.941417 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:14:25.941417 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:14:25.942282 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:14:25.942282 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:14:25.942282 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:14:25.942282 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:14:25.942282 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 10:14:25.942282 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 10:14:25.942282 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 10:14:25.942282 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 10:14:25.942282 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 10:14:25.942282 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 10:14:25.942282 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 19 10:14:25.942282 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Sep 19 10:14:25.942282 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 433/884] 10.222.0.66 () {56 vars in 1120 bytes} [Mon Sep 19 10:14:25 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:14:25.949355 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026f2e54-c603-41ce-ac96-6780c4cabafd None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:26.059063 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026f2e54-c603-41ce-ac96-6780c4cabafd None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:26.093219 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375d17f5-a2a1-47a3-8acf-a0d023833d47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:26.093814 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375d17f5-a2a1-47a3-8acf-a0d023833d47 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:26.094094 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375d17f5-a2a1-47a3-8acf-a0d023833d47 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:26.094368 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375d17f5-a2a1-47a3-8acf-a0d023833d47 None admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:26.095027 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375d17f5-a2a1-47a3-8acf-a0d023833d47 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:14:26.095328 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375d17f5-a2a1-47a3-8acf-a0d023833d47 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:26.096734 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375d17f5-a2a1-47a3-8acf-a0d023833d47 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:26.105878 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 452/885] 10.222.0.66 () {56 vars in 1115 bytes} [Mon Sep 19 10:14:25 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:14:26.111533 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5104548-25cb-4d03-b5e0-3dbd69e794d9 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:26.224642 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5104548-25cb-4d03-b5e0-3dbd69e794d9 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:26.252221 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:26.261885 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08667cbc-c649-4f4a-a7aa-8796b2737983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:26.262525 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08667cbc-c649-4f4a-a7aa-8796b2737983 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:26.262808 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08667cbc-c649-4f4a-a7aa-8796b2737983 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:26.263081 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08667cbc-c649-4f4a-a7aa-8796b2737983 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:26.274663 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08667cbc-c649-4f4a-a7aa-8796b2737983 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:26.276120 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08667cbc-c649-4f4a-a7aa-8796b2737983 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:26.292180 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-08667cbc-c649-4f4a-a7aa-8796b2737983 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 10:14:26.292180 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:14:26.292180 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:14:26.292180 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:14:26.292180 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:14:26.292180 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:14:26.292180 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:14:26.292180 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:14:26.292180 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:14:26.292180 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:14:26.292180 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:14:26.292180 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:14:26.292180 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 10:14:26.292180 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 10:14:26.292180 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 10:14:26.292180 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 10:14:26.293229 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:14:26.293229 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:14:26.293229 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:14:26.293229 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:14:26.293229 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:14:26.293229 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:14:26.293229 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:14:26.293229 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Sep 19 10:14:26.293229 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:14:26.293229 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:14:26.293229 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:14:26.293229 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:14:26.293229 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:14:26.293229 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:14:26.293229 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:14:26.293229 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:14:26.293229 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 10:14:26.294358 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 10:14:26.294358 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 10:14:26.294358 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Sep 19 10:14:26.294358 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 434/886] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 19 10:14:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:14:26.301385 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375d17f5-a2a1-47a3-8acf-a0d023833d47 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:26.321716 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:26.411746 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375d17f5-a2a1-47a3-8acf-a0d023833d47 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:26.447954 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd939c7f-2760-4b66-9015-d9e5ffb0110a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:26.448967 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd939c7f-2760-4b66-9015-d9e5ffb0110a None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:26.449470 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd939c7f-2760-4b66-9015-d9e5ffb0110a None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:26.449949 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd939c7f-2760-4b66-9015-d9e5ffb0110a None admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:26.450803 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd939c7f-2760-4b66-9015-d9e5ffb0110a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:14:26.451319 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd939c7f-2760-4b66-9015-d9e5ffb0110a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:26.452929 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd939c7f-2760-4b66-9015-d9e5ffb0110a None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:26.467787 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 453/887] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Sep 19 10:14:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:14:26.473799 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08667cbc-c649-4f4a-a7aa-8796b2737983 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:26.589530 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08667cbc-c649-4f4a-a7aa-8796b2737983 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:26.624695 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639685e6-c1b0-406c-84b6-58f161d029d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:26.625335 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639685e6-c1b0-406c-84b6-58f161d029d1 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:26.625618 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639685e6-c1b0-406c-84b6-58f161d029d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:26.625893 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639685e6-c1b0-406c-84b6-58f161d029d1 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:26.633863 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639685e6-c1b0-406c-84b6-58f161d029d1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:26.635356 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639685e6-c1b0-406c-84b6-58f161d029d1 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:26.646735 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-639685e6-c1b0-406c-84b6-58f161d029d1 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 19 10:14:26.646735 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:14:26.646735 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:14:26.646735 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:14:26.646735 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:14:26.646735 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:14:26.646735 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:14:26.646735 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:14:26.646735 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:14:26.646735 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:14:26.646735 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:14:26.646735 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:14:26.646735 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 10:14:26.646735 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 10:14:26.646735 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 10:14:26.646735 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 10:14:26.647684 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:14:26.647684 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:14:26.647684 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 10:14:26.647684 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 10:14:26.647684 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 10:14:26.647684 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 10:14:26.647684 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:14:26.647684 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:14:26.647684 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:14:26.647684 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:14:26.647684 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:14:26.647684 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Sep 19 10:14:26.647684 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:14:26.647684 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:14:26.647684 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:14:26.647684 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:14:26.647684 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:14:26.647684 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:14:26.648670 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:14:26.648670 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:14:26.648670 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 10:14:26.648670 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 10:14:26.648670 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 10:14:26.648670 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 10:14:26.648670 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 10:14:26.648670 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 10:14:26.648670 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 19 10:14:26.648670 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Sep 19 10:14:26.648670 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 435/888] 10.222.0.66 () {56 vars in 1117 bytes} [Mon Sep 19 10:14:26 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:14:26.655511 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd939c7f-2760-4b66-9015-d9e5ffb0110a None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:26.753732 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:26.780847 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd939c7f-2760-4b66-9015-d9e5ffb0110a None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:26.821781 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471d736c-be53-46c6-bb03-9d6734c024de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:26.822398 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471d736c-be53-46c6-bb03-9d6734c024de None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:26.822678 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471d736c-be53-46c6-bb03-9d6734c024de None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:26.822948 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471d736c-be53-46c6-bb03-9d6734c024de None admin] PATH_INFO: `/v3/users` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:26.823680 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471d736c-be53-46c6-bb03-9d6734c024de None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:14:26.823990 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471d736c-be53-46c6-bb03-9d6734c024de None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:26.825456 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471d736c-be53-46c6-bb03-9d6734c024de None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:26.844609 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 454/889] 10.222.0.66 () {56 vars in 1149 bytes} [Mon Sep 19 10:14:26 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:14:26.853326 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639685e6-c1b0-406c-84b6-58f161d029d1 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:26.904222 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:26.914631 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8d171e-a24a-4b47-b1e3-3045a364837f None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:26.914925 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8d171e-a24a-4b47-b1e3-3045a364837f None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:26.915188 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8d171e-a24a-4b47-b1e3-3045a364837f None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:26.917162 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 455/890] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:14:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:14:26.924647 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fd93f4-a176-461c-ac63-7f116fae1d91 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:26.925796 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fd93f4-a176-461c-ac63-7f116fae1d91 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:26.926289 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fd93f4-a176-461c-ac63-7f116fae1d91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:26.946814 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-15fd93f4-a176-461c-ac63-7f116fae1d91 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:14:26.948651 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-15fd93f4-a176-461c-ac63-7f116fae1d91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:14:26.974695 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639685e6-c1b0-406c-84b6-58f161d029d1 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:27.011495 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5ad7c8-53e7-4abb-91cb-cbfbd277898d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:27.012072 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5ad7c8-53e7-4abb-91cb-cbfbd277898d None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:27.012368 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5ad7c8-53e7-4abb-91cb-cbfbd277898d None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:27.012636 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5ad7c8-53e7-4abb-91cb-cbfbd277898d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:27.028541 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 456/891] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:14:26 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 10:14:27.084620 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5ad7c8-53e7-4abb-91cb-cbfbd277898d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:27.086074 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5ad7c8-53e7-4abb-91cb-cbfbd277898d None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:27.128313 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:27.189757 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 436/892] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Sep 19 10:14:26 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 19 10:14:27.195087 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fd93f4-a176-461c-ac63-7f116fae1d91 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:27.259280 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:27.306679 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fd93f4-a176-461c-ac63-7f116fae1d91 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:27.338185 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5ad7c8-53e7-4abb-91cb-cbfbd277898d None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:27.349427 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967fb28d-8e1e-420d-9f9a-ed9b0cdec2fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:27.350464 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967fb28d-8e1e-420d-9f9a-ed9b0cdec2fe None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:27.350967 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967fb28d-8e1e-420d-9f9a-ed9b0cdec2fe None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:27.351510 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967fb28d-8e1e-420d-9f9a-ed9b0cdec2fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:27.363101 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967fb28d-8e1e-420d-9f9a-ed9b0cdec2fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:27.364756 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967fb28d-8e1e-420d-9f9a-ed9b0cdec2fe None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:27.382271 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-967fb28d-8e1e-420d-9f9a-ed9b0cdec2fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 10:14:27.382271 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:14:27.382271 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:14:27.382271 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:14:27.382271 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:14:27.382271 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:14:27.382271 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:14:27.382271 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:14:27.382271 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:14:27.382271 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:14:27.382271 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:14:27.382271 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:14:27.382271 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 10:14:27.382271 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 10:14:27.382271 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 10:14:27.382271 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 10:14:27.383263 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:14:27.383263 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:14:27.383263 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:14:27.383263 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:14:27.383263 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:14:27.383263 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:14:27.383263 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:14:27.383263 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 19 10:14:27.383263 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:14:27.383263 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:14:27.383263 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:14:27.383263 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:14:27.383263 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:14:27.383263 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:14:27.383263 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:14:27.383263 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:14:27.383263 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 10:14:27.384201 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 10:14:27.384201 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 10:14:27.384201 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 19 10:14:27.384201 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 457/893] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 19 10:14:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:14:27.389213 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967fb28d-8e1e-420d-9f9a-ed9b0cdec2fe None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:27.456762 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5ad7c8-53e7-4abb-91cb-cbfbd277898d None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:27.492383 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db002a8-1374-4674-b5e8-6cf951c1d002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:27.493000 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db002a8-1374-4674-b5e8-6cf951c1d002 None admin] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:27.493296 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db002a8-1374-4674-b5e8-6cf951c1d002 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:27.493561 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db002a8-1374-4674-b5e8-6cf951c1d002 None admin] PATH_INFO: `/v3/services` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:27.494227 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db002a8-1374-4674-b5e8-6cf951c1d002 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:27.495601 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db002a8-1374-4674-b5e8-6cf951c1d002 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:27.499691 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967fb28d-8e1e-420d-9f9a-ed9b0cdec2fe None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:27.506273 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:27.520197 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:27.520578 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 437/894] 10.222.0.66 () {60 vars in 1141 bytes} [Mon Sep 19 10:14:27 2022] POST /identity/v3/services => generated 241 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 10:14:27.522195 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aad8e7c-4b08-4e35-b1a9-02403161cc26 None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:27.522491 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aad8e7c-4b08-4e35-b1a9-02403161cc26 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:27.522767 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aad8e7c-4b08-4e35-b1a9-02403161cc26 None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:27.524269 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 438/895] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:14:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:14:27.534963 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1073cb7-d0e4-42d1-9dd1-7f8d3e19fb24 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:27.535461 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1073cb7-d0e4-42d1-9dd1-7f8d3e19fb24 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:27.535951 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1073cb7-d0e4-42d1-9dd1-7f8d3e19fb24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:27.559003 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-e1073cb7-d0e4-42d1-9dd1-7f8d3e19fb24 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:14:27.560366 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-e1073cb7-d0e4-42d1-9dd1-7f8d3e19fb24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:14:27.563971 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873d03d1-7a70-41bb-abac-654ab4bac0d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:27.564976 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873d03d1-7a70-41bb-abac-654ab4bac0d4 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:27.565546 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873d03d1-7a70-41bb-abac-654ab4bac0d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:27.566093 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873d03d1-7a70-41bb-abac-654ab4bac0d4 None admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:27.566954 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873d03d1-7a70-41bb-abac-654ab4bac0d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:14:27.567459 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873d03d1-7a70-41bb-abac-654ab4bac0d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:27.569085 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873d03d1-7a70-41bb-abac-654ab4bac0d4 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:27.586024 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 458/896] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Sep 19 10:14:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:14:27.591671 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873d03d1-7a70-41bb-abac-654ab4bac0d4 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:27.650932 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 439/897] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:14:27 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 10:14:27.716544 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873d03d1-7a70-41bb-abac-654ab4bac0d4 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:27.738934 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9bdd1a-9570-4e9b-a63e-eada3e44ff52 None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:27.738934 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9bdd1a-9570-4e9b-a63e-eada3e44ff52 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:27.738934 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9bdd1a-9570-4e9b-a63e-eada3e44ff52 None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:27.740532 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 440/898] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:14:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 10:14:27.746318 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be94640-179f-4962-a83e-3dda59c28497 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:27.747135 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be94640-179f-4962-a83e-3dda59c28497 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:27.747482 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be94640-179f-4962-a83e-3dda59c28497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:27.759764 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc33252-e2d9-42d5-a26c-cc843441b0c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:27.760438 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc33252-e2d9-42d5-a26c-cc843441b0c2 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:27.760725 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc33252-e2d9-42d5-a26c-cc843441b0c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:27.760991 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc33252-e2d9-42d5-a26c-cc843441b0c2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:27.769955 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc33252-e2d9-42d5-a26c-cc843441b0c2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:27.771408 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc33252-e2d9-42d5-a26c-cc843441b0c2 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:27.771870 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-9be94640-179f-4962-a83e-3dda59c28497 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:14:27.773159 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-9be94640-179f-4962-a83e-3dda59c28497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:14:27.783485 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-cfc33252-e2d9-42d5-a26c-cc843441b0c2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 10:14:27.783485 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:14:27.783485 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:14:27.783485 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:14:27.783485 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:14:27.783485 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:14:27.783485 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:14:27.783485 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:14:27.783485 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:14:27.783485 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:14:27.783485 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:14:27.783485 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:14:27.783485 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 10:14:27.783485 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 10:14:27.783485 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 10:14:27.785165 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 10:14:27.785165 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:14:27.785165 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:14:27.785165 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:14:27.785165 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:14:27.785165 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:14:27.785165 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:14:27.785165 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:14:27.785165 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 19 10:14:27.785165 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:14:27.785165 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:14:27.785165 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:14:27.785165 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:14:27.785165 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:14:27.785165 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:14:27.785165 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:14:27.785165 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:14:27.786067 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 10:14:27.786067 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 10:14:27.786067 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 10:14:27.786067 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 10:14:27.786067 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 10:14:27.786067 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 10:14:27.786067 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 10:14:27.786067 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 19 10:14:27.788702 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 459/899] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Sep 19 10:14:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:14:27.794369 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc33252-e2d9-42d5-a26c-cc843441b0c2 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:27.840532 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:27.860113 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 441/900] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:14:27 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 10:14:27.917926 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc33252-e2d9-42d5-a26c-cc843441b0c2 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:27.957136 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e2406b-b46c-44c2-b6e9-ab800048f2b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:27.957758 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e2406b-b46c-44c2-b6e9-ab800048f2b5 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:27.958039 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e2406b-b46c-44c2-b6e9-ab800048f2b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:27.958323 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e2406b-b46c-44c2-b6e9-ab800048f2b5 None admin] PATH_INFO: `/v3/projects` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:27.959016 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e2406b-b46c-44c2-b6e9-ab800048f2b5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:14:27.959321 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e2406b-b46c-44c2-b6e9-ab800048f2b5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:27.960788 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e2406b-b46c-44c2-b6e9-ab800048f2b5 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:27.974099 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 460/901] 10.222.0.66 () {56 vars in 1148 bytes} [Mon Sep 19 10:14:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 10:14:27.980731 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be94640-179f-4962-a83e-3dda59c28497 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:27.985207 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e2406b-b46c-44c2-b6e9-ab800048f2b5 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:28.047817 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:28.093751 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be94640-179f-4962-a83e-3dda59c28497 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:28.122341 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e2406b-b46c-44c2-b6e9-ab800048f2b5 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:28.135611 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db2fc4d-56b8-4212-8ac3-c2b602a569ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:28.136572 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db2fc4d-56b8-4212-8ac3-c2b602a569ce None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:28.137050 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db2fc4d-56b8-4212-8ac3-c2b602a569ce None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:28.137518 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db2fc4d-56b8-4212-8ac3-c2b602a569ce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:28.138477 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db2fc4d-56b8-4212-8ac3-c2b602a569ce None admin] RBAC: Adding query filter params (role.id=89dc9467e2a84e2e9602562960b6668f, scope.project.id=be6b93ef3359434d9c776343f0aea333, user.id=e4d1160b71a84e2fa44a8ca6edf1846e) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:14:28.138989 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db2fc4d-56b8-4212-8ac3-c2b602a569ce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:28.140523 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:28.141457 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db2fc4d-56b8-4212-8ac3-c2b602a569ce None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:28.156205 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 442/902] 10.222.0.66 () {56 vars in 1374 bytes} [Mon Sep 19 10:14:27 2022] GET /identity/v3/role_assignments?user.id=e4d1160b71a84e2fa44a8ca6edf1846e&scope.project.id=be6b93ef3359434d9c776343f0aea333&role.id=89dc9467e2a84e2e9602562960b6668f => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:14:28.156205 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db2fc4d-56b8-4212-8ac3-c2b602a569ce None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:28.166353 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22c08be-bb0c-4e53-a687-67b149b00c00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:28.167666 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22c08be-bb0c-4e53-a687-67b149b00c00 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:28.168009 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22c08be-bb0c-4e53-a687-67b149b00c00 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:28.168265 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22c08be-bb0c-4e53-a687-67b149b00c00 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:28.168880 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22c08be-bb0c-4e53-a687-67b149b00c00 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:28.171101 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22c08be-bb0c-4e53-a687-67b149b00c00 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:28.182196 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-c22c08be-bb0c-4e53-a687-67b149b00c00 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 19 10:14:28.182196 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:14:28.182196 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 10:14:28.182196 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 10:14:28.182196 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 10:14:28.182196 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 10:14:28.182196 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 10:14:28.182196 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 10:14:28.182196 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 19 10:14:28.182196 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 19 10:14:28.182196 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 10:14:28.182196 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 19 10:14:28.182196 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:14:28.182196 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:14:28.182196 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:14:28.182196 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:14:28.183196 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:14:28.183196 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:14:28.183196 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:14:28.183196 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:14:28.183196 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:14:28.183196 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:14:28.183196 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:14:28.183196 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 10:14:28.183196 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 10:14:28.183196 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 10:14:28.183196 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 10:14:28.183196 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:14:28.183196 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:14:28.183196 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:14:28.183196 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:14:28.183196 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:14:28.183196 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:14:28.184059 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:14:28.184059 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 19 10:14:28.184059 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:14:28.184059 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:14:28.184059 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:14:28.184059 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:14:28.184059 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:14:28.184059 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:14:28.184059 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:14:28.184059 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:14:28.184059 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 10:14:28.184059 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 10:14:28.184059 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 19 10:14:28.184059 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 19 10:14:28.188344 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 461/903] 10.222.0.66 () {56 vars in 1132 bytes} [Mon Sep 19 10:14:27 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 10:14:28.191219 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22c08be-bb0c-4e53-a687-67b149b00c00 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:28.291635 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db2fc4d-56b8-4212-8ac3-c2b602a569ce None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:28.324695 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:28.331953 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22c08be-bb0c-4e53-a687-67b149b00c00 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:28.339863 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c85833-2866-4e19-a9dd-3a6483626943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:28.340101 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c85833-2866-4e19-a9dd-3a6483626943 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:28.340497 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c85833-2866-4e19-a9dd-3a6483626943 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:28.341103 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c85833-2866-4e19-a9dd-3a6483626943 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:28.341875 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c85833-2866-4e19-a9dd-3a6483626943 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:28.343499 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c85833-2866-4e19-a9dd-3a6483626943 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:28.355788 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-32c85833-2866-4e19-a9dd-3a6483626943 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 19 10:14:28.355788 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:14:28.355788 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 10:14:28.355788 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 10:14:28.355788 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 10:14:28.355788 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 10:14:28.355788 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 10:14:28.355788 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 10:14:28.355788 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 19 10:14:28.355788 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Sep 19 10:14:28.355788 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 10:14:28.355788 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Sep 19 10:14:28.355788 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:14:28.355788 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:14:28.355788 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:14:28.355788 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:14:28.355788 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:14:28.358988 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:14:28.358988 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:14:28.358988 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:14:28.358988 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:14:28.358988 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:14:28.358988 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:14:28.358988 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 10:14:28.358988 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 10:14:28.358988 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 10:14:28.358988 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 10:14:28.358988 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:14:28.358988 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:14:28.358988 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:14:28.358988 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:14:28.358988 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:14:28.358988 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:14:28.363566 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:14:28.363566 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Sep 19 10:14:28.363566 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:14:28.363566 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:14:28.363566 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:14:28.363566 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:14:28.363566 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:14:28.363566 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:14:28.363566 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:14:28.363566 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:14:28.363566 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 10:14:28.363566 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 10:14:28.363566 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 19 10:14:28.363566 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Sep 19 10:14:28.363566 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 443/904] 10.222.0.66 () {56 vars in 1114 bytes} [Mon Sep 19 10:14:28 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:14:28.365473 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c85833-2866-4e19-a9dd-3a6483626943 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:28.374662 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522e8d40-6413-4971-a9e4-dbf500226de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:28.375305 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522e8d40-6413-4971-a9e4-dbf500226de3 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:28.375588 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522e8d40-6413-4971-a9e4-dbf500226de3 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:28.375854 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522e8d40-6413-4971-a9e4-dbf500226de3 None admin] PATH_INFO: `/v3/services` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:28.376520 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522e8d40-6413-4971-a9e4-dbf500226de3 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:14:28.376825 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522e8d40-6413-4971-a9e4-dbf500226de3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:28.379215 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522e8d40-6413-4971-a9e4-dbf500226de3 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:28.389620 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 462/905] 10.222.0.66 () {56 vars in 1126 bytes} [Mon Sep 19 10:14:28 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 10:14:28.396600 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522e8d40-6413-4971-a9e4-dbf500226de3 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:28.421483 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:28.513151 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522e8d40-6413-4971-a9e4-dbf500226de3 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:28.514255 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c85833-2866-4e19-a9dd-3a6483626943 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:28.551143 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6350a548-7c0c-4728-9f71-e84ba9b13433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:28.551990 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6350a548-7c0c-4728-9f71-e84ba9b13433 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:28.552308 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6350a548-7c0c-4728-9f71-e84ba9b13433 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:28.552672 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6350a548-7c0c-4728-9f71-e84ba9b13433 None admin] PATH_INFO: `/v3/services` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:28.553400 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6350a548-7c0c-4728-9f71-e84ba9b13433 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:14:28.553809 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6350a548-7c0c-4728-9f71-e84ba9b13433 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:28.555324 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6350a548-7c0c-4728-9f71-e84ba9b13433 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:28.565231 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 463/906] 10.222.0.66 () {56 vars in 1126 bytes} [Mon Sep 19 10:14:28 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:14:28.566318 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6350a548-7c0c-4728-9f71-e84ba9b13433 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:28.571748 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ef219f-39ca-45ba-bf48-83a6c6d22f8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:28.572671 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ef219f-39ca-45ba-bf48-83a6c6d22f8f None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:28.573156 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ef219f-39ca-45ba-bf48-83a6c6d22f8f None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:28.573662 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ef219f-39ca-45ba-bf48-83a6c6d22f8f None admin] PATH_INFO: `/v3/services` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:28.574496 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ef219f-39ca-45ba-bf48-83a6c6d22f8f None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:14:28.575023 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ef219f-39ca-45ba-bf48-83a6c6d22f8f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:28.577104 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ef219f-39ca-45ba-bf48-83a6c6d22f8f None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:28.590141 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 444/907] 10.222.0.66 () {56 vars in 1114 bytes} [Mon Sep 19 10:14:28 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:14:28.592077 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ef219f-39ca-45ba-bf48-83a6c6d22f8f None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:28.663624 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:28.673709 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:28.694127 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6350a548-7c0c-4728-9f71-e84ba9b13433 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:28.721163 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ef219f-39ca-45ba-bf48-83a6c6d22f8f None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:28.729377 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a59410-604b-4b62-9f11-e0002c524d73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:28.729988 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a59410-604b-4b62-9f11-e0002c524d73 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:28.730264 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a59410-604b-4b62-9f11-e0002c524d73 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:28.730912 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a59410-604b-4b62-9f11-e0002c524d73 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:28.731224 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a59410-604b-4b62-9f11-e0002c524d73 None admin] RBAC: Adding query filter params (interface=public, service_id=a7ae1a7d3eb9443babde1440faf1a52d, region_id=RegionOne) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:14:28.731527 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a59410-604b-4b62-9f11-e0002c524d73 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:28.732926 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a59410-604b-4b62-9f11-e0002c524d73 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:28.743296 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 464/908] 10.222.0.66 () {56 vars in 1251 bytes} [Mon Sep 19 10:14:28 2022] GET /identity/v3/endpoints?service_id=a7ae1a7d3eb9443babde1440faf1a52d&interface=public®ion_id=RegionOne => generated 194 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:14:28.744341 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a59410-604b-4b62-9f11-e0002c524d73 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:28.768924 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1cfe75-5597-4fb9-9e50-cab284847b15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:28.769821 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1cfe75-5597-4fb9-9e50-cab284847b15 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:28.770249 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1cfe75-5597-4fb9-9e50-cab284847b15 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:28.770681 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1cfe75-5597-4fb9-9e50-cab284847b15 None admin] PATH_INFO: `/v3/services` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:28.771456 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1cfe75-5597-4fb9-9e50-cab284847b15 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:14:28.771911 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1cfe75-5597-4fb9-9e50-cab284847b15 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:28.773544 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1cfe75-5597-4fb9-9e50-cab284847b15 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:28.783992 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 445/909] 10.222.0.66 () {56 vars in 1114 bytes} [Mon Sep 19 10:14:28 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 10:14:28.785673 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1cfe75-5597-4fb9-9e50-cab284847b15 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:28.852589 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a59410-604b-4b62-9f11-e0002c524d73 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:28.886975 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae62bd1-916d-4cfa-8bbf-ea134ad113f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:28.887861 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae62bd1-916d-4cfa-8bbf-ea134ad113f8 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:28.888267 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae62bd1-916d-4cfa-8bbf-ea134ad113f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:28.888634 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae62bd1-916d-4cfa-8bbf-ea134ad113f8 None admin] PATH_INFO: `/v3/services` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:28.889342 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae62bd1-916d-4cfa-8bbf-ea134ad113f8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:28.890802 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae62bd1-916d-4cfa-8bbf-ea134ad113f8 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:28.900209 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 465/910] 10.222.0.66 () {56 vars in 1087 bytes} [Mon Sep 19 10:14:28 2022] GET /identity/v3/services => generated 1497 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 10:14:28.909146 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1cfe75-5597-4fb9-9e50-cab284847b15 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:28.929953 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:28.952968 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d169309-0827-4771-ad5c-be577d4335f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:28.953957 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d169309-0827-4771-ad5c-be577d4335f0 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:28.954467 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d169309-0827-4771-ad5c-be577d4335f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:28.954942 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d169309-0827-4771-ad5c-be577d4335f0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:28.955860 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d169309-0827-4771-ad5c-be577d4335f0 None admin] RBAC: Adding query filter params (interface=public, service_id=423c35cfd9864de998945c01c3a2a973, region_id=RegionOne) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:14:28.957058 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d169309-0827-4771-ad5c-be577d4335f0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:28.958820 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d169309-0827-4771-ad5c-be577d4335f0 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:28.965566 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 446/911] 10.222.0.66 () {56 vars in 1251 bytes} [Mon Sep 19 10:14:28 2022] GET /identity/v3/endpoints?service_id=423c35cfd9864de998945c01c3a2a973&interface=public®ion_id=RegionOne => generated 194 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:14:28.970955 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae62bd1-916d-4cfa-8bbf-ea134ad113f8 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:28.991301 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:29.084425 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae62bd1-916d-4cfa-8bbf-ea134ad113f8 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:29.124483 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf1e01d-e598-4f88-aad7-f224705854b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:29.125287 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf1e01d-e598-4f88-aad7-f224705854b9 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:29.125579 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf1e01d-e598-4f88-aad7-f224705854b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:29.125846 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf1e01d-e598-4f88-aad7-f224705854b9 None admin] PATH_INFO: `/v3/services` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:29.126476 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf1e01d-e598-4f88-aad7-f224705854b9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:29.127883 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf1e01d-e598-4f88-aad7-f224705854b9 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:29.135134 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 466/912] 10.222.0.66 () {56 vars in 1087 bytes} [Mon Sep 19 10:14:28 2022] GET /identity/v3/services => generated 1497 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 10:14:29.875877 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeea84d-ccee-4eee-8604-a73592af0c70 None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:29.876441 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeea84d-ccee-4eee-8604-a73592af0c70 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:29.876876 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeea84d-ccee-4eee-8604-a73592af0c70 None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:29.878656 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 447/913] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:14:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:14:29.884693 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acc3cb0-5bb8-4105-b96f-f66c07f2983b None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:29.885281 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acc3cb0-5bb8-4105-b96f-f66c07f2983b None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:29.885759 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acc3cb0-5bb8-4105-b96f-f66c07f2983b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:29.905470 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-9acc3cb0-5bb8-4105-b96f-f66c07f2983b None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:14:29.907026 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-9acc3cb0-5bb8-4105-b96f-f66c07f2983b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:14:29.978568 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 467/914] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:14:29 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 10:14:30.259478 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeea84d-ccee-4eee-8604-a73592af0c70 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:30.373106 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeea84d-ccee-4eee-8604-a73592af0c70 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:30.413213 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6269588c-d808-4a6c-87f5-e46f3f246e34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:30.413845 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6269588c-d808-4a6c-87f5-e46f3f246e34 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:30.414125 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6269588c-d808-4a6c-87f5-e46f3f246e34 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:30.414396 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6269588c-d808-4a6c-87f5-e46f3f246e34 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:30.414973 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6269588c-d808-4a6c-87f5-e46f3f246e34 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:30.416371 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6269588c-d808-4a6c-87f5-e46f3f246e34 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:30.426280 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-6269588c-d808-4a6c-87f5-e46f3f246e34 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 19 10:14:30.426280 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:14:30.426280 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 10:14:30.426280 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 10:14:30.426280 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 10:14:30.426280 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 10:14:30.426280 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 10:14:30.426280 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 10:14:30.426280 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 19 10:14:30.426280 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Sep 19 10:14:30.426280 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 10:14:30.426280 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Sep 19 10:14:30.426280 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:14:30.426280 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:14:30.426280 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:14:30.426280 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:14:30.426280 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:14:30.427287 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:14:30.427287 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:14:30.427287 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:14:30.427287 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:14:30.427287 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:14:30.427287 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:14:30.427287 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 10:14:30.427287 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 10:14:30.427287 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 10:14:30.427287 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 10:14:30.427287 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:14:30.427287 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:14:30.427287 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:14:30.427287 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:14:30.427287 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:14:30.427287 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:14:30.428134 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:14:30.428134 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Sep 19 10:14:30.428134 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:14:30.428134 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:14:30.428134 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:14:30.428134 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:14:30.428134 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:14:30.428134 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:14:30.428134 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:14:30.428134 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:14:30.428134 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 10:14:30.428134 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 10:14:30.428134 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 19 10:14:30.428134 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Sep 19 10:14:30.428134 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 448/915] 10.222.0.66 () {56 vars in 1126 bytes} [Mon Sep 19 10:14:30 2022] GET /identity/v3/services/object-store => generated 93 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:14:30.434775 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea98fd96-fc39-4d33-9e78-b4fc3775818b None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:30.435363 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea98fd96-fc39-4d33-9e78-b4fc3775818b None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:30.435363 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea98fd96-fc39-4d33-9e78-b4fc3775818b None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:30.436915 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 468/916] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:14:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:14:30.437357 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6269588c-d808-4a6c-87f5-e46f3f246e34 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:30.441950 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c41b58-8d8e-4888-a685-d86e6897bd79 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:30.442427 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c41b58-8d8e-4888-a685-d86e6897bd79 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:30.442552 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c41b58-8d8e-4888-a685-d86e6897bd79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:30.454875 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:30.462016 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-b2c41b58-8d8e-4888-a685-d86e6897bd79 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:14:30.463962 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-b2c41b58-8d8e-4888-a685-d86e6897bd79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:14:30.496187 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:30.555162 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6269588c-d808-4a6c-87f5-e46f3f246e34 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:30.560250 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 469/917] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:14:30 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 10:14:30.593899 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c440cbbc-c2a6-4117-84cc-6cf37c44003e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:30.594923 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c440cbbc-c2a6-4117-84cc-6cf37c44003e None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:30.595416 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c440cbbc-c2a6-4117-84cc-6cf37c44003e None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:30.595954 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c440cbbc-c2a6-4117-84cc-6cf37c44003e None admin] PATH_INFO: `/v3/services` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:30.597325 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c440cbbc-c2a6-4117-84cc-6cf37c44003e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:14:30.597875 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c440cbbc-c2a6-4117-84cc-6cf37c44003e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:30.599435 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c440cbbc-c2a6-4117-84cc-6cf37c44003e None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:30.604904 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 449/918] 10.222.0.66 () {56 vars in 1122 bytes} [Mon Sep 19 10:14:30 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:14:30.610735 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c41b58-8d8e-4888-a685-d86e6897bd79 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:30.732938 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c41b58-8d8e-4888-a685-d86e6897bd79 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:30.768295 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9bf30f-b7ac-4e36-91de-6dc890f792fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:30.769787 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9bf30f-b7ac-4e36-91de-6dc890f792fc None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:30.770316 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9bf30f-b7ac-4e36-91de-6dc890f792fc None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:30.770815 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9bf30f-b7ac-4e36-91de-6dc890f792fc None admin] PATH_INFO: `/v3/services` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:30.771673 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9bf30f-b7ac-4e36-91de-6dc890f792fc None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:14:30.772194 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9bf30f-b7ac-4e36-91de-6dc890f792fc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:30.773755 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9bf30f-b7ac-4e36-91de-6dc890f792fc None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:30.776155 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:30.780551 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 470/919] 10.222.0.66 () {56 vars in 1122 bytes} [Mon Sep 19 10:14:30 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 10:14:30.787125 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c440cbbc-c2a6-4117-84cc-6cf37c44003e None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:30.883011 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9bf30f-b7ac-4e36-91de-6dc890f792fc None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:30.905125 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c440cbbc-c2a6-4117-84cc-6cf37c44003e None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:30.919810 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:30.953261 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571db791-6caf-45bc-9e23-09d53390ce5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:30.953879 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571db791-6caf-45bc-9e23-09d53390ce5e None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:30.954165 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571db791-6caf-45bc-9e23-09d53390ce5e None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:30.954438 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571db791-6caf-45bc-9e23-09d53390ce5e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:30.955390 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571db791-6caf-45bc-9e23-09d53390ce5e None admin] RBAC: Adding query filter params (interface=public, service_id=83453e3220bd445891b8080ce5c4e7f2, region_id=RegionOne) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:14:30.955709 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571db791-6caf-45bc-9e23-09d53390ce5e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:30.957838 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571db791-6caf-45bc-9e23-09d53390ce5e None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:30.965428 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 450/920] 10.222.0.66 () {56 vars in 1251 bytes} [Mon Sep 19 10:14:30 2022] GET /identity/v3/endpoints?service_id=83453e3220bd445891b8080ce5c4e7f2&interface=public®ion_id=RegionOne => generated 194 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:14:30.971158 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571db791-6caf-45bc-9e23-09d53390ce5e None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:31.011837 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9bf30f-b7ac-4e36-91de-6dc890f792fc None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:31.048412 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2811f2d-40c6-476e-802f-7b2e0d4f0e18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:31.049276 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2811f2d-40c6-476e-802f-7b2e0d4f0e18 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:31.049576 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2811f2d-40c6-476e-802f-7b2e0d4f0e18 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:31.049944 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2811f2d-40c6-476e-802f-7b2e0d4f0e18 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:31.063186 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2811f2d-40c6-476e-802f-7b2e0d4f0e18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 10:14:31.068241 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-a2811f2d-40c6-476e-802f-7b2e0d4f0e18 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 19 10:14:31.068241 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:14:31.068241 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:14:31.068241 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:14:31.068241 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:14:31.068241 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:14:31.068241 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:14:31.068241 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:14:31.068241 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:14:31.068241 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:14:31.068241 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:14:31.068241 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:14:31.068241 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 10:14:31.068241 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 10:14:31.068241 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 10:14:31.068241 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 10:14:31.069261 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 10:14:31.069261 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 10:14:31.069261 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 10:14:31.069261 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 10:14:31.069261 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:14:31.069261 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:14:31.069261 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:14:31.069261 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:14:31.069261 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:14:31.069261 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:14:31.069261 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:14:31.069261 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 19 10:14:31.069261 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:14:31.069261 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:14:31.069261 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:14:31.069261 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:14:31.070118 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:14:31.070118 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:14:31.070118 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:14:31.070118 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:14:31.070118 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 10:14:31.070118 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 10:14:31.070118 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 10:14:31.070118 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 10:14:31.070118 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 10:14:31.070118 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 10:14:31.070118 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 19 10:14:31.070118 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 19 10:14:31.075062 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 471/921] 10.222.0.66 () {56 vars in 1120 bytes} [Mon Sep 19 10:14:30 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:14:31.075950 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2811f2d-40c6-476e-802f-7b2e0d4f0e18 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:31.118596 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571db791-6caf-45bc-9e23-09d53390ce5e None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:31.142747 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:31.169054 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d42f574-d6d0-48f1-bb55-d97593232f8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:31.170513 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d42f574-d6d0-48f1-bb55-d97593232f8a None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:31.171367 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d42f574-d6d0-48f1-bb55-d97593232f8a None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:31.171843 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d42f574-d6d0-48f1-bb55-d97593232f8a None admin] PATH_INFO: `/v3/services` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:31.172697 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d42f574-d6d0-48f1-bb55-d97593232f8a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:31.174917 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d42f574-d6d0-48f1-bb55-d97593232f8a None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:31.182188 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 451/922] 10.222.0.66 () {56 vars in 1087 bytes} [Mon Sep 19 10:14:30 2022] GET /identity/v3/services => generated 1497 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 10:14:31.183627 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac48b184-54f9-4460-8810-c8a2b0e7e232 None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:31.184116 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac48b184-54f9-4460-8810-c8a2b0e7e232 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:31.184637 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac48b184-54f9-4460-8810-c8a2b0e7e232 None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:31.186509 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 452/923] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:14:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:14:31.192827 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2811f2d-40c6-476e-802f-7b2e0d4f0e18 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:31.194642 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc4e652-ff24-4a83-b193-84722e298ee2 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:31.195187 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc4e652-ff24-4a83-b193-84722e298ee2 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:31.195673 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc4e652-ff24-4a83-b193-84722e298ee2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:31.216105 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-7cc4e652-ff24-4a83-b193-84722e298ee2 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:14:31.217744 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-7cc4e652-ff24-4a83-b193-84722e298ee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:14:31.230477 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd622aa-605d-48dc-984f-7f4430864b8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:31.231095 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd622aa-605d-48dc-984f-7f4430864b8c None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:31.231370 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd622aa-605d-48dc-984f-7f4430864b8c None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:31.231692 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd622aa-605d-48dc-984f-7f4430864b8c None admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:31.232406 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd622aa-605d-48dc-984f-7f4430864b8c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:14:31.232732 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd622aa-605d-48dc-984f-7f4430864b8c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:31.234131 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd622aa-605d-48dc-984f-7f4430864b8c None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:31.248399 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 472/924] 10.222.0.66 () {56 vars in 1115 bytes} [Mon Sep 19 10:14:31 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:14:31.249760 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd622aa-605d-48dc-984f-7f4430864b8c None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:31.256574 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:31.311028 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 453/925] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:14:31 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 10:14:31.368038 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd622aa-605d-48dc-984f-7f4430864b8c None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:31.392588 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:31.401020 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d0bfa5-a522-4367-bc41-871a6526587a None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:31.401295 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d0bfa5-a522-4367-bc41-871a6526587a None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:31.401525 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d0bfa5-a522-4367-bc41-871a6526587a None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:31.403743 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 454/926] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:14:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:14:31.407133 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70425c94-0db9-4238-8514-0f96e2e7ce64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:31.407873 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70425c94-0db9-4238-8514-0f96e2e7ce64 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:31.408150 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70425c94-0db9-4238-8514-0f96e2e7ce64 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:31.408449 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70425c94-0db9-4238-8514-0f96e2e7ce64 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:31.409866 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65d35f0-0d62-40aa-8e97-21d432d229bc None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:31.410220 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65d35f0-0d62-40aa-8e97-21d432d229bc None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:31.410568 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65d35f0-0d62-40aa-8e97-21d432d229bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:31.421862 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70425c94-0db9-4238-8514-0f96e2e7ce64 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:31.423335 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70425c94-0db9-4238-8514-0f96e2e7ce64 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:31.434484 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-d65d35f0-0d62-40aa-8e97-21d432d229bc None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:14:31.435679 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-d65d35f0-0d62-40aa-8e97-21d432d229bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:14:31.439009 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-70425c94-0db9-4238-8514-0f96e2e7ce64 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 10:14:31.439009 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:14:31.439009 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:14:31.439009 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:14:31.439009 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:14:31.439009 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:14:31.439009 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:14:31.439009 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:14:31.439009 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:14:31.439009 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:14:31.439009 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:14:31.439009 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:14:31.439009 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 10:14:31.439009 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 10:14:31.439009 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 10:14:31.439009 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 10:14:31.441166 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:14:31.441166 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:14:31.441166 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:14:31.441166 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:14:31.441166 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:14:31.441166 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:14:31.441166 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:14:31.441166 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 19 10:14:31.441166 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:14:31.441166 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:14:31.441166 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:14:31.441166 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:14:31.441166 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:14:31.441166 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:14:31.441166 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:14:31.441166 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:14:31.441166 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 10:14:31.442287 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 10:14:31.442287 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 10:14:31.442287 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 19 10:14:31.442287 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 473/927] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 19 10:14:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 10:14:31.446576 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70425c94-0db9-4238-8514-0f96e2e7ce64 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:31.551649 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70425c94-0db9-4238-8514-0f96e2e7ce64 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:31.560258 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 455/928] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:14:31 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 10:14:31.589646 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65d35f0-0d62-40aa-8e97-21d432d229bc None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:31.592934 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb34960-4712-4927-a218-8d746a00e9a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:31.593548 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb34960-4712-4927-a218-8d746a00e9a9 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:31.593823 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb34960-4712-4927-a218-8d746a00e9a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:31.594095 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb34960-4712-4927-a218-8d746a00e9a9 None admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:31.594735 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb34960-4712-4927-a218-8d746a00e9a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:14:31.595033 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb34960-4712-4927-a218-8d746a00e9a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:31.596549 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb34960-4712-4927-a218-8d746a00e9a9 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:31.610456 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 474/929] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Sep 19 10:14:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 10:14:31.616652 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb34960-4712-4927-a218-8d746a00e9a9 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:31.660672 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:31.705606 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:31.713753 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65d35f0-0d62-40aa-8e97-21d432d229bc None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:31.748750 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb34960-4712-4927-a218-8d746a00e9a9 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:31.761858 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6327f4b3-f6d2-4ebc-8221-e2fb21a3139e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:31.763311 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6327f4b3-f6d2-4ebc-8221-e2fb21a3139e None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:31.764196 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6327f4b3-f6d2-4ebc-8221-e2fb21a3139e None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:31.764744 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6327f4b3-f6d2-4ebc-8221-e2fb21a3139e None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:31.766507 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6327f4b3-f6d2-4ebc-8221-e2fb21a3139e None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:31.768851 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6327f4b3-f6d2-4ebc-8221-e2fb21a3139e None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:31.781889 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-6327f4b3-f6d2-4ebc-8221-e2fb21a3139e None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 19 10:14:31.781889 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:14:31.781889 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 10:14:31.781889 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 10:14:31.781889 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 10:14:31.781889 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 10:14:31.781889 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 10:14:31.781889 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 10:14:31.781889 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 19 10:14:31.781889 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Sep 19 10:14:31.781889 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 10:14:31.781889 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Sep 19 10:14:31.781889 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:14:31.781889 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:14:31.781889 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:14:31.781889 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:14:31.783038 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:14:31.783038 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:14:31.783038 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:14:31.783038 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:14:31.783038 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:14:31.783038 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:14:31.783038 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:14:31.783038 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 10:14:31.783038 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 10:14:31.783038 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 10:14:31.783038 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 10:14:31.783038 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:14:31.783038 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:14:31.783038 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:14:31.783038 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:14:31.783038 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:14:31.783038 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:14:31.783914 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:14:31.783914 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Sep 19 10:14:31.783914 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:14:31.783914 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:14:31.783914 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:14:31.783914 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:14:31.783914 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:14:31.783914 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:14:31.783914 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:14:31.783914 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:14:31.783914 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 10:14:31.783914 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 10:14:31.783914 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 19 10:14:31.783914 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Sep 19 10:14:31.790613 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 456/930] 10.222.0.66 () {56 vars in 1132 bytes} [Mon Sep 19 10:14:31 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 10:14:31.792593 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6327f4b3-f6d2-4ebc-8221-e2fb21a3139e None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:31.795403 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef5cb59-087f-4c39-b5d9-21e0e5e616dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:31.796360 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef5cb59-087f-4c39-b5d9-21e0e5e616dd None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:31.796648 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef5cb59-087f-4c39-b5d9-21e0e5e616dd None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:31.796916 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef5cb59-087f-4c39-b5d9-21e0e5e616dd None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:31.805442 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef5cb59-087f-4c39-b5d9-21e0e5e616dd None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:31.806897 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef5cb59-087f-4c39-b5d9-21e0e5e616dd None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:31.823004 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-9ef5cb59-087f-4c39-b5d9-21e0e5e616dd None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 19 10:14:31.823004 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:14:31.823004 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:14:31.823004 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:14:31.823004 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:14:31.823004 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:14:31.823004 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:14:31.823004 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:14:31.823004 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:14:31.823004 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:14:31.823004 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:14:31.823004 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:14:31.823004 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 10:14:31.823004 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 10:14:31.823004 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 10:14:31.823004 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 10:14:31.824014 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:14:31.824014 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:14:31.824014 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 10:14:31.824014 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 10:14:31.824014 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 10:14:31.824014 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 10:14:31.824014 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:14:31.824014 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:14:31.824014 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:14:31.824014 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:14:31.824014 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:14:31.824014 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 19 10:14:31.824014 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:14:31.824014 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:14:31.824014 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:14:31.824014 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:14:31.824014 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:14:31.824014 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:14:31.824983 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:14:31.824983 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:14:31.824983 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 10:14:31.824983 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 10:14:31.824983 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 10:14:31.824983 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 10:14:31.824983 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 10:14:31.824983 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 10:14:31.824983 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 19 10:14:31.824983 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 19 10:14:31.828474 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 475/931] 10.222.0.66 () {56 vars in 1117 bytes} [Mon Sep 19 10:14:31 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:14:31.833281 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef5cb59-087f-4c39-b5d9-21e0e5e616dd None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:31.909797 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6327f4b3-f6d2-4ebc-8221-e2fb21a3139e None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:31.945587 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:31.948973 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f0b9a6-f332-4fe3-a090-33e6cf24238d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:31.949679 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f0b9a6-f332-4fe3-a090-33e6cf24238d None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:31.949949 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f0b9a6-f332-4fe3-a090-33e6cf24238d None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:31.950330 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f0b9a6-f332-4fe3-a090-33e6cf24238d None admin] PATH_INFO: `/v3/services` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:31.951026 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f0b9a6-f332-4fe3-a090-33e6cf24238d None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:14:31.951331 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f0b9a6-f332-4fe3-a090-33e6cf24238d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:31.952775 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f0b9a6-f332-4fe3-a090-33e6cf24238d None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:31.953614 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef5cb59-087f-4c39-b5d9-21e0e5e616dd None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:31.962357 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 457/932] 10.222.0.66 () {56 vars in 1126 bytes} [Mon Sep 19 10:14:31 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 10:14:31.962357 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f0b9a6-f332-4fe3-a090-33e6cf24238d None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:31.989873 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:31.993392 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac01948-f6f8-48bf-8524-570e0ab4ae93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:31.993989 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac01948-f6f8-48bf-8524-570e0ab4ae93 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:31.994273 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac01948-f6f8-48bf-8524-570e0ab4ae93 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:31.994535 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac01948-f6f8-48bf-8524-570e0ab4ae93 None admin] PATH_INFO: `/v3/users` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:31.995254 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac01948-f6f8-48bf-8524-570e0ab4ae93 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:14:31.995554 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac01948-f6f8-48bf-8524-570e0ab4ae93 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:31.997067 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac01948-f6f8-48bf-8524-570e0ab4ae93 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:32.015301 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 476/933] 10.222.0.66 () {56 vars in 1149 bytes} [Mon Sep 19 10:14:31 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 10:14:32.020429 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac01948-f6f8-48bf-8524-570e0ab4ae93 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:32.068912 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f0b9a6-f332-4fe3-a090-33e6cf24238d None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:32.103633 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263256ef-3088-4c15-899c-1bcab549f5e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:32.104303 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263256ef-3088-4c15-899c-1bcab549f5e6 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:32.104590 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263256ef-3088-4c15-899c-1bcab549f5e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:32.104866 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263256ef-3088-4c15-899c-1bcab549f5e6 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:32.105444 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263256ef-3088-4c15-899c-1bcab549f5e6 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:32.106823 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263256ef-3088-4c15-899c-1bcab549f5e6 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:32.116268 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-263256ef-3088-4c15-899c-1bcab549f5e6 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 19 10:14:32.116268 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:14:32.116268 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 10:14:32.116268 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 10:14:32.116268 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 10:14:32.116268 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 10:14:32.116268 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 10:14:32.116268 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 10:14:32.116268 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 19 10:14:32.116268 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Sep 19 10:14:32.116268 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 10:14:32.116268 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Sep 19 10:14:32.116268 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:14:32.116268 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:14:32.116268 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:14:32.116268 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:14:32.116268 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:14:32.117286 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:14:32.117286 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:14:32.117286 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:14:32.117286 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:14:32.117286 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:14:32.117286 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:14:32.117286 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 10:14:32.117286 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 10:14:32.117286 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 10:14:32.117286 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 10:14:32.117286 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:14:32.117286 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:14:32.117286 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:14:32.117286 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:14:32.117286 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:14:32.117286 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:14:32.118118 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:14:32.118118 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Sep 19 10:14:32.118118 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:14:32.118118 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:14:32.118118 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:14:32.118118 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:14:32.118118 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:14:32.118118 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:14:32.118118 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:14:32.118118 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:14:32.118118 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 10:14:32.118118 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 10:14:32.118118 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 19 10:14:32.118118 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Sep 19 10:14:32.118118 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 458/934] 10.222.0.66 () {56 vars in 1114 bytes} [Mon Sep 19 10:14:31 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:14:32.118917 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263256ef-3088-4c15-899c-1bcab549f5e6 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:32.145097 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac01948-f6f8-48bf-8524-570e0ab4ae93 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:32.186821 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc55c2da-cb03-4552-a1c4-be6e1d10c618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:32.187577 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc55c2da-cb03-4552-a1c4-be6e1d10c618 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:32.187854 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc55c2da-cb03-4552-a1c4-be6e1d10c618 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:32.188123 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc55c2da-cb03-4552-a1c4-be6e1d10c618 None admin] PATH_INFO: `/v3/services` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:32.188767 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc55c2da-cb03-4552-a1c4-be6e1d10c618 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:14:32.189064 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc55c2da-cb03-4552-a1c4-be6e1d10c618 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:32.190424 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc55c2da-cb03-4552-a1c4-be6e1d10c618 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:32.195545 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 477/935] 10.222.0.66 () {56 vars in 1126 bytes} [Mon Sep 19 10:14:32 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:14:32.195545 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc55c2da-cb03-4552-a1c4-be6e1d10c618 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:32.218040 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:32.223726 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:32.236556 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263256ef-3088-4c15-899c-1bcab549f5e6 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:32.273000 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b26662-1c34-428d-88ec-d07c1dad6376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:32.273625 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b26662-1c34-428d-88ec-d07c1dad6376 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:32.273901 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b26662-1c34-428d-88ec-d07c1dad6376 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:32.274170 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b26662-1c34-428d-88ec-d07c1dad6376 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:32.284338 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b26662-1c34-428d-88ec-d07c1dad6376 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:32.286308 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b26662-1c34-428d-88ec-d07c1dad6376 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:32.302047 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-63b26662-1c34-428d-88ec-d07c1dad6376 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 10:14:32.302047 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:14:32.302047 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:14:32.302047 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:14:32.302047 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:14:32.302047 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:14:32.302047 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:14:32.302047 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:14:32.302047 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:14:32.302047 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:14:32.302047 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:14:32.302047 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:14:32.302047 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 10:14:32.302047 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 10:14:32.302047 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 10:14:32.302047 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 10:14:32.303013 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:14:32.303013 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:14:32.303013 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:14:32.303013 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:14:32.303013 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:14:32.303013 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:14:32.303013 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:14:32.303013 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Sep 19 10:14:32.303013 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:14:32.303013 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:14:32.303013 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:14:32.303013 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:14:32.303013 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:14:32.303013 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:14:32.303013 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:14:32.303013 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:14:32.303013 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 10:14:32.303922 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 10:14:32.303922 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 10:14:32.303922 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Sep 19 10:14:32.303922 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 459/936] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 19 10:14:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:14:32.303922 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b26662-1c34-428d-88ec-d07c1dad6376 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:32.313893 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc55c2da-cb03-4552-a1c4-be6e1d10c618 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:32.355964 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fd028c-232b-47e7-96d2-cddc19cceaed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:32.356896 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fd028c-232b-47e7-96d2-cddc19cceaed None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:32.357254 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fd028c-232b-47e7-96d2-cddc19cceaed None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:32.357534 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fd028c-232b-47e7-96d2-cddc19cceaed None admin] PATH_INFO: `/v3/services` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:32.358158 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fd028c-232b-47e7-96d2-cddc19cceaed None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:14:32.358466 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fd028c-232b-47e7-96d2-cddc19cceaed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:32.360315 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fd028c-232b-47e7-96d2-cddc19cceaed None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:32.370156 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 478/937] 10.222.0.66 () {56 vars in 1114 bytes} [Mon Sep 19 10:14:32 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:14:32.370156 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fd028c-232b-47e7-96d2-cddc19cceaed None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:32.416521 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b26662-1c34-428d-88ec-d07c1dad6376 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:32.451047 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0516b3-5267-41b4-bc1c-1f5086854d8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:32.451650 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0516b3-5267-41b4-bc1c-1f5086854d8f None admin] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:32.451926 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0516b3-5267-41b4-bc1c-1f5086854d8f None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:32.452215 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0516b3-5267-41b4-bc1c-1f5086854d8f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:32.452871 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0516b3-5267-41b4-bc1c-1f5086854d8f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:32.454235 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0516b3-5267-41b4-bc1c-1f5086854d8f None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:32.461238 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:32.464364 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:32.477975 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 460/938] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 19 10:14:32 2022] POST /identity/v3/endpoints => generated 347 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:14:32.478718 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0516b3-5267-41b4-bc1c-1f5086854d8f None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:32.498690 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fd028c-232b-47e7-96d2-cddc19cceaed None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:32.555217 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaae62c-3304-403c-a858-9b9e064ed66d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:32.555849 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaae62c-3304-403c-a858-9b9e064ed66d None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:32.556252 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaae62c-3304-403c-a858-9b9e064ed66d None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:32.556536 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaae62c-3304-403c-a858-9b9e064ed66d None admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:32.557197 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddaae62c-3304-403c-a858-9b9e064ed66d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:14:32.557499 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddaae62c-3304-403c-a858-9b9e064ed66d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:32.558937 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddaae62c-3304-403c-a858-9b9e064ed66d None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:32.573799 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 479/939] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Sep 19 10:14:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:14:32.580879 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaae62c-3304-403c-a858-9b9e064ed66d None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:32.616093 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0516b3-5267-41b4-bc1c-1f5086854d8f None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:32.663113 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4d71fe-22ab-4f36-963c-d4234edcdb1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:32.664041 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4d71fe-22ab-4f36-963c-d4234edcdb1e None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:32.664555 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4d71fe-22ab-4f36-963c-d4234edcdb1e None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:32.665015 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4d71fe-22ab-4f36-963c-d4234edcdb1e None admin] PATH_INFO: `/v3/services` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:32.665982 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4d71fe-22ab-4f36-963c-d4234edcdb1e None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:14:32.667008 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4d71fe-22ab-4f36-963c-d4234edcdb1e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:32.668916 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4d71fe-22ab-4f36-963c-d4234edcdb1e None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:32.682027 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 461/940] 10.222.0.66 () {56 vars in 1114 bytes} [Mon Sep 19 10:14:32 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:14:32.685129 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4d71fe-22ab-4f36-963c-d4234edcdb1e None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:32.718385 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaae62c-3304-403c-a858-9b9e064ed66d None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:32.760455 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89d76eb-6f93-49da-948e-9097a07496c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:32.761121 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89d76eb-6f93-49da-948e-9097a07496c6 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:32.761403 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89d76eb-6f93-49da-948e-9097a07496c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:32.761675 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89d76eb-6f93-49da-948e-9097a07496c6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:32.764569 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:32.770425 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89d76eb-6f93-49da-948e-9097a07496c6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:32.772426 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89d76eb-6f93-49da-948e-9097a07496c6 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:32.773690 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:32.787194 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-f89d76eb-6f93-49da-948e-9097a07496c6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 10:14:32.787194 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:14:32.787194 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:14:32.787194 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:14:32.787194 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:14:32.787194 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:14:32.787194 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:14:32.787194 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:14:32.787194 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:14:32.787194 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:14:32.787194 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:14:32.787194 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:14:32.787194 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 10:14:32.787194 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 10:14:32.787194 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 10:14:32.788136 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 10:14:32.788136 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:14:32.788136 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:14:32.788136 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:14:32.788136 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:14:32.788136 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:14:32.788136 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:14:32.788136 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:14:32.788136 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 19 10:14:32.788136 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:14:32.788136 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:14:32.788136 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:14:32.788136 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:14:32.788136 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:14:32.788136 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:14:32.788136 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:14:32.788136 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:14:32.793948 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 10:14:32.793948 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 10:14:32.793948 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 10:14:32.793948 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 10:14:32.793948 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 10:14:32.793948 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 10:14:32.793948 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 10:14:32.793948 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 19 10:14:32.793948 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 480/941] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Sep 19 10:14:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:14:32.796971 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89d76eb-6f93-49da-948e-9097a07496c6 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:32.842515 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4d71fe-22ab-4f36-963c-d4234edcdb1e None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:32.894768 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccac7f3-89dd-47a5-b405-e8cd53e7adc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:32.895421 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccac7f3-89dd-47a5-b405-e8cd53e7adc2 None admin] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:32.895699 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccac7f3-89dd-47a5-b405-e8cd53e7adc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:32.895972 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccac7f3-89dd-47a5-b405-e8cd53e7adc2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:32.896752 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccac7f3-89dd-47a5-b405-e8cd53e7adc2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:32.898703 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccac7f3-89dd-47a5-b405-e8cd53e7adc2 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:32.926084 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89d76eb-6f93-49da-948e-9097a07496c6 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:32.932284 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 462/942] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 19 10:14:32 2022] POST /identity/v3/endpoints => generated 346 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 10:14:32.976032 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c967a427-8ae7-4a7a-b4cf-c21c0e173e43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:32.977107 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c967a427-8ae7-4a7a-b4cf-c21c0e173e43 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:32.977652 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c967a427-8ae7-4a7a-b4cf-c21c0e173e43 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:32.978137 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c967a427-8ae7-4a7a-b4cf-c21c0e173e43 None admin] PATH_INFO: `/v3/projects` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:32.979035 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c967a427-8ae7-4a7a-b4cf-c21c0e173e43 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:14:32.979644 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c967a427-8ae7-4a7a-b4cf-c21c0e173e43 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:32.981419 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c967a427-8ae7-4a7a-b4cf-c21c0e173e43 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:33.002408 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 481/943] 10.222.0.66 () {56 vars in 1148 bytes} [Mon Sep 19 10:14:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 10:14:33.004786 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccac7f3-89dd-47a5-b405-e8cd53e7adc2 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:33.126996 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccac7f3-89dd-47a5-b405-e8cd53e7adc2 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:33.145416 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:33.167636 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f84fd54-1ca5-4097-8c23-162ed6d80f25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:33.168340 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f84fd54-1ca5-4097-8c23-162ed6d80f25 None admin] REQUEST_METHOD: `PUT` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:33.168620 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f84fd54-1ca5-4097-8c23-162ed6d80f25 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:33.168895 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f84fd54-1ca5-4097-8c23-162ed6d80f25 None admin] PATH_INFO: `/v3/projects/be6b93ef3359434d9c776343f0aea333/users/e4d1160b71a84e2fa44a8ca6edf1846e/roles/89dc9467e2a84e2e9602562960b6668f` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:33.171287 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f84fd54-1ca5-4097-8c23-162ed6d80f25 None admin] RBAC: Authorizing `identity:create_grant(project_id=be6b93ef3359434d9c776343f0aea333, user_id=e4d1160b71a84e2fa44a8ca6edf1846e, role_id=89dc9467e2a84e2e9602562960b6668f)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:33.172795 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f84fd54-1ca5-4097-8c23-162ed6d80f25 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:33.188221 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 463/944] 10.222.0.66 () {58 vars in 1439 bytes} [Mon Sep 19 10:14:33 2022] PUT /identity/v3/projects/be6b93ef3359434d9c776343f0aea333/users/e4d1160b71a84e2fa44a8ca6edf1846e/roles/89dc9467e2a84e2e9602562960b6668f => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 10:14:33.483311 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f00df0-93ee-4fe9-809b-9ecd9eea6e2d None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:33.483829 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f00df0-93ee-4fe9-809b-9ecd9eea6e2d None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:33.483829 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f00df0-93ee-4fe9-809b-9ecd9eea6e2d None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:33.485439 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 482/945] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:14:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:14:33.491497 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954bb4f7-20d9-4d1d-a9a0-b37a7c07c844 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:33.491960 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954bb4f7-20d9-4d1d-a9a0-b37a7c07c844 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:33.492051 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954bb4f7-20d9-4d1d-a9a0-b37a7c07c844 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:33.510529 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-954bb4f7-20d9-4d1d-a9a0-b37a7c07c844 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:14:33.511707 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-954bb4f7-20d9-4d1d-a9a0-b37a7c07c844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:14:33.582417 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 464/946] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:14:33 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 10:14:33.863040 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f00df0-93ee-4fe9-809b-9ecd9eea6e2d None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:33.922607 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:33.980680 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f00df0-93ee-4fe9-809b-9ecd9eea6e2d None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:34.017324 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2804d66b-f080-43e9-b7f0-975fb04a7576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:34.018189 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2804d66b-f080-43e9-b7f0-975fb04a7576 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:34.018676 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2804d66b-f080-43e9-b7f0-975fb04a7576 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:34.019103 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2804d66b-f080-43e9-b7f0-975fb04a7576 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:34.019914 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2804d66b-f080-43e9-b7f0-975fb04a7576 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:34.021461 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2804d66b-f080-43e9-b7f0-975fb04a7576 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:34.030511 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-2804d66b-f080-43e9-b7f0-975fb04a7576 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 19 10:14:34.030511 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:14:34.030511 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 10:14:34.030511 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 10:14:34.030511 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 10:14:34.030511 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 10:14:34.030511 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 10:14:34.030511 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 10:14:34.030511 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 19 10:14:34.030511 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 19 10:14:34.030511 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 10:14:34.030511 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 19 10:14:34.030511 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:14:34.030511 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:14:34.030511 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:14:34.030511 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:14:34.030511 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:14:34.031740 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:14:34.031740 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:14:34.031740 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:14:34.031740 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:14:34.031740 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:14:34.031740 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:14:34.031740 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 10:14:34.031740 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 10:14:34.031740 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 10:14:34.031740 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 10:14:34.031740 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:14:34.031740 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:14:34.031740 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:14:34.031740 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:14:34.031740 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:14:34.031740 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:14:34.032818 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:14:34.032818 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 19 10:14:34.032818 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:14:34.032818 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:14:34.032818 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:14:34.032818 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:14:34.032818 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:14:34.032818 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:14:34.032818 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:14:34.032818 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:14:34.032818 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 10:14:34.032818 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 10:14:34.032818 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 19 10:14:34.032818 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 19 10:14:34.035652 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 483/947] 10.222.0.66 () {56 vars in 1126 bytes} [Mon Sep 19 10:14:33 2022] GET /identity/v3/services/object-store => generated 93 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:14:34.041361 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954bb4f7-20d9-4d1d-a9a0-b37a7c07c844 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:34.147654 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954bb4f7-20d9-4d1d-a9a0-b37a7c07c844 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:34.156122 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:34.190918 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e108d3-36dd-4c70-bee1-70df7036fe51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:34.191776 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e108d3-36dd-4c70-bee1-70df7036fe51 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:34.192269 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e108d3-36dd-4c70-bee1-70df7036fe51 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:34.192691 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e108d3-36dd-4c70-bee1-70df7036fe51 None admin] PATH_INFO: `/v3/services` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:34.193480 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e108d3-36dd-4c70-bee1-70df7036fe51 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:14:34.193928 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e108d3-36dd-4c70-bee1-70df7036fe51 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:34.195440 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e108d3-36dd-4c70-bee1-70df7036fe51 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:34.201023 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 465/948] 10.222.0.66 () {56 vars in 1122 bytes} [Mon Sep 19 10:14:34 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:14:34.209253 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2804d66b-f080-43e9-b7f0-975fb04a7576 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:34.316975 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2804d66b-f080-43e9-b7f0-975fb04a7576 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:34.333967 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:34.353157 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1186a1ce-29c0-4918-b734-6e4a03b60141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:34.353769 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1186a1ce-29c0-4918-b734-6e4a03b60141 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:34.354049 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1186a1ce-29c0-4918-b734-6e4a03b60141 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:34.354323 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1186a1ce-29c0-4918-b734-6e4a03b60141 None admin] PATH_INFO: `/v3/services` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:34.355002 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1186a1ce-29c0-4918-b734-6e4a03b60141 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:14:34.355304 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1186a1ce-29c0-4918-b734-6e4a03b60141 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:34.356759 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1186a1ce-29c0-4918-b734-6e4a03b60141 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:34.362058 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 484/949] 10.222.0.66 () {56 vars in 1122 bytes} [Mon Sep 19 10:14:34 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:14:34.368309 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e108d3-36dd-4c70-bee1-70df7036fe51 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:34.480960 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e108d3-36dd-4c70-bee1-70df7036fe51 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:34.517584 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dd9795-f16b-4f6e-a7e2-f8035bc9c75c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:34.518237 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dd9795-f16b-4f6e-a7e2-f8035bc9c75c None admin] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:34.518458 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dd9795-f16b-4f6e-a7e2-f8035bc9c75c None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:34.518761 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dd9795-f16b-4f6e-a7e2-f8035bc9c75c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:34.519437 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dd9795-f16b-4f6e-a7e2-f8035bc9c75c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:34.520841 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dd9795-f16b-4f6e-a7e2-f8035bc9c75c None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:34.541786 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 466/950] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 19 10:14:34 2022] POST /identity/v3/endpoints => generated 349 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:14:34.773026 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ee12f8-8bbf-4bc8-a6b7-30f01497b80e None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:34.773538 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ee12f8-8bbf-4bc8-a6b7-30f01497b80e None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:34.773538 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ee12f8-8bbf-4bc8-a6b7-30f01497b80e None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:34.774886 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 485/951] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:14:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:14:34.780511 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4e9c28-7ce5-48dd-900c-4971e7010c95 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:34.780799 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4e9c28-7ce5-48dd-900c-4971e7010c95 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:34.781074 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4e9c28-7ce5-48dd-900c-4971e7010c95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:34.801031 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-5b4e9c28-7ce5-48dd-900c-4971e7010c95 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:14:34.802557 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-5b4e9c28-7ce5-48dd-900c-4971e7010c95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:14:34.825740 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:34.883596 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 467/952] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:14:34 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 10:14:35.156965 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ee12f8-8bbf-4bc8-a6b7-30f01497b80e None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:35.250586 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34a6988-1881-48da-bb7f-c65f053c20d5 None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:35.251272 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34a6988-1881-48da-bb7f-c65f053c20d5 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:35.251744 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34a6988-1881-48da-bb7f-c65f053c20d5 None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:35.254139 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 468/953] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:14:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 10:14:35.259444 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0e20c0-ba46-4d44-a850-b0a349b91e52 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:35.260004 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0e20c0-ba46-4d44-a850-b0a349b91e52 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:35.260558 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0e20c0-ba46-4d44-a850-b0a349b91e52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:35.266631 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ee12f8-8bbf-4bc8-a6b7-30f01497b80e None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:35.280284 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-ee0e20c0-ba46-4d44-a850-b0a349b91e52 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:14:35.282004 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-ee0e20c0-ba46-4d44-a850-b0a349b91e52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:14:35.306360 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18ac794-e692-4c31-b197-48b2d5a1a545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:35.307474 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18ac794-e692-4c31-b197-48b2d5a1a545 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:35.307758 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18ac794-e692-4c31-b197-48b2d5a1a545 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:35.308028 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18ac794-e692-4c31-b197-48b2d5a1a545 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:35.308637 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18ac794-e692-4c31-b197-48b2d5a1a545 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:35.310008 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18ac794-e692-4c31-b197-48b2d5a1a545 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:35.322283 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-f18ac794-e692-4c31-b197-48b2d5a1a545 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 19 10:14:35.322283 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:14:35.322283 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 10:14:35.322283 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 10:14:35.322283 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 10:14:35.322283 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 10:14:35.322283 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 10:14:35.322283 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 10:14:35.322283 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 19 10:14:35.322283 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 19 10:14:35.322283 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 10:14:35.322283 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 19 10:14:35.322283 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:14:35.322283 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:14:35.322283 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:14:35.322283 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:14:35.322283 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:14:35.323297 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:14:35.323297 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:14:35.323297 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:14:35.323297 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:14:35.323297 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:14:35.323297 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:14:35.323297 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 10:14:35.323297 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 10:14:35.323297 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 10:14:35.323297 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 10:14:35.323297 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:14:35.323297 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:14:35.323297 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:14:35.323297 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:14:35.323297 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:14:35.323297 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:14:35.324121 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:14:35.324121 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 19 10:14:35.324121 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:14:35.324121 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:14:35.324121 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:14:35.324121 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:14:35.324121 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:14:35.324121 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:14:35.324121 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:14:35.324121 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:14:35.324121 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 10:14:35.324121 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 10:14:35.324121 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 19 10:14:35.324121 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 19 10:14:35.328338 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 486/954] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Sep 19 10:14:35 2022] GET /identity/v3/services/compute => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:14:35.329219 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18ac794-e692-4c31-b197-48b2d5a1a545 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:35.376658 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 469/955] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:14:35 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 10:14:35.380379 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:35.437031 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18ac794-e692-4c31-b197-48b2d5a1a545 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:35.483236 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84241240-a702-4c49-8718-b13c45f0dad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:35.483872 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84241240-a702-4c49-8718-b13c45f0dad2 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:35.484150 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84241240-a702-4c49-8718-b13c45f0dad2 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:35.484460 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84241240-a702-4c49-8718-b13c45f0dad2 None admin] PATH_INFO: `/v3/services` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:35.485112 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84241240-a702-4c49-8718-b13c45f0dad2 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:14:35.485417 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84241240-a702-4c49-8718-b13c45f0dad2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:35.486968 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84241240-a702-4c49-8718-b13c45f0dad2 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:35.493163 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 487/956] 10.222.0.66 () {56 vars in 1112 bytes} [Mon Sep 19 10:14:35 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:14:35.498703 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0e20c0-ba46-4d44-a850-b0a349b91e52 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:35.569248 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8efed2-08a2-4a43-9e25-1e39a6975e50 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:35.569572 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8efed2-08a2-4a43-9e25-1e39a6975e50 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:35.569801 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8efed2-08a2-4a43-9e25-1e39a6975e50 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:35.571128 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 488/957] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:14:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 10:14:35.576077 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c07451d-dbeb-471a-b821-41cd3ba62ed5 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:35.576381 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c07451d-dbeb-471a-b821-41cd3ba62ed5 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:35.576659 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c07451d-dbeb-471a-b821-41cd3ba62ed5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:35.586860 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:35.596612 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-3c07451d-dbeb-471a-b821-41cd3ba62ed5 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:14:35.597899 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-3c07451d-dbeb-471a-b821-41cd3ba62ed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:14:35.607890 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0e20c0-ba46-4d44-a850-b0a349b91e52 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:35.651628 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998ee19b-29e2-449b-a83d-7076b1f8f575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:35.652261 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998ee19b-29e2-449b-a83d-7076b1f8f575 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:35.652551 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998ee19b-29e2-449b-a83d-7076b1f8f575 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:35.652808 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998ee19b-29e2-449b-a83d-7076b1f8f575 None admin] PATH_INFO: `/v3/services` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:35.653942 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998ee19b-29e2-449b-a83d-7076b1f8f575 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:14:35.654247 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998ee19b-29e2-449b-a83d-7076b1f8f575 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:35.655929 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998ee19b-29e2-449b-a83d-7076b1f8f575 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:35.664216 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 470/958] 10.222.0.66 () {56 vars in 1112 bytes} [Mon Sep 19 10:14:35 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:14:35.672129 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998ee19b-29e2-449b-a83d-7076b1f8f575 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:35.708218 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 489/959] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:14:35 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 10:14:35.797613 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998ee19b-29e2-449b-a83d-7076b1f8f575 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:35.835979 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e7ff72-3527-4f66-827a-27116aa06b61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:35.836684 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e7ff72-3527-4f66-827a-27116aa06b61 None admin] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:35.836966 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e7ff72-3527-4f66-827a-27116aa06b61 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:35.837239 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e7ff72-3527-4f66-827a-27116aa06b61 None admin] PATH_INFO: `/v3/projects` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:35.837888 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e7ff72-3527-4f66-827a-27116aa06b61 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:35.839344 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e7ff72-3527-4f66-827a-27116aa06b61 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:35.842025 dv-cinder-858275-1-smb devstack@keystone.service[81352]: WARNING keystone.server.flask.common [None req-58e7ff72-3527-4f66-827a-27116aa06b61 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 19 10:14:35.861632 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.sql.core [None req-58e7ff72-3527-4f66-827a-27116aa06b61 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 19 10:14:35.861632 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 19 10:14:35.861632 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [parameters: {'id': 'af5a5c7aff9a43da8121936e99708367', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 19 10:14:35.861632 dv-cinder-858275-1-smb devstack@keystone.service[81352]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81352) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 19 10:14:35.878871 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-58e7ff72-3527-4f66-827a-27116aa06b61 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id af5a5c7aff9a43da8121936e99708367.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id af5a5c7aff9a43da8121936e99708367. Sep 19 10:14:35.878871 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:14:35.878871 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 19 10:14:35.878871 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 19 10:14:35.878871 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 19 10:14:35.878871 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 19 10:14:35.878871 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 19 10:14:35.878871 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application result = self._query(query) Sep 19 10:14:35.878871 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 19 10:14:35.878871 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application conn.query(q) Sep 19 10:14:35.878871 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 19 10:14:35.878871 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 19 10:14:35.878871 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 19 10:14:35.879750 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application result.read() Sep 19 10:14:35.879750 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 19 10:14:35.879750 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 19 10:14:35.879750 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 19 10:14:35.879750 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 19 10:14:35.879750 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 19 10:14:35.879750 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 19 10:14:35.879750 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 19 10:14:35.879750 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 19 10:14:35.879750 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 19 10:14:35.879750 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Sep 19 10:14:35.879750 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 19 10:14:35.879750 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Sep 19 10:14:35.879750 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:14:35.879750 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 19 10:14:35.879750 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 19 10:14:35.879750 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Sep 19 10:14:35.879750 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return project_ref.to_dict() Sep 19 10:14:35.880775 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 19 10:14:35.880775 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application next(self.gen) Sep 19 10:14:35.880775 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 19 10:14:35.880775 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application yield resource Sep 19 10:14:35.880775 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 19 10:14:35.880775 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application next(self.gen) Sep 19 10:14:35.880775 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 19 10:14:35.880775 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application self.session.rollback() Sep 19 10:14:35.880775 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 19 10:14:35.880775 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application self.force_reraise() Sep 19 10:14:35.880775 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 19 10:14:35.880775 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise self.value Sep 19 10:14:35.880775 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 19 10:14:35.880775 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 19 10:14:35.880775 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 19 10:14:35.880775 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application session.commit() Sep 19 10:14:35.880775 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 19 10:14:35.881702 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 19 10:14:35.881702 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 19 10:14:35.881702 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application self._prepare_impl() Sep 19 10:14:35.881702 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 19 10:14:35.881702 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application self.session.flush() Sep 19 10:14:35.881702 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 19 10:14:35.881702 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application self._flush(objects) Sep 19 10:14:35.881702 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 19 10:14:35.881702 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 19 10:14:35.881702 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 19 10:14:35.881702 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application compat.raise_( Sep 19 10:14:35.881702 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 19 10:14:35.881702 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception Sep 19 10:14:35.881702 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 19 10:14:35.881702 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application flush_context.execute() Sep 19 10:14:35.881702 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 19 10:14:35.881702 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application rec.execute(self) Sep 19 10:14:35.882606 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 19 10:14:35.882606 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 19 10:14:35.882606 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 19 10:14:35.882606 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 19 10:14:35.882606 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 19 10:14:35.882606 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 19 10:14:35.882606 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 19 10:14:35.882606 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 19 10:14:35.882606 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 19 10:14:35.882606 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 19 10:14:35.882606 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 19 10:14:35.882606 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 19 10:14:35.882606 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 19 10:14:35.882606 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 19 10:14:35.882606 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 19 10:14:35.883458 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 19 10:14:35.883458 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 19 10:14:35.883458 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception Sep 19 10:14:35.883458 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 19 10:14:35.883458 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 19 10:14:35.883458 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 19 10:14:35.883458 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 19 10:14:35.883458 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 19 10:14:35.883458 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application result = self._query(query) Sep 19 10:14:35.883458 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 19 10:14:35.883458 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application conn.query(q) Sep 19 10:14:35.883458 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 19 10:14:35.883458 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 19 10:14:35.883458 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 19 10:14:35.883458 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application result.read() Sep 19 10:14:35.883458 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 19 10:14:35.883458 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 19 10:14:35.885371 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 19 10:14:35.885371 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 19 10:14:35.885371 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 19 10:14:35.885371 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 19 10:14:35.885371 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 19 10:14:35.885371 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 19 10:14:35.885371 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 19 10:14:35.885371 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 19 10:14:35.885371 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application [parameters: {'id': 'af5a5c7aff9a43da8121936e99708367', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 19 10:14:35.885371 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 19 10:14:35.885371 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Sep 19 10:14:35.885371 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 10:14:35.885371 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Sep 19 10:14:35.885371 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:14:35.885371 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Sep 19 10:14:35.886372 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Sep 19 10:14:35.886372 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 19 10:14:35.886372 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 19 10:14:35.886372 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Sep 19 10:14:35.886372 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Sep 19 10:14:35.886372 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 10:14:35.886372 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Sep 19 10:14:35.886372 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:14:35.886372 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:14:35.886372 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:14:35.886372 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:14:35.886372 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:14:35.886372 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:14:35.886372 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:14:35.886372 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:14:35.886372 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:14:35.886372 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:14:35.887623 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:14:35.887623 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Sep 19 10:14:35.887623 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Sep 19 10:14:35.887623 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:14:35.887623 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:14:35.887623 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Sep 19 10:14:35.887623 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.Conflict( Sep 19 10:14:35.887623 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id af5a5c7aff9a43da8121936e99708367. Sep 19 10:14:35.887623 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Sep 19 10:14:35.887623 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 471/960] 10.222.0.66 () {60 vars in 1140 bytes} [Mon Sep 19 10:14:35 2022] POST /identity/v3/projects => generated 262 bytes in 210 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Sep 19 10:14:35.889239 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c07451d-dbeb-471a-b821-41cd3ba62ed5 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:35.949013 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:36.015920 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c07451d-dbeb-471a-b821-41cd3ba62ed5 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:36.022136 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e7ff72-3527-4f66-827a-27116aa06b61 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:36.032645 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:36.058677 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b34c3c-d57d-40ce-8d2a-1470c8da988e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:36.059440 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b34c3c-d57d-40ce-8d2a-1470c8da988e None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:36.059968 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b34c3c-d57d-40ce-8d2a-1470c8da988e None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:36.060278 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b34c3c-d57d-40ce-8d2a-1470c8da988e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:36.070906 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b34c3c-d57d-40ce-8d2a-1470c8da988e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:36.072394 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b34c3c-d57d-40ce-8d2a-1470c8da988e None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:36.088013 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-83b34c3c-d57d-40ce-8d2a-1470c8da988e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 10:14:36.088013 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:14:36.088013 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:14:36.088013 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:14:36.088013 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:14:36.088013 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:14:36.088013 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:14:36.088013 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:14:36.088013 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:14:36.088013 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:14:36.088013 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:14:36.088013 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:14:36.088013 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 10:14:36.088013 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 10:14:36.088013 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 10:14:36.090098 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 10:14:36.090098 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:14:36.090098 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:14:36.090098 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:14:36.090098 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:14:36.090098 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:14:36.090098 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:14:36.090098 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:14:36.090098 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 19 10:14:36.090098 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:14:36.090098 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:14:36.090098 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:14:36.090098 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:14:36.090098 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:14:36.090098 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:14:36.090098 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:14:36.090098 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:14:36.092218 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 10:14:36.092218 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 10:14:36.092218 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 10:14:36.092218 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 10:14:36.092218 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 10:14:36.092218 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 10:14:36.092218 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 10:14:36.092218 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 19 10:14:36.092218 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 490/961] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Sep 19 10:14:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:14:36.096154 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b34c3c-d57d-40ce-8d2a-1470c8da988e None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:36.148657 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e7ff72-3527-4f66-827a-27116aa06b61 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:36.186292 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f3bfed-b81b-4992-b59a-6178e99fc791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:36.187069 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f3bfed-b81b-4992-b59a-6178e99fc791 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:36.187466 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f3bfed-b81b-4992-b59a-6178e99fc791 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:36.187735 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f3bfed-b81b-4992-b59a-6178e99fc791 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:36.199792 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f3bfed-b81b-4992-b59a-6178e99fc791 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 10:14:36.204630 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-52f3bfed-b81b-4992-b59a-6178e99fc791 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 19 10:14:36.204630 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:14:36.204630 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:14:36.204630 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:14:36.204630 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:14:36.204630 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:14:36.204630 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:14:36.204630 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:14:36.204630 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:14:36.204630 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:14:36.204630 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:14:36.204630 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:14:36.204630 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 10:14:36.204630 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 10:14:36.204630 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 10:14:36.204630 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 10:14:36.205577 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 10:14:36.205577 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 10:14:36.205577 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 10:14:36.205577 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 10:14:36.205577 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:14:36.205577 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:14:36.205577 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:14:36.205577 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:14:36.205577 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:14:36.205577 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:14:36.205577 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:14:36.205577 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Sep 19 10:14:36.205577 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:14:36.205577 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:14:36.205577 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:14:36.205577 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:14:36.206499 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:14:36.206499 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:14:36.206499 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:14:36.206499 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:14:36.206499 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 10:14:36.206499 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 10:14:36.206499 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 10:14:36.206499 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 10:14:36.206499 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 10:14:36.206499 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 10:14:36.206499 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 19 10:14:36.206499 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Sep 19 10:14:36.206499 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 472/962] 10.222.0.66 () {56 vars in 1120 bytes} [Mon Sep 19 10:14:36 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:14:36.213274 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f3bfed-b81b-4992-b59a-6178e99fc791 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:36.229435 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:36.234200 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b34c3c-d57d-40ce-8d2a-1470c8da988e None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:36.274765 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ee36b7-afd6-4095-85d1-963559357940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:36.275620 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ee36b7-afd6-4095-85d1-963559357940 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:36.275754 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ee36b7-afd6-4095-85d1-963559357940 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:36.275965 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ee36b7-afd6-4095-85d1-963559357940 None admin] PATH_INFO: `/v3/projects` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:36.276694 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ee36b7-afd6-4095-85d1-963559357940 None admin] RBAC: Adding query filter params (name=service) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:14:36.277000 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ee36b7-afd6-4095-85d1-963559357940 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:36.278519 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ee36b7-afd6-4095-85d1-963559357940 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:36.301360 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:36.307548 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 491/963] 10.222.0.66 () {56 vars in 1112 bytes} [Mon Sep 19 10:14:36 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 10:14:36.352382 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f3bfed-b81b-4992-b59a-6178e99fc791 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:36.399355 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f641d92e-9305-4313-85c2-6ac0b820a4e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:36.400420 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f641d92e-9305-4313-85c2-6ac0b820a4e4 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:36.400914 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f641d92e-9305-4313-85c2-6ac0b820a4e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:36.401395 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f641d92e-9305-4313-85c2-6ac0b820a4e4 None admin] PATH_INFO: `/v3/roles` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:36.402303 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f641d92e-9305-4313-85c2-6ac0b820a4e4 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:14:36.402824 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f641d92e-9305-4313-85c2-6ac0b820a4e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:36.404709 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f641d92e-9305-4313-85c2-6ac0b820a4e4 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:36.418265 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 473/964] 10.222.0.66 () {56 vars in 1115 bytes} [Mon Sep 19 10:14:36 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:14:36.425501 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ee36b7-afd6-4095-85d1-963559357940 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:36.540650 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ee36b7-afd6-4095-85d1-963559357940 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:36.580575 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fd6805-4906-4884-98b6-3aa4ad434ee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:36.582212 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fd6805-4906-4884-98b6-3aa4ad434ee0 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:36.582490 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fd6805-4906-4884-98b6-3aa4ad434ee0 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:36.582763 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fd6805-4906-4884-98b6-3aa4ad434ee0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:36.593920 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fd6805-4906-4884-98b6-3aa4ad434ee0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:36.595427 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fd6805-4906-4884-98b6-3aa4ad434ee0 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:36.611819 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-39fd6805-4906-4884-98b6-3aa4ad434ee0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 10:14:36.611819 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:14:36.611819 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:14:36.611819 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:14:36.611819 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:14:36.611819 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:14:36.611819 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:14:36.611819 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:14:36.611819 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:14:36.611819 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:14:36.611819 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:14:36.611819 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:14:36.611819 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 10:14:36.611819 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 10:14:36.611819 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 10:14:36.611819 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 10:14:36.612894 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:14:36.612894 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:14:36.612894 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:14:36.612894 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:14:36.612894 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:14:36.612894 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:14:36.612894 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:14:36.612894 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 19 10:14:36.612894 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:14:36.612894 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:14:36.612894 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:14:36.612894 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:14:36.612894 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:14:36.612894 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:14:36.612894 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:14:36.612894 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:14:36.612894 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 10:14:36.614233 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 10:14:36.614233 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 10:14:36.614233 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 19 10:14:36.614233 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 492/965] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 19 10:14:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:14:36.619117 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f641d92e-9305-4313-85c2-6ac0b820a4e4 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:36.733368 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f641d92e-9305-4313-85c2-6ac0b820a4e4 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:36.758910 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:36.771006 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbac6ea-5a95-4564-b5d8-b50a1bfc7eed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:36.771621 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbac6ea-5a95-4564-b5d8-b50a1bfc7eed None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:36.771906 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbac6ea-5a95-4564-b5d8-b50a1bfc7eed None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:36.772201 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbac6ea-5a95-4564-b5d8-b50a1bfc7eed None admin] PATH_INFO: `/v3/domains` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:36.772853 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbac6ea-5a95-4564-b5d8-b50a1bfc7eed None admin] RBAC: Adding query filter params (name=Default) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:14:36.773159 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbac6ea-5a95-4564-b5d8-b50a1bfc7eed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:36.774536 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbac6ea-5a95-4564-b5d8-b50a1bfc7eed None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:36.787654 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 474/966] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Sep 19 10:14:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:14:36.792988 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fd6805-4906-4884-98b6-3aa4ad434ee0 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:36.807204 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:36.818326 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d61cd97-1d01-4819-b0f0-6b1a281dcce9 None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:36.818700 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d61cd97-1d01-4819-b0f0-6b1a281dcce9 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:36.818894 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d61cd97-1d01-4819-b0f0-6b1a281dcce9 None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:36.821455 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 475/967] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:14:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:14:36.825730 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a256469-f7fd-46a9-bef4-1e55d4965cb6 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:36.826086 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a256469-f7fd-46a9-bef4-1e55d4965cb6 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:36.826291 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a256469-f7fd-46a9-bef4-1e55d4965cb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:36.847446 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-0a256469-f7fd-46a9-bef4-1e55d4965cb6 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:14:36.849601 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-0a256469-f7fd-46a9-bef4-1e55d4965cb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:14:36.922175 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fd6805-4906-4884-98b6-3aa4ad434ee0 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:36.932435 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 476/968] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:14:36 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 10:14:36.962366 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08b36e3-24d5-4832-b2ea-bad61e898a4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:36.963128 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08b36e3-24d5-4832-b2ea-bad61e898a4f None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:36.963412 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08b36e3-24d5-4832-b2ea-bad61e898a4f None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:36.963687 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08b36e3-24d5-4832-b2ea-bad61e898a4f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:36.972406 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08b36e3-24d5-4832-b2ea-bad61e898a4f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:36.973855 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08b36e3-24d5-4832-b2ea-bad61e898a4f None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:36.985996 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-d08b36e3-24d5-4832-b2ea-bad61e898a4f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 19 10:14:36.985996 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:14:36.985996 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:14:36.985996 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:14:36.985996 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:14:36.985996 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:14:36.985996 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:14:36.985996 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:14:36.985996 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:14:36.985996 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:14:36.985996 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:14:36.985996 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:14:36.985996 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 10:14:36.985996 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 10:14:36.985996 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 10:14:36.985996 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 10:14:36.986981 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:14:36.986981 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:14:36.986981 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 10:14:36.986981 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 10:14:36.986981 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 10:14:36.986981 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 10:14:36.986981 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:14:36.986981 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:14:36.986981 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:14:36.986981 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:14:36.986981 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:14:36.986981 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 19 10:14:36.986981 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:14:36.986981 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:14:36.986981 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:14:36.986981 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:14:36.986981 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:14:36.986981 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:14:36.988568 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:14:36.988568 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:14:36.988568 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 10:14:36.988568 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 10:14:36.988568 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 10:14:36.988568 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 10:14:36.988568 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 10:14:36.988568 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 10:14:36.988568 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 19 10:14:36.988568 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 19 10:14:36.988568 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 493/969] 10.222.0.66 () {56 vars in 1117 bytes} [Mon Sep 19 10:14:36 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:14:36.995000 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a256469-f7fd-46a9-bef4-1e55d4965cb6 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:37.108678 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a256469-f7fd-46a9-bef4-1e55d4965cb6 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:37.123719 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:37.144497 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7655920e-4086-4d06-88cc-e409f4861cb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:37.145119 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7655920e-4086-4d06-88cc-e409f4861cb3 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:37.145682 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7655920e-4086-4d06-88cc-e409f4861cb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:37.145959 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7655920e-4086-4d06-88cc-e409f4861cb3 None admin] PATH_INFO: `/v3/users` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:37.146688 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7655920e-4086-4d06-88cc-e409f4861cb3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:14:37.146997 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7655920e-4086-4d06-88cc-e409f4861cb3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:37.148470 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7655920e-4086-4d06-88cc-e409f4861cb3 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:37.167693 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 477/970] 10.222.0.66 () {56 vars in 1149 bytes} [Mon Sep 19 10:14:36 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:14:37.173245 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08b36e3-24d5-4832-b2ea-bad61e898a4f None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:37.233182 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7655920e-4086-4d06-88cc-e409f4861cb3 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:37.249942 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:37.290537 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08b36e3-24d5-4832-b2ea-bad61e898a4f None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:37.330257 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe88dfb2-09e2-4220-99c2-09e82b8c4426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:37.331283 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe88dfb2-09e2-4220-99c2-09e82b8c4426 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:37.331783 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe88dfb2-09e2-4220-99c2-09e82b8c4426 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:37.332259 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe88dfb2-09e2-4220-99c2-09e82b8c4426 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:37.370985 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7655920e-4086-4d06-88cc-e409f4861cb3 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:37.410035 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9f5bad-fa17-45a6-825e-73d354e0b0b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:37.411041 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9f5bad-fa17-45a6-825e-73d354e0b0b4 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:37.411514 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9f5bad-fa17-45a6-825e-73d354e0b0b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:37.411968 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9f5bad-fa17-45a6-825e-73d354e0b0b4 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:37.412917 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9f5bad-fa17-45a6-825e-73d354e0b0b4 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:37.414686 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9f5bad-fa17-45a6-825e-73d354e0b0b4 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:37.425939 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-3c9f5bad-fa17-45a6-825e-73d354e0b0b4 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 19 10:14:37.425939 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:14:37.425939 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 10:14:37.425939 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 10:14:37.425939 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 10:14:37.425939 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 10:14:37.425939 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 10:14:37.425939 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 10:14:37.425939 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 19 10:14:37.425939 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Sep 19 10:14:37.425939 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 10:14:37.425939 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Sep 19 10:14:37.425939 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:14:37.425939 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:14:37.425939 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:14:37.425939 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:14:37.425939 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:14:37.427064 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:14:37.427064 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:14:37.427064 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:14:37.427064 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:14:37.427064 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:14:37.427064 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:14:37.427064 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 10:14:37.427064 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 10:14:37.427064 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 10:14:37.427064 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 10:14:37.427064 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:14:37.427064 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:14:37.427064 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:14:37.427064 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:14:37.427064 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:14:37.427064 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:14:37.427927 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:14:37.427927 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Sep 19 10:14:37.427927 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:14:37.427927 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:14:37.427927 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:14:37.427927 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:14:37.427927 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:14:37.427927 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:14:37.427927 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:14:37.427927 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:14:37.427927 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 10:14:37.427927 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 10:14:37.427927 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 19 10:14:37.427927 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Sep 19 10:14:37.430954 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe88dfb2-09e2-4220-99c2-09e82b8c4426 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:37.431160 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 478/971] 10.222.0.66 () {56 vars in 1126 bytes} [Mon Sep 19 10:14:37 2022] GET /identity/v3/services/object-store => generated 93 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 10:14:37.433709 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe88dfb2-09e2-4220-99c2-09e82b8c4426 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:37.437987 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9f5bad-fa17-45a6-825e-73d354e0b0b4 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:37.484071 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:37.508707 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:37.552656 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 494/972] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Sep 19 10:14:37 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 19 10:14:37.554143 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe88dfb2-09e2-4220-99c2-09e82b8c4426 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:37.570820 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9f5bad-fa17-45a6-825e-73d354e0b0b4 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:37.608007 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7356234-add3-4748-808c-30a67ae9e55b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:37.608831 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7356234-add3-4748-808c-30a67ae9e55b None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:37.609208 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7356234-add3-4748-808c-30a67ae9e55b None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:37.609576 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7356234-add3-4748-808c-30a67ae9e55b None admin] PATH_INFO: `/v3/services` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:37.610303 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7356234-add3-4748-808c-30a67ae9e55b None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:14:37.610703 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7356234-add3-4748-808c-30a67ae9e55b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:37.612898 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7356234-add3-4748-808c-30a67ae9e55b None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:37.623565 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 479/973] 10.222.0.66 () {56 vars in 1122 bytes} [Mon Sep 19 10:14:37 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 10:14:37.624940 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7356234-add3-4748-808c-30a67ae9e55b None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:37.659768 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe88dfb2-09e2-4220-99c2-09e82b8c4426 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:37.700574 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3709c86-5c2c-47f7-bec9-f1e5dfa44927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:37.701438 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3709c86-5c2c-47f7-bec9-f1e5dfa44927 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:37.701939 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3709c86-5c2c-47f7-bec9-f1e5dfa44927 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:37.702453 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3709c86-5c2c-47f7-bec9-f1e5dfa44927 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:37.714347 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3709c86-5c2c-47f7-bec9-f1e5dfa44927 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:37.716264 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3709c86-5c2c-47f7-bec9-f1e5dfa44927 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:37.733148 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-a3709c86-5c2c-47f7-bec9-f1e5dfa44927 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 10:14:37.733148 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:14:37.733148 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:14:37.733148 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:14:37.733148 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:14:37.733148 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:14:37.733148 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:14:37.733148 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:14:37.733148 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:14:37.733148 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:14:37.733148 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:14:37.733148 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:14:37.733148 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 10:14:37.733148 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 10:14:37.733148 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 10:14:37.733148 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 10:14:37.734214 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:14:37.734214 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:14:37.734214 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:14:37.734214 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:14:37.734214 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:14:37.734214 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:14:37.734214 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:14:37.734214 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 19 10:14:37.734214 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:14:37.734214 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:14:37.734214 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:14:37.734214 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:14:37.734214 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:14:37.734214 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:14:37.734214 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:14:37.734214 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:14:37.734214 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 10:14:37.735085 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 10:14:37.735085 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 10:14:37.735085 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 19 10:14:37.741573 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:37.741892 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 495/974] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 19 10:14:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 10:14:37.743121 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3709c86-5c2c-47f7-bec9-f1e5dfa44927 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:37.743358 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7356234-add3-4748-808c-30a67ae9e55b None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:37.769459 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:37.785433 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73edf07-bbf3-419f-a163-7523a6252a83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:37.786099 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73edf07-bbf3-419f-a163-7523a6252a83 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:37.786381 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73edf07-bbf3-419f-a163-7523a6252a83 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:37.786656 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73edf07-bbf3-419f-a163-7523a6252a83 None admin] PATH_INFO: `/v3/services` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:37.787373 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73edf07-bbf3-419f-a163-7523a6252a83 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:14:37.787949 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73edf07-bbf3-419f-a163-7523a6252a83 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:37.789603 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73edf07-bbf3-419f-a163-7523a6252a83 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:37.800912 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 480/975] 10.222.0.66 () {56 vars in 1122 bytes} [Mon Sep 19 10:14:37 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:14:37.802527 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73edf07-bbf3-419f-a163-7523a6252a83 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:37.857777 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3709c86-5c2c-47f7-bec9-f1e5dfa44927 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:37.893421 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa65738b-0356-409d-9f86-54d27fccb09f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:37.894876 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa65738b-0356-409d-9f86-54d27fccb09f None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:37.895381 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa65738b-0356-409d-9f86-54d27fccb09f None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:37.895835 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa65738b-0356-409d-9f86-54d27fccb09f None admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:37.896815 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa65738b-0356-409d-9f86-54d27fccb09f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:14:37.897463 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa65738b-0356-409d-9f86-54d27fccb09f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:37.899073 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa65738b-0356-409d-9f86-54d27fccb09f None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:37.911896 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 496/976] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Sep 19 10:14:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:14:37.920379 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73edf07-bbf3-419f-a163-7523a6252a83 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:37.922369 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa65738b-0356-409d-9f86-54d27fccb09f None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:37.955949 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b57bd6-ec75-4e8e-bc21-5214deaf4751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:37.957153 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b57bd6-ec75-4e8e-bc21-5214deaf4751 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:37.957433 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b57bd6-ec75-4e8e-bc21-5214deaf4751 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:37.957709 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b57bd6-ec75-4e8e-bc21-5214deaf4751 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:37.958417 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b57bd6-ec75-4e8e-bc21-5214deaf4751 None admin] RBAC: Adding query filter params (interface=admin, service_id=83453e3220bd445891b8080ce5c4e7f2, region_id=RegionOne) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:14:37.958728 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b57bd6-ec75-4e8e-bc21-5214deaf4751 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:37.960105 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b57bd6-ec75-4e8e-bc21-5214deaf4751 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:37.968615 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 481/977] 10.222.0.66 () {56 vars in 1249 bytes} [Mon Sep 19 10:14:37 2022] GET /identity/v3/endpoints?service_id=83453e3220bd445891b8080ce5c4e7f2&interface=admin®ion_id=RegionOne => generated 193 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 10:14:37.968615 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb09000d-74d3-442f-84ef-8ab3f017b0c4 None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:37.968615 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb09000d-74d3-442f-84ef-8ab3f017b0c4 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:37.968615 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb09000d-74d3-442f-84ef-8ab3f017b0c4 None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:37.968615 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 482/978] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:14:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:14:37.971959 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb09000d-74d3-442f-84ef-8ab3f017b0c4 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:38.001119 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:38.016101 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:38.036138 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa65738b-0356-409d-9f86-54d27fccb09f None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:38.078822 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fe34e6-d1bc-4c34-82cb-d734794d5b94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:38.079423 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fe34e6-d1bc-4c34-82cb-d734794d5b94 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:38.079707 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fe34e6-d1bc-4c34-82cb-d734794d5b94 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:38.079981 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fe34e6-d1bc-4c34-82cb-d734794d5b94 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:38.084882 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb09000d-74d3-442f-84ef-8ab3f017b0c4 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:38.087969 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fe34e6-d1bc-4c34-82cb-d734794d5b94 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:38.089677 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fe34e6-d1bc-4c34-82cb-d734794d5b94 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:38.101516 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-55fe34e6-d1bc-4c34-82cb-d734794d5b94 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 10:14:38.101516 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:14:38.101516 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:14:38.101516 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:14:38.101516 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:14:38.101516 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:14:38.101516 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:14:38.101516 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:14:38.101516 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:14:38.101516 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:14:38.101516 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:14:38.101516 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:14:38.101516 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 10:14:38.101516 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 10:14:38.101516 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 10:14:38.102610 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 10:14:38.102610 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:14:38.102610 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:14:38.102610 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:14:38.102610 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:14:38.102610 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:14:38.102610 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:14:38.102610 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:14:38.102610 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 19 10:14:38.102610 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:14:38.102610 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:14:38.102610 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:14:38.102610 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:14:38.102610 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:14:38.102610 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:14:38.102610 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:14:38.102610 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:14:38.108370 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 10:14:38.108370 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 10:14:38.108370 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 10:14:38.108370 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 10:14:38.108370 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 10:14:38.108370 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 10:14:38.108370 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 10:14:38.108370 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 19 10:14:38.108370 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 497/979] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Sep 19 10:14:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 10:14:38.108370 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5b575d-fea2-49b7-867f-98eddfb0450f None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:38.108370 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5b575d-fea2-49b7-867f-98eddfb0450f None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:38.109125 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5b575d-fea2-49b7-867f-98eddfb0450f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:38.123412 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-4d5b575d-fea2-49b7-867f-98eddfb0450f None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:14:38.124981 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-4d5b575d-fea2-49b7-867f-98eddfb0450f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:14:38.131195 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0140075b-dd45-4c07-8a5e-c9ac04bb72c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:38.131811 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0140075b-dd45-4c07-8a5e-c9ac04bb72c0 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:38.132089 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0140075b-dd45-4c07-8a5e-c9ac04bb72c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:38.132407 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0140075b-dd45-4c07-8a5e-c9ac04bb72c0 None admin] PATH_INFO: `/v3/services` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:38.133016 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0140075b-dd45-4c07-8a5e-c9ac04bb72c0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:38.134448 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0140075b-dd45-4c07-8a5e-c9ac04bb72c0 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:38.141081 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 483/980] 10.222.0.66 () {56 vars in 1087 bytes} [Mon Sep 19 10:14:37 2022] GET /identity/v3/services => generated 1497 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 10:14:38.142348 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0140075b-dd45-4c07-8a5e-c9ac04bb72c0 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:38.213533 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 498/981] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:14:38 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 10:14:38.268877 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:38.279849 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0140075b-dd45-4c07-8a5e-c9ac04bb72c0 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:38.324053 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f737301-7354-4834-88c2-cc742345fb14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:38.324529 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f737301-7354-4834-88c2-cc742345fb14 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:38.325460 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f737301-7354-4834-88c2-cc742345fb14 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:38.325460 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f737301-7354-4834-88c2-cc742345fb14 None admin] PATH_INFO: `/v3/projects` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:38.325821 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f737301-7354-4834-88c2-cc742345fb14 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:14:38.327191 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f737301-7354-4834-88c2-cc742345fb14 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:38.327569 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f737301-7354-4834-88c2-cc742345fb14 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:38.341302 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 484/982] 10.222.0.66 () {56 vars in 1148 bytes} [Mon Sep 19 10:14:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:14:38.347996 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5b575d-fea2-49b7-867f-98eddfb0450f None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:38.424095 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:38.456613 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5b575d-fea2-49b7-867f-98eddfb0450f None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:38.493255 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5f763d-ebae-4ead-a06d-ef050389b1bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:38.494231 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5f763d-ebae-4ead-a06d-ef050389b1bf None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:38.494716 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5f763d-ebae-4ead-a06d-ef050389b1bf None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:38.495207 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5f763d-ebae-4ead-a06d-ef050389b1bf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:38.496139 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5f763d-ebae-4ead-a06d-ef050389b1bf None admin] RBAC: Adding query filter params (role.id=89dc9467e2a84e2e9602562960b6668f, scope.project.id=be6b93ef3359434d9c776343f0aea333, user.id=e4d1160b71a84e2fa44a8ca6edf1846e) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:14:38.496669 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5f763d-ebae-4ead-a06d-ef050389b1bf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:38.498323 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5f763d-ebae-4ead-a06d-ef050389b1bf None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:38.504506 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f737301-7354-4834-88c2-cc742345fb14 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:38.506371 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 499/983] 10.222.0.66 () {56 vars in 1374 bytes} [Mon Sep 19 10:14:38 2022] GET /identity/v3/role_assignments?user.id=e4d1160b71a84e2fa44a8ca6edf1846e&scope.project.id=be6b93ef3359434d9c776343f0aea333&role.id=89dc9467e2a84e2e9602562960b6668f => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 10:14:38.630828 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f737301-7354-4834-88c2-cc742345fb14 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:38.680654 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f0a4c8-11d5-4761-8c61-d7ba3e6eabcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:38.681746 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f0a4c8-11d5-4761-8c61-d7ba3e6eabcd None admin] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:38.682237 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f0a4c8-11d5-4761-8c61-d7ba3e6eabcd None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:38.682712 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f0a4c8-11d5-4761-8c61-d7ba3e6eabcd None admin] PATH_INFO: `/v3/services` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:38.683602 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f0a4c8-11d5-4761-8c61-d7ba3e6eabcd None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:38.685746 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f0a4c8-11d5-4761-8c61-d7ba3e6eabcd None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:38.706611 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 485/984] 10.222.0.66 () {60 vars in 1141 bytes} [Mon Sep 19 10:14:38 2022] POST /identity/v3/services => generated 242 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:14:38.760758 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e6ccbd-c2da-4f96-8318-e8212ae2c779 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:38.760952 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e6ccbd-c2da-4f96-8318-e8212ae2c779 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:38.761231 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e6ccbd-c2da-4f96-8318-e8212ae2c779 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:38.762923 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 500/985] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:14:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:14:38.768971 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502d7fa6-b58d-4b07-a36a-ebcac6018cd6 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:38.769286 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502d7fa6-b58d-4b07-a36a-ebcac6018cd6 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:38.769542 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502d7fa6-b58d-4b07-a36a-ebcac6018cd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:38.791499 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-502d7fa6-b58d-4b07-a36a-ebcac6018cd6 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:14:38.792838 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-502d7fa6-b58d-4b07-a36a-ebcac6018cd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:14:38.803470 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:38.883821 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 486/986] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:14:38 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 10:14:39.158554 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e6ccbd-c2da-4f96-8318-e8212ae2c779 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:39.264424 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e6ccbd-c2da-4f96-8318-e8212ae2c779 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:39.302382 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acde132-4c15-4f91-869a-521a796b76a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:39.303384 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acde132-4c15-4f91-869a-521a796b76a9 None admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:39.303873 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acde132-4c15-4f91-869a-521a796b76a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:39.304376 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acde132-4c15-4f91-869a-521a796b76a9 None admin] PATH_INFO: `/v3/users` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:39.305226 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acde132-4c15-4f91-869a-521a796b76a9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:39.306846 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acde132-4c15-4f91-869a-521a796b76a9 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:39.309596 dv-cinder-858275-1-smb devstack@keystone.service[81351]: WARNING keystone.server.flask.common [None req-2acde132-4c15-4f91-869a-521a796b76a9 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 19 10:14:39.318865 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:39.326328 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.sql.core [None req-2acde132-4c15-4f91-869a-521a796b76a9 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 19 10:14:39.326328 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 19 10:14:39.326328 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [parameters: {'user_id': '637494cac6a7466b9b1f4aea17978dfd', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 19 10:14:39.326328 dv-cinder-858275-1-smb devstack@keystone.service[81351]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81351) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 19 10:14:39.335371 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-2acde132-4c15-4f91-869a-521a796b76a9 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 19 10:14:39.335371 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:14:39.335371 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 19 10:14:39.335371 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 19 10:14:39.335371 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 19 10:14:39.335371 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 19 10:14:39.335371 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 19 10:14:39.335371 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application result = self._query(query) Sep 19 10:14:39.335371 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 19 10:14:39.335371 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application conn.query(q) Sep 19 10:14:39.335371 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 19 10:14:39.335371 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 19 10:14:39.335371 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 19 10:14:39.335371 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application result.read() Sep 19 10:14:39.335371 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 19 10:14:39.336303 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 19 10:14:39.336303 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 19 10:14:39.336303 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 19 10:14:39.336303 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 19 10:14:39.336303 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 19 10:14:39.336303 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 19 10:14:39.336303 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 19 10:14:39.336303 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 19 10:14:39.336303 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 19 10:14:39.336303 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 19 10:14:39.336303 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 19 10:14:39.336303 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:14:39.336303 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 19 10:14:39.336303 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 19 10:14:39.336303 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Sep 19 10:14:39.336303 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Sep 19 10:14:39.336303 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 19 10:14:39.336303 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application next(self.gen) Sep 19 10:14:39.337259 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 19 10:14:39.337259 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application yield resource Sep 19 10:14:39.337259 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 19 10:14:39.337259 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application next(self.gen) Sep 19 10:14:39.337259 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 19 10:14:39.337259 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application self.session.rollback() Sep 19 10:14:39.337259 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 19 10:14:39.337259 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application self.force_reraise() Sep 19 10:14:39.337259 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 19 10:14:39.337259 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise self.value Sep 19 10:14:39.337259 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 19 10:14:39.337259 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 19 10:14:39.337259 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 19 10:14:39.337259 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application session.commit() Sep 19 10:14:39.337259 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 19 10:14:39.337259 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 19 10:14:39.337259 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 19 10:14:39.338129 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application self._prepare_impl() Sep 19 10:14:39.338129 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 19 10:14:39.338129 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application self.session.flush() Sep 19 10:14:39.338129 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 19 10:14:39.338129 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application self._flush(objects) Sep 19 10:14:39.338129 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 19 10:14:39.338129 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 19 10:14:39.338129 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 19 10:14:39.338129 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application compat.raise_( Sep 19 10:14:39.338129 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 19 10:14:39.338129 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception Sep 19 10:14:39.338129 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 19 10:14:39.338129 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application flush_context.execute() Sep 19 10:14:39.338129 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 19 10:14:39.338129 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rec.execute(self) Sep 19 10:14:39.338129 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 19 10:14:39.338129 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 19 10:14:39.338983 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 19 10:14:39.338983 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 19 10:14:39.338983 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 19 10:14:39.338983 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application result = connection._execute_20( Sep 19 10:14:39.338983 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 19 10:14:39.338983 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 19 10:14:39.338983 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 19 10:14:39.338983 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 19 10:14:39.338983 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 19 10:14:39.338983 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 19 10:14:39.338983 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 19 10:14:39.338983 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 19 10:14:39.338983 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 19 10:14:39.338983 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 19 10:14:39.338983 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 19 10:14:39.338983 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception Sep 19 10:14:39.339803 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 19 10:14:39.339803 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 19 10:14:39.339803 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 19 10:14:39.339803 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 19 10:14:39.339803 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 19 10:14:39.339803 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application result = self._query(query) Sep 19 10:14:39.339803 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 19 10:14:39.339803 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application conn.query(q) Sep 19 10:14:39.339803 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 19 10:14:39.339803 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 19 10:14:39.339803 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 19 10:14:39.339803 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application result.read() Sep 19 10:14:39.339803 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 19 10:14:39.339803 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 19 10:14:39.339803 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 19 10:14:39.339803 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 19 10:14:39.342194 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 19 10:14:39.342194 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 19 10:14:39.342194 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 19 10:14:39.342194 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 19 10:14:39.342194 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 19 10:14:39.342194 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 19 10:14:39.342194 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [parameters: {'user_id': '637494cac6a7466b9b1f4aea17978dfd', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 19 10:14:39.342194 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 19 10:14:39.342194 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 19 10:14:39.342194 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 10:14:39.342194 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 19 10:14:39.342194 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:14:39.342194 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:14:39.342194 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:14:39.342194 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:14:39.344042 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:14:39.344042 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:14:39.344042 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:14:39.344042 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:14:39.344042 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:14:39.344042 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:14:39.344042 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:14:39.344042 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Sep 19 10:14:39.344042 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Sep 19 10:14:39.344042 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:14:39.344042 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:14:39.344042 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 10:14:39.344042 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 10:14:39.344042 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 10:14:39.344042 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 10:14:39.344042 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Sep 19 10:14:39.344042 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Sep 19 10:14:39.346234 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Sep 19 10:14:39.346234 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Sep 19 10:14:39.346234 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 19 10:14:39.346234 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 19 10:14:39.346234 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 19 10:14:39.346234 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 19 10:14:39.349354 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 501/987] 10.222.0.66 () {60 vars in 1131 bytes} [Mon Sep 19 10:14:39 2022] POST /identity/v3/users => generated 160 bytes in 191 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:14:39.356250 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502d7fa6-b58d-4b07-a36a-ebcac6018cd6 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:39.470441 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502d7fa6-b58d-4b07-a36a-ebcac6018cd6 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:39.508680 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d8ba9f-f05e-472f-982d-fe11284fcff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:39.509630 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d8ba9f-f05e-472f-982d-fe11284fcff7 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:39.510125 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d8ba9f-f05e-472f-982d-fe11284fcff7 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:39.510598 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d8ba9f-f05e-472f-982d-fe11284fcff7 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:39.519358 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d8ba9f-f05e-472f-982d-fe11284fcff7 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:39.521233 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d8ba9f-f05e-472f-982d-fe11284fcff7 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:39.523609 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:39.536345 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-e9d8ba9f-f05e-472f-982d-fe11284fcff7 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 19 10:14:39.536345 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:14:39.536345 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:14:39.536345 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:14:39.536345 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:14:39.536345 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:14:39.536345 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:14:39.536345 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:14:39.536345 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:14:39.536345 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:14:39.536345 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:14:39.536345 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:14:39.536345 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 10:14:39.536345 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 10:14:39.536345 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 10:14:39.536345 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 10:14:39.537477 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:14:39.537477 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:14:39.537477 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 10:14:39.537477 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 10:14:39.537477 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 10:14:39.537477 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 10:14:39.537477 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:14:39.537477 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:14:39.537477 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:14:39.537477 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:14:39.537477 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:14:39.537477 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Sep 19 10:14:39.537477 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:14:39.537477 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:14:39.537477 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:14:39.537477 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:14:39.537477 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:14:39.537477 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:14:39.538416 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:14:39.538416 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:14:39.538416 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 10:14:39.538416 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 10:14:39.538416 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 10:14:39.538416 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 10:14:39.538416 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 10:14:39.538416 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 10:14:39.538416 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 19 10:14:39.538416 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Sep 19 10:14:39.540708 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 487/988] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Sep 19 10:14:39 2022] GET /identity/v3/users/cinder => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:14:39.547208 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acde132-4c15-4f91-869a-521a796b76a9 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:39.652275 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acde132-4c15-4f91-869a-521a796b76a9 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:39.696564 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc22c02-bb40-41f1-af7a-951b98f952bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:39.697620 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc22c02-bb40-41f1-af7a-951b98f952bc None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:39.698102 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc22c02-bb40-41f1-af7a-951b98f952bc None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:39.698578 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc22c02-bb40-41f1-af7a-951b98f952bc None admin] PATH_INFO: `/v3/users` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:39.699492 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc22c02-bb40-41f1-af7a-951b98f952bc None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:14:39.700008 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc22c02-bb40-41f1-af7a-951b98f952bc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:39.701888 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc22c02-bb40-41f1-af7a-951b98f952bc None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:39.740398 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 502/989] 10.222.0.66 () {56 vars in 1101 bytes} [Mon Sep 19 10:14:39 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:14:40.443854 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512bb320-3e86-4e52-ab79-1e11f3b080d8 None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:40.444444 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512bb320-3e86-4e52-ab79-1e11f3b080d8 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:40.444444 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512bb320-3e86-4e52-ab79-1e11f3b080d8 None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:40.446024 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 488/990] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:14:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:14:40.451591 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd422e66-f1ee-45e5-b456-fa39e0eb3471 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:40.452249 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd422e66-f1ee-45e5-b456-fa39e0eb3471 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:40.452249 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd422e66-f1ee-45e5-b456-fa39e0eb3471 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:40.470914 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-bd422e66-f1ee-45e5-b456-fa39e0eb3471 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:14:40.473050 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-bd422e66-f1ee-45e5-b456-fa39e0eb3471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:14:40.525052 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:40.543416 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 503/991] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:14:40 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 10:14:40.814463 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2409ce-6236-4846-972d-f08a91337e6c None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:40.814865 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2409ce-6236-4846-972d-f08a91337e6c None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:40.814972 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd422e66-f1ee-45e5-b456-fa39e0eb3471 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:40.815054 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2409ce-6236-4846-972d-f08a91337e6c None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:40.816930 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 489/992] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:14:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:14:40.821919 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a4b521-1f23-48da-a380-9c127f35a7c2 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:40.822207 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a4b521-1f23-48da-a380-9c127f35a7c2 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:40.822485 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a4b521-1f23-48da-a380-9c127f35a7c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:40.840862 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-60a4b521-1f23-48da-a380-9c127f35a7c2 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:14:40.842043 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-60a4b521-1f23-48da-a380-9c127f35a7c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:14:40.928305 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 490/993] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:14:40 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 10:14:40.932411 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd422e66-f1ee-45e5-b456-fa39e0eb3471 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:40.968623 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd811fb-0594-4255-a80e-c59bd8025a52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:40.969601 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd811fb-0594-4255-a80e-c59bd8025a52 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:40.970109 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd811fb-0594-4255-a80e-c59bd8025a52 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:40.970597 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd811fb-0594-4255-a80e-c59bd8025a52 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:40.971449 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd811fb-0594-4255-a80e-c59bd8025a52 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:40.973064 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd811fb-0594-4255-a80e-c59bd8025a52 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:40.982442 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-ccd811fb-0594-4255-a80e-c59bd8025a52 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 19 10:14:40.982442 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:14:40.982442 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 10:14:40.982442 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 10:14:40.982442 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 10:14:40.982442 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 10:14:40.982442 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 10:14:40.982442 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 10:14:40.982442 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 19 10:14:40.982442 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 19 10:14:40.982442 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 10:14:40.982442 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 19 10:14:40.982442 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:14:40.982442 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:14:40.982442 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:14:40.982442 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:14:40.982442 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:14:40.983490 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:14:40.983490 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:14:40.983490 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:14:40.983490 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:14:40.983490 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:14:40.983490 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:14:40.983490 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 10:14:40.983490 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 10:14:40.983490 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 10:14:40.983490 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 10:14:40.983490 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:14:40.983490 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:14:40.983490 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:14:40.983490 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:14:40.983490 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:14:40.983490 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:14:40.984352 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:14:40.984352 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 19 10:14:40.984352 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:14:40.984352 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:14:40.984352 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:14:40.984352 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:14:40.984352 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:14:40.984352 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:14:40.984352 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:14:40.984352 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:14:40.984352 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 10:14:40.984352 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 10:14:40.984352 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 19 10:14:40.984352 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 19 10:14:40.985617 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210df25a-28fa-433d-9b1f-f19bfbc24ac8 None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:40.985617 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210df25a-28fa-433d-9b1f-f19bfbc24ac8 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:40.985617 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210df25a-28fa-433d-9b1f-f19bfbc24ac8 None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:40.985970 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 491/994] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:14:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 10:14:40.989138 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 504/995] 10.222.0.66 () {56 vars in 1126 bytes} [Mon Sep 19 10:14:40 2022] GET /identity/v3/services/object-store => generated 93 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 10:14:40.990941 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e876776-6d7a-4450-a21d-58098c42cf8b None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:40.991226 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e876776-6d7a-4450-a21d-58098c42cf8b None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:40.991499 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e876776-6d7a-4450-a21d-58098c42cf8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:40.992800 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210df25a-28fa-433d-9b1f-f19bfbc24ac8 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:41.012349 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-4e876776-6d7a-4450-a21d-58098c42cf8b None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:14:41.013549 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-4e876776-6d7a-4450-a21d-58098c42cf8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:14:41.062347 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:41.089231 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 505/996] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:14:40 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 10:14:41.103462 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210df25a-28fa-433d-9b1f-f19bfbc24ac8 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:41.131111 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:41.139534 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159317b5-52f8-433a-be33-96856d840481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:41.140137 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159317b5-52f8-433a-be33-96856d840481 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:41.140451 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159317b5-52f8-433a-be33-96856d840481 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:41.140716 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159317b5-52f8-433a-be33-96856d840481 None admin] PATH_INFO: `/v3/services` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:41.141331 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159317b5-52f8-433a-be33-96856d840481 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:14:41.141625 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159317b5-52f8-433a-be33-96856d840481 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:41.142987 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159317b5-52f8-433a-be33-96856d840481 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:41.152257 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 492/997] 10.222.0.66 () {56 vars in 1122 bytes} [Mon Sep 19 10:14:40 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:14:41.154564 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e876776-6d7a-4450-a21d-58098c42cf8b None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:41.198051 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159317b5-52f8-433a-be33-96856d840481 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:41.262897 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e876776-6d7a-4450-a21d-58098c42cf8b None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:41.297181 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e071ddff-b265-40bf-8cc8-ff79f3da090e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:41.297796 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e071ddff-b265-40bf-8cc8-ff79f3da090e None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:41.298073 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e071ddff-b265-40bf-8cc8-ff79f3da090e None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:41.298351 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e071ddff-b265-40bf-8cc8-ff79f3da090e None admin] PATH_INFO: `/v3/services` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:41.299022 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e071ddff-b265-40bf-8cc8-ff79f3da090e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:14:41.299340 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e071ddff-b265-40bf-8cc8-ff79f3da090e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:41.301262 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e071ddff-b265-40bf-8cc8-ff79f3da090e None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:41.306682 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 506/998] 10.222.0.66 () {56 vars in 1122 bytes} [Mon Sep 19 10:14:41 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:14:41.308477 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159317b5-52f8-433a-be33-96856d840481 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:41.312069 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e071ddff-b265-40bf-8cc8-ff79f3da090e None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:41.347342 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0839056a-aa0b-4ac1-b5a3-f508ebcc5522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:41.347886 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0839056a-aa0b-4ac1-b5a3-f508ebcc5522 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:41.348197 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0839056a-aa0b-4ac1-b5a3-f508ebcc5522 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:41.348478 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0839056a-aa0b-4ac1-b5a3-f508ebcc5522 None admin] PATH_INFO: `/v3/services/image` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:41.349029 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0839056a-aa0b-4ac1-b5a3-f508ebcc5522 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:41.350403 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0839056a-aa0b-4ac1-b5a3-f508ebcc5522 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:41.359369 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-0839056a-aa0b-4ac1-b5a3-f508ebcc5522 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 19 10:14:41.359369 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:14:41.359369 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 10:14:41.359369 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 10:14:41.359369 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 10:14:41.359369 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 10:14:41.359369 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 10:14:41.359369 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 10:14:41.359369 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 19 10:14:41.359369 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Sep 19 10:14:41.359369 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 10:14:41.359369 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Sep 19 10:14:41.359369 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:14:41.359369 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:14:41.359369 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:14:41.359369 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:14:41.359369 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:14:41.360829 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:14:41.360829 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:14:41.360829 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:14:41.360829 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:14:41.360829 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:14:41.360829 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:14:41.360829 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 10:14:41.360829 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 10:14:41.360829 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 10:14:41.360829 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 10:14:41.360829 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:14:41.360829 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:14:41.360829 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:14:41.360829 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:14:41.360829 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:14:41.360829 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:14:41.361951 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:14:41.361951 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Sep 19 10:14:41.361951 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:14:41.361951 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:14:41.361951 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:14:41.361951 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:14:41.361951 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:14:41.361951 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:14:41.361951 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:14:41.361951 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:14:41.361951 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 10:14:41.361951 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 10:14:41.361951 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 19 10:14:41.361951 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Sep 19 10:14:41.361951 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 493/999] 10.222.0.66 () {56 vars in 1105 bytes} [Mon Sep 19 10:14:41 2022] GET /identity/v3/services/image => generated 86 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 10:14:41.362798 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0839056a-aa0b-4ac1-b5a3-f508ebcc5522 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:41.364446 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:41.416589 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:41.421433 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e071ddff-b265-40bf-8cc8-ff79f3da090e None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:41.457877 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a4bd44-9a88-406d-bc35-20d3040dd358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:41.458542 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a4bd44-9a88-406d-bc35-20d3040dd358 None admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:41.458835 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a4bd44-9a88-406d-bc35-20d3040dd358 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:41.459112 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a4bd44-9a88-406d-bc35-20d3040dd358 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:41.459769 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a4bd44-9a88-406d-bc35-20d3040dd358 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:41.461180 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a4bd44-9a88-406d-bc35-20d3040dd358 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:41.461399 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0839056a-aa0b-4ac1-b5a3-f508ebcc5522 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:41.479963 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 507/1000] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 19 10:14:41 2022] POST /identity/v3/endpoints => generated 325 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 10:14:41.481026 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a4bd44-9a88-406d-bc35-20d3040dd358 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:41.514819 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9b0827-1d65-4bc4-8f8d-d135d18c0c01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:41.515750 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9b0827-1d65-4bc4-8f8d-d135d18c0c01 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:41.516036 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9b0827-1d65-4bc4-8f8d-d135d18c0c01 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:41.516436 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9b0827-1d65-4bc4-8f8d-d135d18c0c01 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:41.517146 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9b0827-1d65-4bc4-8f8d-d135d18c0c01 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:41.519351 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9b0827-1d65-4bc4-8f8d-d135d18c0c01 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:41.529083 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-7e9b0827-1d65-4bc4-8f8d-d135d18c0c01 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 19 10:14:41.529083 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:14:41.529083 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 10:14:41.529083 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 10:14:41.529083 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 10:14:41.529083 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 10:14:41.529083 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 10:14:41.529083 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 10:14:41.529083 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 19 10:14:41.529083 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Sep 19 10:14:41.529083 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 10:14:41.529083 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Sep 19 10:14:41.529083 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:14:41.529083 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:14:41.529083 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:14:41.529083 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:14:41.529083 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:14:41.532548 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:14:41.532548 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:14:41.532548 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:14:41.532548 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:14:41.532548 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:14:41.532548 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:14:41.532548 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 10:14:41.532548 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 10:14:41.532548 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 10:14:41.532548 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 10:14:41.532548 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:14:41.532548 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:14:41.532548 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:14:41.532548 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:14:41.532548 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:14:41.532548 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:14:41.533634 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:14:41.533634 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Sep 19 10:14:41.533634 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:14:41.533634 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:14:41.533634 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:14:41.533634 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:14:41.533634 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:14:41.533634 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:14:41.533634 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:14:41.533634 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:14:41.533634 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 10:14:41.533634 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 10:14:41.533634 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 19 10:14:41.533634 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Sep 19 10:14:41.533634 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 494/1001] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Sep 19 10:14:41 2022] GET /identity/v3/services/compute => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:14:41.537273 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9b0827-1d65-4bc4-8f8d-d135d18c0c01 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:41.609693 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a4bd44-9a88-406d-bc35-20d3040dd358 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:41.613042 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:41.647075 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9b0827-1d65-4bc4-8f8d-d135d18c0c01 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:41.654351 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0de83b-c344-45a6-9f28-303eba609d0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:41.654985 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0de83b-c344-45a6-9f28-303eba609d0f None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:41.655941 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0de83b-c344-45a6-9f28-303eba609d0f None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:41.655941 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0de83b-c344-45a6-9f28-303eba609d0f None admin] PATH_INFO: `/v3/services` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:41.656220 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0de83b-c344-45a6-9f28-303eba609d0f None admin] RBAC: Adding query filter params (name=image) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:14:41.656537 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0de83b-c344-45a6-9f28-303eba609d0f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:41.657985 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0de83b-c344-45a6-9f28-303eba609d0f None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:41.664365 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 508/1002] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 19 10:14:41 2022] GET /identity/v3/services?name=image => generated 122 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:14:41.665297 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:41.670807 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0de83b-c344-45a6-9f28-303eba609d0f None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:41.697734 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b567c95-0309-4749-980b-34056ae07b6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:41.697734 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b567c95-0309-4749-980b-34056ae07b6a None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:41.697734 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b567c95-0309-4749-980b-34056ae07b6a None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:41.697734 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b567c95-0309-4749-980b-34056ae07b6a None admin] PATH_INFO: `/v3/services` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:41.698196 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b567c95-0309-4749-980b-34056ae07b6a None admin] RBAC: Adding query filter params (name=compute) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:14:41.698404 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b567c95-0309-4749-980b-34056ae07b6a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:41.699874 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b567c95-0309-4749-980b-34056ae07b6a None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:41.705067 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 495/1003] 10.222.0.66 () {56 vars in 1112 bytes} [Mon Sep 19 10:14:41 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 10:14:41.712808 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b567c95-0309-4749-980b-34056ae07b6a None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:41.796537 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0de83b-c344-45a6-9f28-303eba609d0f None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:41.824190 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b567c95-0309-4749-980b-34056ae07b6a None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:41.837868 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d4f807-be04-4e7e-9fe4-b34ffd2fe32e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:41.838485 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d4f807-be04-4e7e-9fe4-b34ffd2fe32e None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:41.839078 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d4f807-be04-4e7e-9fe4-b34ffd2fe32e None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:41.839363 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d4f807-be04-4e7e-9fe4-b34ffd2fe32e None admin] PATH_INFO: `/v3/services` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:41.840516 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d4f807-be04-4e7e-9fe4-b34ffd2fe32e None admin] RBAC: Adding query filter params (type=image) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:14:41.840821 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d4f807-be04-4e7e-9fe4-b34ffd2fe32e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:41.842370 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d4f807-be04-4e7e-9fe4-b34ffd2fe32e None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:41.847770 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 509/1004] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 19 10:14:41 2022] GET /identity/v3/services?type=image => generated 122 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 10:14:41.862167 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3efb8f-133e-470f-9ab7-d34a789e9774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:41.863740 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3efb8f-133e-470f-9ab7-d34a789e9774 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:41.864315 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3efb8f-133e-470f-9ab7-d34a789e9774 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:41.864875 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3efb8f-133e-470f-9ab7-d34a789e9774 None admin] PATH_INFO: `/v3/services` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:41.865757 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3efb8f-133e-470f-9ab7-d34a789e9774 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:14:41.866286 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3efb8f-133e-470f-9ab7-d34a789e9774 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:41.867936 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3efb8f-133e-470f-9ab7-d34a789e9774 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:41.874080 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 496/1005] 10.222.0.66 () {56 vars in 1112 bytes} [Mon Sep 19 10:14:41 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:14:41.880890 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d4f807-be04-4e7e-9fe4-b34ffd2fe32e None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:41.918163 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:42.000325 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d4f807-be04-4e7e-9fe4-b34ffd2fe32e None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:42.040356 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9174c0ab-184a-42e4-8c8f-db9ec09bb85e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:42.041383 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9174c0ab-184a-42e4-8c8f-db9ec09bb85e None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:42.041840 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9174c0ab-184a-42e4-8c8f-db9ec09bb85e None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:42.042262 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9174c0ab-184a-42e4-8c8f-db9ec09bb85e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:42.043122 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9174c0ab-184a-42e4-8c8f-db9ec09bb85e None admin] RBAC: Adding query filter params (interface=public, service_id=7b59e8f05f024c25882f18323d0e1555, region_id=RegionOne) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:14:42.043445 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9174c0ab-184a-42e4-8c8f-db9ec09bb85e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:42.045109 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9174c0ab-184a-42e4-8c8f-db9ec09bb85e None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:42.052025 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 510/1006] 10.222.0.66 () {56 vars in 1251 bytes} [Mon Sep 19 10:14:41 2022] GET /identity/v3/endpoints?service_id=7b59e8f05f024c25882f18323d0e1555&interface=public®ion_id=RegionOne => generated 194 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 10:14:42.058009 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3efb8f-133e-470f-9ab7-d34a789e9774 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:42.112353 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:42.172713 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3efb8f-133e-470f-9ab7-d34a789e9774 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:42.207968 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d705157f-363c-4bcd-8fa1-049b87b3c57a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:42.208615 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d705157f-363c-4bcd-8fa1-049b87b3c57a None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:42.208896 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d705157f-363c-4bcd-8fa1-049b87b3c57a None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:42.209171 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d705157f-363c-4bcd-8fa1-049b87b3c57a None admin] PATH_INFO: `/v3/services` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:42.209782 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d705157f-363c-4bcd-8fa1-049b87b3c57a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:42.211159 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d705157f-363c-4bcd-8fa1-049b87b3c57a None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:42.224236 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 497/1007] 10.222.0.66 () {56 vars in 1087 bytes} [Mon Sep 19 10:14:42 2022] GET /identity/v3/services => generated 1727 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 10:14:43.729433 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d32dd1-0615-41a3-bdfb-30d0cfed7e7a None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:43.730017 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d32dd1-0615-41a3-bdfb-30d0cfed7e7a None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:43.730017 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d32dd1-0615-41a3-bdfb-30d0cfed7e7a None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:43.731547 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 511/1008] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:14:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:14:43.736850 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3082d19a-5fb5-4f77-927b-d9f1d1ab9132 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:43.737929 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3082d19a-5fb5-4f77-927b-d9f1d1ab9132 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:43.737929 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3082d19a-5fb5-4f77-927b-d9f1d1ab9132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:43.758413 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-3082d19a-5fb5-4f77-927b-d9f1d1ab9132 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:14:43.759609 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-3082d19a-5fb5-4f77-927b-d9f1d1ab9132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:14:43.839476 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 498/1009] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:14:43 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 10:14:44.033112 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1febddbb-3b0e-4b6b-b2be-ff5d3ed1d5a2 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:44.033512 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1febddbb-3b0e-4b6b-b2be-ff5d3ed1d5a2 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:44.033693 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1febddbb-3b0e-4b6b-b2be-ff5d3ed1d5a2 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:44.035359 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 512/1010] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:14:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:14:44.040456 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340bc922-0988-453e-a5fa-9c657bce58ec None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:44.040740 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340bc922-0988-453e-a5fa-9c657bce58ec None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:44.041009 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340bc922-0988-453e-a5fa-9c657bce58ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:44.059726 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-340bc922-0988-453e-a5fa-9c657bce58ec None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:14:44.060932 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-340bc922-0988-453e-a5fa-9c657bce58ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:14:44.094911 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:44.115319 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1febddbb-3b0e-4b6b-b2be-ff5d3ed1d5a2 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:44.140096 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 499/1011] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:14:44 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 10:14:44.220628 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:44.229577 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1febddbb-3b0e-4b6b-b2be-ff5d3ed1d5a2 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:44.264630 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404cc05c-e73c-4fc7-8a18-db4282f815b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:44.265268 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404cc05c-e73c-4fc7-8a18-db4282f815b6 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:44.265556 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404cc05c-e73c-4fc7-8a18-db4282f815b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:44.265832 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404cc05c-e73c-4fc7-8a18-db4282f815b6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:44.267058 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404cc05c-e73c-4fc7-8a18-db4282f815b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:44.268643 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404cc05c-e73c-4fc7-8a18-db4282f815b6 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:44.270468 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 513/1012] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 19 10:14:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:14:44.276027 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340bc922-0988-453e-a5fa-9c657bce58ec None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:44.388602 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340bc922-0988-453e-a5fa-9c657bce58ec None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:44.411647 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404cc05c-e73c-4fc7-8a18-db4282f815b6 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:44.429699 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f48f2f-798e-4972-92f6-5867f8c58e0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:44.430830 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f48f2f-798e-4972-92f6-5867f8c58e0c None admin] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:44.431719 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f48f2f-798e-4972-92f6-5867f8c58e0c None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:44.432209 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f48f2f-798e-4972-92f6-5867f8c58e0c None admin] PATH_INFO: `/v3/projects` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:44.433115 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f48f2f-798e-4972-92f6-5867f8c58e0c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:44.434826 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f48f2f-798e-4972-92f6-5867f8c58e0c None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:44.467007 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 500/1013] 10.222.0.66 () {60 vars in 1141 bytes} [Mon Sep 19 10:14:44 2022] POST /identity/v3/projects => generated 311 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:14:44.491390 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721f5c6b-ca3e-4274-9fd9-1c03074da8d7 None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:44.491684 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721f5c6b-ca3e-4274-9fd9-1c03074da8d7 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:44.491966 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721f5c6b-ca3e-4274-9fd9-1c03074da8d7 None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:44.493561 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 501/1014] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:14:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 10:14:44.499572 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f277692-b0de-49b6-87da-e248fb1f5cae None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:44.499899 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f277692-b0de-49b6-87da-e248fb1f5cae None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:44.500110 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f277692-b0de-49b6-87da-e248fb1f5cae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:44.519932 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-3f277692-b0de-49b6-87da-e248fb1f5cae None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:14:44.521378 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-3f277692-b0de-49b6-87da-e248fb1f5cae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:14:44.540724 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404cc05c-e73c-4fc7-8a18-db4282f815b6 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:44.545057 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:44.580719 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24efa0ed-b38b-494e-a553-5603402980c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:44.581346 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24efa0ed-b38b-494e-a553-5603402980c1 None admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:44.581664 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24efa0ed-b38b-494e-a553-5603402980c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:44.581938 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24efa0ed-b38b-494e-a553-5603402980c1 None admin] PATH_INFO: `/v3/services` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:44.582683 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24efa0ed-b38b-494e-a553-5603402980c1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:44.584107 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24efa0ed-b38b-494e-a553-5603402980c1 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:44.601407 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 514/1015] 10.222.0.66 () {60 vars in 1141 bytes} [Mon Sep 19 10:14:44 2022] POST /identity/v3/services => generated 242 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 10:14:44.632421 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 502/1016] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:14:44 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 10:14:44.912058 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24efa0ed-b38b-494e-a553-5603402980c1 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:44.940901 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:45.019235 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24efa0ed-b38b-494e-a553-5603402980c1 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:45.053024 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9049adc-7396-4509-977a-044c801e5b71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:45.053657 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9049adc-7396-4509-977a-044c801e5b71 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:45.053946 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9049adc-7396-4509-977a-044c801e5b71 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:45.054200 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9049adc-7396-4509-977a-044c801e5b71 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:45.054770 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9049adc-7396-4509-977a-044c801e5b71 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:45.056128 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9049adc-7396-4509-977a-044c801e5b71 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:45.064795 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-d9049adc-7396-4509-977a-044c801e5b71 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 19 10:14:45.064795 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:14:45.064795 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 10:14:45.064795 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 10:14:45.064795 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 10:14:45.064795 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 10:14:45.064795 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 10:14:45.064795 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 10:14:45.064795 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 19 10:14:45.064795 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 19 10:14:45.064795 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 10:14:45.064795 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 19 10:14:45.064795 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:14:45.064795 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:14:45.064795 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:14:45.064795 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:14:45.064795 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:14:45.065819 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:14:45.065819 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:14:45.065819 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:14:45.065819 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:14:45.065819 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:14:45.065819 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:14:45.065819 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 10:14:45.065819 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 10:14:45.065819 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 10:14:45.065819 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 10:14:45.065819 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:14:45.065819 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:14:45.065819 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:14:45.065819 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:14:45.065819 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:14:45.065819 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:14:45.066686 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:14:45.066686 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 19 10:14:45.066686 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:14:45.066686 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:14:45.066686 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:14:45.066686 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:14:45.066686 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:14:45.066686 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:14:45.066686 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:14:45.066686 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:14:45.066686 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 10:14:45.066686 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 10:14:45.066686 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 19 10:14:45.066686 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 19 10:14:45.068393 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 515/1017] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Sep 19 10:14:44 2022] GET /identity/v3/services/compute => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:14:45.071832 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f277692-b0de-49b6-87da-e248fb1f5cae None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:45.173627 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f277692-b0de-49b6-87da-e248fb1f5cae None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:45.209039 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a5c2ed-b594-49da-9707-e13c00eab469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:45.209566 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a5c2ed-b594-49da-9707-e13c00eab469 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:45.209842 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a5c2ed-b594-49da-9707-e13c00eab469 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:45.210116 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a5c2ed-b594-49da-9707-e13c00eab469 None admin] PATH_INFO: `/v3/services` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:45.210733 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a5c2ed-b594-49da-9707-e13c00eab469 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:14:45.211029 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a5c2ed-b594-49da-9707-e13c00eab469 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:45.212420 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a5c2ed-b594-49da-9707-e13c00eab469 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:45.217521 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 503/1018] 10.222.0.66 () {56 vars in 1112 bytes} [Mon Sep 19 10:14:45 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:14:45.223530 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9049adc-7396-4509-977a-044c801e5b71 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:45.315589 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:45.329042 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9049adc-7396-4509-977a-044c801e5b71 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:45.364397 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c797feb-89a8-43e7-b9af-1bff6da317aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:45.365064 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c797feb-89a8-43e7-b9af-1bff6da317aa None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:45.365383 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c797feb-89a8-43e7-b9af-1bff6da317aa None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:45.365661 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c797feb-89a8-43e7-b9af-1bff6da317aa None admin] PATH_INFO: `/v3/services` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:45.366291 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c797feb-89a8-43e7-b9af-1bff6da317aa None admin] RBAC: Adding query filter params (type=compute) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:14:45.366592 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c797feb-89a8-43e7-b9af-1bff6da317aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:45.367963 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c797feb-89a8-43e7-b9af-1bff6da317aa None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:45.378083 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 516/1019] 10.222.0.66 () {56 vars in 1112 bytes} [Mon Sep 19 10:14:45 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 10:14:45.379795 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a5c2ed-b594-49da-9707-e13c00eab469 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:45.394222 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:45.492881 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a5c2ed-b594-49da-9707-e13c00eab469 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:45.530136 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa90255-3284-462c-af89-b4ca5fe9a621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:45.530758 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa90255-3284-462c-af89-b4ca5fe9a621 None admin] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:45.531046 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa90255-3284-462c-af89-b4ca5fe9a621 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:45.531321 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa90255-3284-462c-af89-b4ca5fe9a621 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:45.532014 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa90255-3284-462c-af89-b4ca5fe9a621 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:45.533473 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa90255-3284-462c-af89-b4ca5fe9a621 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:45.564198 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 504/1020] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 19 10:14:45 2022] POST /identity/v3/endpoints => generated 334 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:14:46.746860 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d7d194-246e-4cbe-94be-1019dd9c4c7b None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:46.747402 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d7d194-246e-4cbe-94be-1019dd9c4c7b None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:46.747402 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d7d194-246e-4cbe-94be-1019dd9c4c7b None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:46.749000 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 517/1021] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:14:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:14:46.754686 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fd9f33-a29d-4a7f-bd9b-2ca57cb48325 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:46.755099 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fd9f33-a29d-4a7f-bd9b-2ca57cb48325 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:46.755264 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fd9f33-a29d-4a7f-bd9b-2ca57cb48325 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:46.773477 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-e8fd9f33-a29d-4a7f-bd9b-2ca57cb48325 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:14:46.774655 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-e8fd9f33-a29d-4a7f-bd9b-2ca57cb48325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:14:46.839470 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:46.840428 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccca86a-c688-4f55-b925-80c6f987710f None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:46.840767 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccca86a-c688-4f55-b925-80c6f987710f None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:46.841072 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccca86a-c688-4f55-b925-80c6f987710f None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:46.842592 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 518/1022] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:14:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 10:14:46.848063 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2ac406-d522-47d1-993f-1615779fd80f None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:46.848382 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2ac406-d522-47d1-993f-1615779fd80f None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:46.848664 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2ac406-d522-47d1-993f-1615779fd80f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:46.858143 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 505/1023] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:14:46 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 10:14:46.869833 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-6a2ac406-d522-47d1-993f-1615779fd80f None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:14:46.871042 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-6a2ac406-d522-47d1-993f-1615779fd80f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:14:46.943652 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 519/1024] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:14:46 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 10:14:47.132815 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fd9f33-a29d-4a7f-bd9b-2ca57cb48325 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:47.217748 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2ac406-d522-47d1-993f-1615779fd80f None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:47.235708 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fd9f33-a29d-4a7f-bd9b-2ca57cb48325 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:47.271460 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c0729a-d90d-445b-a205-e435e2ba837a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:47.272137 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c0729a-d90d-445b-a205-e435e2ba837a None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:47.272391 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c0729a-d90d-445b-a205-e435e2ba837a None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:47.272651 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c0729a-d90d-445b-a205-e435e2ba837a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:47.273731 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c0729a-d90d-445b-a205-e435e2ba837a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:47.275467 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c0729a-d90d-445b-a205-e435e2ba837a None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:47.281521 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 506/1025] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 19 10:14:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:14:47.282380 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c0729a-d90d-445b-a205-e435e2ba837a None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:47.310014 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:47.331131 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2ac406-d522-47d1-993f-1615779fd80f None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:47.347487 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:47.367769 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc963d2-1f80-4fb7-81ee-0e1fb7a77a84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:47.368470 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc963d2-1f80-4fb7-81ee-0e1fb7a77a84 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:47.368747 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc963d2-1f80-4fb7-81ee-0e1fb7a77a84 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:47.369017 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc963d2-1f80-4fb7-81ee-0e1fb7a77a84 None admin] PATH_INFO: `/v3/services/image` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:47.369597 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc963d2-1f80-4fb7-81ee-0e1fb7a77a84 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:47.370975 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc963d2-1f80-4fb7-81ee-0e1fb7a77a84 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:47.381623 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-3fc963d2-1f80-4fb7-81ee-0e1fb7a77a84 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 19 10:14:47.381623 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:14:47.381623 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 10:14:47.381623 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 10:14:47.381623 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 10:14:47.381623 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 10:14:47.381623 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 10:14:47.381623 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 10:14:47.381623 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 19 10:14:47.381623 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 19 10:14:47.381623 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 10:14:47.381623 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 19 10:14:47.381623 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:14:47.381623 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:14:47.381623 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:14:47.381623 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:14:47.381623 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:14:47.382656 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:14:47.382656 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:14:47.382656 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:14:47.382656 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:14:47.382656 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:14:47.382656 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:14:47.382656 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 10:14:47.382656 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 10:14:47.382656 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 10:14:47.382656 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 10:14:47.382656 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:14:47.382656 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:14:47.382656 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:14:47.382656 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:14:47.382656 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:14:47.382656 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:14:47.383743 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:14:47.383743 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 19 10:14:47.383743 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:14:47.383743 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:14:47.383743 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:14:47.383743 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:14:47.383743 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:14:47.383743 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:14:47.383743 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:14:47.383743 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:14:47.383743 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 10:14:47.383743 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 10:14:47.383743 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 19 10:14:47.383743 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 19 10:14:47.383743 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 520/1026] 10.222.0.66 () {56 vars in 1105 bytes} [Mon Sep 19 10:14:47 2022] GET /identity/v3/services/image => generated 86 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 10:14:47.388821 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc963d2-1f80-4fb7-81ee-0e1fb7a77a84 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:47.396667 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c0729a-d90d-445b-a205-e435e2ba837a None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:47.436306 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426b23b2-1d20-4d83-a09a-3dd97c8238f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:47.437310 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426b23b2-1d20-4d83-a09a-3dd97c8238f2 None admin] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:47.437565 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426b23b2-1d20-4d83-a09a-3dd97c8238f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:47.437836 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426b23b2-1d20-4d83-a09a-3dd97c8238f2 None admin] PATH_INFO: `/v3/users` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:47.438804 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426b23b2-1d20-4d83-a09a-3dd97c8238f2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:47.441132 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426b23b2-1d20-4d83-a09a-3dd97c8238f2 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:47.464218 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 507/1027] 10.222.0.66 () {60 vars in 1132 bytes} [Mon Sep 19 10:14:47 2022] POST /identity/v3/users => generated 285 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:14:47.523337 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc963d2-1f80-4fb7-81ee-0e1fb7a77a84 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:47.561933 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a423084e-9c60-42e5-8c05-32e37a6e74bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:47.562566 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a423084e-9c60-42e5-8c05-32e37a6e74bf None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:47.562907 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a423084e-9c60-42e5-8c05-32e37a6e74bf None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:47.563190 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a423084e-9c60-42e5-8c05-32e37a6e74bf None admin] PATH_INFO: `/v3/services` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:47.563828 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a423084e-9c60-42e5-8c05-32e37a6e74bf None admin] RBAC: Adding query filter params (name=image) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:14:47.564133 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a423084e-9c60-42e5-8c05-32e37a6e74bf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:47.565600 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a423084e-9c60-42e5-8c05-32e37a6e74bf None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:47.575987 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 521/1028] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 19 10:14:47 2022] GET /identity/v3/services?name=image => generated 122 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 10:14:47.577796 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426b23b2-1d20-4d83-a09a-3dd97c8238f2 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:47.694446 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426b23b2-1d20-4d83-a09a-3dd97c8238f2 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:47.711887 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:47.732463 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c46380-e9f5-4490-b07d-1dab7f4ef038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:47.733105 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c46380-e9f5-4490-b07d-1dab7f4ef038 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:47.733393 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c46380-e9f5-4490-b07d-1dab7f4ef038 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:47.733671 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c46380-e9f5-4490-b07d-1dab7f4ef038 None admin] PATH_INFO: `/v3/services` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:47.734326 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c46380-e9f5-4490-b07d-1dab7f4ef038 None admin] RBAC: Adding query filter params (type=image) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:14:47.734641 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c46380-e9f5-4490-b07d-1dab7f4ef038 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:47.736075 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c46380-e9f5-4490-b07d-1dab7f4ef038 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:47.742586 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 508/1029] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 19 10:14:47 2022] GET /identity/v3/services?type=image => generated 350 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:14:47.749098 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a423084e-9c60-42e5-8c05-32e37a6e74bf None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:47.764618 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:47.861246 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70447b6-43a3-473c-8ee8-e922e08407fd None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:47.861816 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70447b6-43a3-473c-8ee8-e922e08407fd None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:47.861901 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70447b6-43a3-473c-8ee8-e922e08407fd None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:47.862901 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a423084e-9c60-42e5-8c05-32e37a6e74bf None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:47.863339 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 509/1030] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:14:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 10:14:47.868118 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee20160d-8732-43e6-9de7-f0f429986a23 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:47.868440 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee20160d-8732-43e6-9de7-f0f429986a23 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:47.869311 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee20160d-8732-43e6-9de7-f0f429986a23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:47.887371 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-ee20160d-8732-43e6-9de7-f0f429986a23 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:14:47.888595 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-ee20160d-8732-43e6-9de7-f0f429986a23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:14:47.898992 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09a4b7c-cb53-4daf-94d4-2d2265958bf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:47.899615 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09a4b7c-cb53-4daf-94d4-2d2265958bf1 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:47.899893 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09a4b7c-cb53-4daf-94d4-2d2265958bf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:47.900185 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09a4b7c-cb53-4daf-94d4-2d2265958bf1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:47.900897 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09a4b7c-cb53-4daf-94d4-2d2265958bf1 None admin] RBAC: Adding query filter params (interface=public, service_id=61277b6ab9ec400ca41b84f2cc80fdb9, region_id=RegionOne) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:14:47.901207 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09a4b7c-cb53-4daf-94d4-2d2265958bf1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:47.902593 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09a4b7c-cb53-4daf-94d4-2d2265958bf1 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:47.907942 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 522/1031] 10.222.0.66 () {56 vars in 1251 bytes} [Mon Sep 19 10:14:47 2022] GET /identity/v3/endpoints?service_id=61277b6ab9ec400ca41b84f2cc80fdb9&interface=public®ion_id=RegionOne => generated 194 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:14:47.913541 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09a4b7c-cb53-4daf-94d4-2d2265958bf1 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:47.970109 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 510/1032] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:14:47 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 10:14:47.989380 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:48.016769 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09a4b7c-cb53-4daf-94d4-2d2265958bf1 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:48.051396 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b227cdc-aab3-44f4-b0cf-a11ba0a9deb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:48.052008 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b227cdc-aab3-44f4-b0cf-a11ba0a9deb2 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:48.052328 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b227cdc-aab3-44f4-b0cf-a11ba0a9deb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:48.052604 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b227cdc-aab3-44f4-b0cf-a11ba0a9deb2 None admin] PATH_INFO: `/v3/services` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:48.053203 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b227cdc-aab3-44f4-b0cf-a11ba0a9deb2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:48.054570 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b227cdc-aab3-44f4-b0cf-a11ba0a9deb2 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:48.068605 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 523/1033] 10.222.0.66 () {56 vars in 1087 bytes} [Mon Sep 19 10:14:47 2022] GET /identity/v3/services => generated 1957 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 10:14:48.242656 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee20160d-8732-43e6-9de7-f0f429986a23 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:48.347258 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee20160d-8732-43e6-9de7-f0f429986a23 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:48.358832 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:48.386750 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796cbeab-a7a7-40c2-b93b-96733175d506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:48.387419 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796cbeab-a7a7-40c2-b93b-96733175d506 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:48.387688 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796cbeab-a7a7-40c2-b93b-96733175d506 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:48.387954 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796cbeab-a7a7-40c2-b93b-96733175d506 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:48.398432 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796cbeab-a7a7-40c2-b93b-96733175d506 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 10:14:48.403280 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-796cbeab-a7a7-40c2-b93b-96733175d506 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 19 10:14:48.403280 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:14:48.403280 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:14:48.403280 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:14:48.403280 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:14:48.403280 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:14:48.403280 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:14:48.403280 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:14:48.403280 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:14:48.403280 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:14:48.403280 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:14:48.403280 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:14:48.403280 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 10:14:48.403280 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 10:14:48.403280 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 10:14:48.403280 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 10:14:48.404379 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 10:14:48.404379 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 10:14:48.404379 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 10:14:48.404379 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 10:14:48.404379 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:14:48.404379 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:14:48.404379 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:14:48.404379 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:14:48.404379 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:14:48.404379 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:14:48.404379 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:14:48.404379 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Sep 19 10:14:48.404379 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:14:48.404379 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:14:48.404379 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:14:48.404379 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:14:48.405397 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:14:48.405397 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:14:48.405397 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:14:48.405397 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:14:48.405397 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 10:14:48.405397 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 10:14:48.405397 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 10:14:48.405397 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 10:14:48.405397 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 10:14:48.405397 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 10:14:48.405397 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 19 10:14:48.405397 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Sep 19 10:14:48.405397 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 511/1034] 10.222.0.66 () {56 vars in 1120 bytes} [Mon Sep 19 10:14:48 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:14:48.413421 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b227cdc-aab3-44f4-b0cf-a11ba0a9deb2 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:48.520774 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b227cdc-aab3-44f4-b0cf-a11ba0a9deb2 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:48.555416 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51da3587-1243-4898-aafc-04f0d267e556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:48.556016 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51da3587-1243-4898-aafc-04f0d267e556 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:48.556323 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51da3587-1243-4898-aafc-04f0d267e556 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:48.556590 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51da3587-1243-4898-aafc-04f0d267e556 None admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:48.557242 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51da3587-1243-4898-aafc-04f0d267e556 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:14:48.557539 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51da3587-1243-4898-aafc-04f0d267e556 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:48.558891 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51da3587-1243-4898-aafc-04f0d267e556 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:48.563989 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:48.573997 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 524/1035] 10.222.0.66 () {56 vars in 1115 bytes} [Mon Sep 19 10:14:48 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:14:48.575311 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796cbeab-a7a7-40c2-b93b-96733175d506 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:48.682352 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796cbeab-a7a7-40c2-b93b-96733175d506 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:48.720875 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458a74af-55ee-4708-b0ea-0f16726365a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:48.721550 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458a74af-55ee-4708-b0ea-0f16726365a7 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:48.721825 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458a74af-55ee-4708-b0ea-0f16726365a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:48.722098 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458a74af-55ee-4708-b0ea-0f16726365a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:48.732637 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458a74af-55ee-4708-b0ea-0f16726365a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:48.734088 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458a74af-55ee-4708-b0ea-0f16726365a7 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:48.749400 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-458a74af-55ee-4708-b0ea-0f16726365a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 10:14:48.749400 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:14:48.749400 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:14:48.749400 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:14:48.749400 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:14:48.749400 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:14:48.749400 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:14:48.749400 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:14:48.749400 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:14:48.749400 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:14:48.749400 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:14:48.749400 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:14:48.749400 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 10:14:48.749400 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 10:14:48.749400 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 10:14:48.749400 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 10:14:48.750470 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:14:48.750470 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:14:48.750470 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:14:48.750470 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:14:48.750470 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:14:48.750470 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:14:48.750470 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:14:48.750470 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Sep 19 10:14:48.750470 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:14:48.750470 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:14:48.750470 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:14:48.750470 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:14:48.750470 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:14:48.750470 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:14:48.750470 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:14:48.750470 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:14:48.750470 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 10:14:48.751376 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 10:14:48.751376 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 10:14:48.751376 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Sep 19 10:14:48.752266 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 512/1036] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 19 10:14:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:14:48.757036 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51da3587-1243-4898-aafc-04f0d267e556 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:48.861210 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51da3587-1243-4898-aafc-04f0d267e556 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:48.894870 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9123e4b-4f47-4348-a9a0-9876b6799729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:48.895476 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9123e4b-4f47-4348-a9a0-9876b6799729 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:48.895751 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9123e4b-4f47-4348-a9a0-9876b6799729 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:48.896017 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9123e4b-4f47-4348-a9a0-9876b6799729 None admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:48.896681 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9123e4b-4f47-4348-a9a0-9876b6799729 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:14:48.896978 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9123e4b-4f47-4348-a9a0-9876b6799729 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:48.898349 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9123e4b-4f47-4348-a9a0-9876b6799729 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:48.915117 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 525/1037] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Sep 19 10:14:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:14:48.916567 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458a74af-55ee-4708-b0ea-0f16726365a7 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:48.942150 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:49.023350 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458a74af-55ee-4708-b0ea-0f16726365a7 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:49.057893 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f80d08-fc30-46b4-97a0-5e45c85446dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:49.058519 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f80d08-fc30-46b4-97a0-5e45c85446dd None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:49.058800 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f80d08-fc30-46b4-97a0-5e45c85446dd None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:49.059069 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f80d08-fc30-46b4-97a0-5e45c85446dd None admin] PATH_INFO: `/v3/users/nova` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:49.067013 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f80d08-fc30-46b4-97a0-5e45c85446dd None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:49.068469 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f80d08-fc30-46b4-97a0-5e45c85446dd None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:49.079399 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-39f80d08-fc30-46b4-97a0-5e45c85446dd None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 19 10:14:49.079399 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:14:49.079399 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:14:49.079399 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:14:49.079399 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:14:49.079399 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:14:49.079399 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:14:49.079399 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:14:49.079399 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:14:49.079399 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:14:49.079399 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:14:49.079399 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:14:49.079399 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 10:14:49.079399 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 10:14:49.079399 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 10:14:49.079399 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 10:14:49.080412 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:14:49.080412 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:14:49.080412 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 10:14:49.080412 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 10:14:49.080412 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 10:14:49.080412 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 10:14:49.080412 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:14:49.080412 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:14:49.080412 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:14:49.080412 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:14:49.080412 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:14:49.080412 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Sep 19 10:14:49.080412 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:14:49.080412 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:14:49.080412 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:14:49.080412 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:14:49.080412 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:14:49.080412 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:14:49.082415 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:14:49.082415 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:14:49.082415 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 10:14:49.082415 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 10:14:49.082415 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 10:14:49.082415 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 10:14:49.082415 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 10:14:49.082415 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 10:14:49.082415 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 19 10:14:49.082415 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Sep 19 10:14:49.083268 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 513/1038] 10.222.0.66 () {56 vars in 1093 bytes} [Mon Sep 19 10:14:48 2022] GET /identity/v3/users/nova => generated 82 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:14:49.086857 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9123e4b-4f47-4348-a9a0-9876b6799729 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:49.149601 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:49.192263 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9123e4b-4f47-4348-a9a0-9876b6799729 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:49.226116 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e264e7a4-ec10-43c4-b8a4-8429efebf54d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:49.226729 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e264e7a4-ec10-43c4-b8a4-8429efebf54d None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:49.227001 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e264e7a4-ec10-43c4-b8a4-8429efebf54d None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:49.227274 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e264e7a4-ec10-43c4-b8a4-8429efebf54d None admin] PATH_INFO: `/v3/users` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:49.227988 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e264e7a4-ec10-43c4-b8a4-8429efebf54d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:14:49.228330 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e264e7a4-ec10-43c4-b8a4-8429efebf54d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:49.229751 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e264e7a4-ec10-43c4-b8a4-8429efebf54d None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:49.247784 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 526/1039] 10.222.0.66 () {56 vars in 1133 bytes} [Mon Sep 19 10:14:49 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 10:14:49.253977 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f80d08-fc30-46b4-97a0-5e45c85446dd None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:49.341059 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:49.360773 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f80d08-fc30-46b4-97a0-5e45c85446dd None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:49.395574 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e40bd24-be60-46c4-9117-0d24909430e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:49.396214 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e40bd24-be60-46c4-9117-0d24909430e6 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:49.396503 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e40bd24-be60-46c4-9117-0d24909430e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:49.396780 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e40bd24-be60-46c4-9117-0d24909430e6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:49.465662 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e40bd24-be60-46c4-9117-0d24909430e6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:49.467033 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e40bd24-be60-46c4-9117-0d24909430e6 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:49.548414 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:49.573857 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 514/1040] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Sep 19 10:14:49 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 19 10:14:49.575449 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e264e7a4-ec10-43c4-b8a4-8429efebf54d None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:49.691997 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e264e7a4-ec10-43c4-b8a4-8429efebf54d None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:49.708727 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:49.722084 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d622d6-ee7a-4cc2-bfb3-abcc4814f8e9 None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:49.722289 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d622d6-ee7a-4cc2-bfb3-abcc4814f8e9 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:49.722564 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d622d6-ee7a-4cc2-bfb3-abcc4814f8e9 None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:49.723929 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 515/1041] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:14:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 10:14:49.729222 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8eb029-6161-4e18-930c-b5c0fe96f92c None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:49.729507 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8eb029-6161-4e18-930c-b5c0fe96f92c None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:49.729905 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8eb029-6161-4e18-930c-b5c0fe96f92c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:49.733040 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bdaf69-179e-4db9-ab17-7f7127703f5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:49.733893 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bdaf69-179e-4db9-ab17-7f7127703f5c None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:49.734356 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bdaf69-179e-4db9-ab17-7f7127703f5c None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:49.734791 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bdaf69-179e-4db9-ab17-7f7127703f5c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:49.745754 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bdaf69-179e-4db9-ab17-7f7127703f5c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:49.747424 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bdaf69-179e-4db9-ab17-7f7127703f5c None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:49.748570 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-1e8eb029-6161-4e18-930c-b5c0fe96f92c None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:14:49.749752 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-1e8eb029-6161-4e18-930c-b5c0fe96f92c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:14:49.763239 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-a8bdaf69-179e-4db9-ab17-7f7127703f5c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 10:14:49.763239 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:14:49.763239 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:14:49.763239 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:14:49.763239 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:14:49.763239 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:14:49.763239 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:14:49.763239 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:14:49.763239 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:14:49.763239 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:14:49.763239 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:14:49.763239 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:14:49.763239 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 10:14:49.763239 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 10:14:49.763239 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 10:14:49.763239 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 10:14:49.764601 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:14:49.764601 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:14:49.764601 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:14:49.764601 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:14:49.764601 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:14:49.764601 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:14:49.764601 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:14:49.764601 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 19 10:14:49.764601 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:14:49.764601 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:14:49.764601 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:14:49.764601 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:14:49.764601 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:14:49.764601 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:14:49.764601 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:14:49.764601 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:14:49.764601 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 10:14:49.765488 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 10:14:49.765488 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 10:14:49.765488 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 19 10:14:49.766125 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 527/1042] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 19 10:14:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 10:14:49.771653 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bdaf69-179e-4db9-ab17-7f7127703f5c None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:49.822864 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 516/1043] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:14:49 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 10:14:49.877057 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bdaf69-179e-4db9-ab17-7f7127703f5c None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:49.912669 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59235acb-fab5-4b42-aa08-a65dbfb3e75f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:49.913577 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59235acb-fab5-4b42-aa08-a65dbfb3e75f None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:49.914037 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59235acb-fab5-4b42-aa08-a65dbfb3e75f None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:49.914496 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59235acb-fab5-4b42-aa08-a65dbfb3e75f None admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:49.915310 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59235acb-fab5-4b42-aa08-a65dbfb3e75f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:14:49.915855 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59235acb-fab5-4b42-aa08-a65dbfb3e75f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:49.917440 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59235acb-fab5-4b42-aa08-a65dbfb3e75f None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:49.929720 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 528/1044] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Sep 19 10:14:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 10:14:49.935354 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8eb029-6161-4e18-930c-b5c0fe96f92c None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:50.038172 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8eb029-6161-4e18-930c-b5c0fe96f92c None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:50.052065 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:50.074524 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a09b02-8a93-47bc-85bc-01a7889ac9d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:50.075311 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a09b02-8a93-47bc-85bc-01a7889ac9d2 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:50.075590 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a09b02-8a93-47bc-85bc-01a7889ac9d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:50.075862 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a09b02-8a93-47bc-85bc-01a7889ac9d2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:50.088237 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a09b02-8a93-47bc-85bc-01a7889ac9d2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:50.089717 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a09b02-8a93-47bc-85bc-01a7889ac9d2 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:50.099015 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59235acb-fab5-4b42-aa08-a65dbfb3e75f None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:50.102690 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-37a09b02-8a93-47bc-85bc-01a7889ac9d2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 10:14:50.102690 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:14:50.102690 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:14:50.102690 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:14:50.102690 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:14:50.102690 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:14:50.102690 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:14:50.102690 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:14:50.102690 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:14:50.102690 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:14:50.102690 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:14:50.102690 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:14:50.102690 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 10:14:50.102690 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 10:14:50.102690 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 10:14:50.103579 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 10:14:50.103579 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:14:50.103579 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:14:50.103579 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:14:50.103579 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:14:50.103579 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:14:50.103579 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:14:50.103579 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:14:50.103579 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Sep 19 10:14:50.103579 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:14:50.103579 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:14:50.103579 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:14:50.103579 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:14:50.103579 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:14:50.103579 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:14:50.103579 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:14:50.103579 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:14:50.104664 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 10:14:50.104664 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 10:14:50.104664 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 10:14:50.104664 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 10:14:50.104664 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 10:14:50.104664 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 10:14:50.104664 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 10:14:50.104664 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Sep 19 10:14:50.104664 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 517/1045] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Sep 19 10:14:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 10:14:50.111010 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a09b02-8a93-47bc-85bc-01a7889ac9d2 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:50.142032 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:50.221211 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59235acb-fab5-4b42-aa08-a65dbfb3e75f None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:50.239305 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a09b02-8a93-47bc-85bc-01a7889ac9d2 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:50.260633 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e87403c-5272-435d-ad05-4d327e9b98e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:50.261266 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e87403c-5272-435d-ad05-4d327e9b98e6 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:50.261549 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e87403c-5272-435d-ad05-4d327e9b98e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:50.261821 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e87403c-5272-435d-ad05-4d327e9b98e6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:50.272240 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e87403c-5272-435d-ad05-4d327e9b98e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 10:14:50.275295 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd30d72-b29d-491e-a797-ef80a8673696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:50.275901 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd30d72-b29d-491e-a797-ef80a8673696 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:50.276190 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd30d72-b29d-491e-a797-ef80a8673696 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:50.276534 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd30d72-b29d-491e-a797-ef80a8673696 None admin] PATH_INFO: `/v3/projects` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:50.277133 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-0e87403c-5272-435d-ad05-4d327e9b98e6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 10:14:50.277133 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:14:50.277133 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:14:50.277133 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:14:50.277133 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:14:50.277133 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:14:50.277133 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:14:50.277133 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:14:50.277133 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:14:50.277133 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:14:50.277133 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:14:50.277133 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:14:50.277133 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 10:14:50.277133 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 10:14:50.277133 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 10:14:50.277133 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 10:14:50.278230 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 10:14:50.278230 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 10:14:50.278230 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 10:14:50.278230 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 10:14:50.278230 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:14:50.278230 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:14:50.278230 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:14:50.278230 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:14:50.278230 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:14:50.278230 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:14:50.278230 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:14:50.278230 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 19 10:14:50.278230 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:14:50.278230 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:14:50.278230 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:14:50.278230 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:14:50.279302 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:14:50.279302 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:14:50.279302 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:14:50.279302 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:14:50.279302 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 10:14:50.279302 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 10:14:50.279302 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 10:14:50.279302 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 10:14:50.279302 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 10:14:50.279302 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 10:14:50.279302 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 10:14:50.279302 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 19 10:14:50.280282 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd30d72-b29d-491e-a797-ef80a8673696 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:14:50.280282 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd30d72-b29d-491e-a797-ef80a8673696 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:50.280282 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd30d72-b29d-491e-a797-ef80a8673696 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:50.283196 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 529/1046] 10.222.0.66 () {56 vars in 1096 bytes} [Mon Sep 19 10:14:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:14:50.284512 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fe4e47-b535-4845-883c-564e9d912aeb None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:50.284794 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fe4e47-b535-4845-883c-564e9d912aeb None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:50.285064 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fe4e47-b535-4845-883c-564e9d912aeb None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:50.287044 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 530/1047] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:14:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:14:50.287583 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fe4e47-b535-4845-883c-564e9d912aeb None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:50.292838 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 518/1048] 10.222.0.66 () {56 vars in 1148 bytes} [Mon Sep 19 10:14:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 10:14:50.294005 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c32bfa-8cce-473c-864c-e5a09f65176c None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:50.294548 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c32bfa-8cce-473c-864c-e5a09f65176c None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:50.294822 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c32bfa-8cce-473c-864c-e5a09f65176c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:50.313445 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-17c32bfa-8cce-473c-864c-e5a09f65176c None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:14:50.314641 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-17c32bfa-8cce-473c-864c-e5a09f65176c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:14:50.343103 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:50.386800 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 519/1049] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:14:50 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 10:14:50.387650 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c32bfa-8cce-473c-864c-e5a09f65176c None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:50.394078 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:50.407144 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fe4e47-b535-4845-883c-564e9d912aeb None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:50.454485 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a2bbc1-5d94-4043-8dfd-16b174b044ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:50.455110 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a2bbc1-5d94-4043-8dfd-16b174b044ee None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:50.455399 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a2bbc1-5d94-4043-8dfd-16b174b044ee None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:50.455736 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a2bbc1-5d94-4043-8dfd-16b174b044ee None admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:50.456439 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a2bbc1-5d94-4043-8dfd-16b174b044ee None admin] RBAC: Adding query filter params (name=admin) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:14:50.456746 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a2bbc1-5d94-4043-8dfd-16b174b044ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:50.458641 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a2bbc1-5d94-4043-8dfd-16b174b044ee None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:50.472213 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 531/1050] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Sep 19 10:14:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:14:50.478366 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a2bbc1-5d94-4043-8dfd-16b174b044ee None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:50.517036 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c32bfa-8cce-473c-864c-e5a09f65176c None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:50.557782 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5533b2f4-227a-4024-a546-079273a5ec1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:50.558269 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5533b2f4-227a-4024-a546-079273a5ec1e None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:50.558566 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5533b2f4-227a-4024-a546-079273a5ec1e None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:50.558844 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5533b2f4-227a-4024-a546-079273a5ec1e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:50.559575 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5533b2f4-227a-4024-a546-079273a5ec1e None admin] RBAC: Adding query filter params (role.id=89dc9467e2a84e2e9602562960b6668f, scope.project.id=be6b93ef3359434d9c776343f0aea333, user.id=15c70bfb085a44e9b84942b480ff22f1) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:14:50.559875 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5533b2f4-227a-4024-a546-079273a5ec1e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:50.561369 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5533b2f4-227a-4024-a546-079273a5ec1e None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:50.576217 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 520/1051] 10.222.0.66 () {56 vars in 1374 bytes} [Mon Sep 19 10:14:50 2022] GET /identity/v3/role_assignments?user.id=15c70bfb085a44e9b84942b480ff22f1&scope.project.id=be6b93ef3359434d9c776343f0aea333&role.id=89dc9467e2a84e2e9602562960b6668f => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:14:50.610103 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a2bbc1-5d94-4043-8dfd-16b174b044ee None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:50.648881 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b89e4d-954e-4605-a2e3-560ac352228f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:50.649537 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b89e4d-954e-4605-a2e3-560ac352228f None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:50.649816 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b89e4d-954e-4605-a2e3-560ac352228f None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:50.650088 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b89e4d-954e-4605-a2e3-560ac352228f None admin] PATH_INFO: `/v3/users/b152c10680e94281ba9ccb46115d302a` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:50.659530 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5533b2f4-227a-4024-a546-079273a5ec1e None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:50.668325 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b89e4d-954e-4605-a2e3-560ac352228f None admin] RBAC: Authorizing `identity:get_user(user_id=b152c10680e94281ba9ccb46115d302a)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:50.673380 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b89e4d-954e-4605-a2e3-560ac352228f None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:50.676666 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 532/1052] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Sep 19 10:14:50 2022] GET /identity/v3/users/b152c10680e94281ba9ccb46115d302a => generated 285 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 10:14:50.682693 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b89e4d-954e-4605-a2e3-560ac352228f None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:50.697068 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:50.698373 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:50.785958 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5533b2f4-227a-4024-a546-079273a5ec1e None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:50.807412 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b89e4d-954e-4605-a2e3-560ac352228f None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:50.825475 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8f5105-9315-408e-adbf-de50a08a8515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:50.826024 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8f5105-9315-408e-adbf-de50a08a8515 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:50.826300 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8f5105-9315-408e-adbf-de50a08a8515 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:50.826572 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8f5105-9315-408e-adbf-de50a08a8515 None admin] PATH_INFO: `/v3/services/image` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:50.827145 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8f5105-9315-408e-adbf-de50a08a8515 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:50.828537 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8f5105-9315-408e-adbf-de50a08a8515 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:50.837365 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-4e8f5105-9315-408e-adbf-de50a08a8515 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 19 10:14:50.837365 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:14:50.837365 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 10:14:50.837365 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 10:14:50.837365 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 10:14:50.837365 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 10:14:50.837365 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 10:14:50.837365 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 10:14:50.837365 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 19 10:14:50.837365 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Sep 19 10:14:50.837365 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 10:14:50.837365 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Sep 19 10:14:50.837365 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:14:50.837365 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:14:50.837365 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:14:50.837365 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:14:50.837365 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:14:50.838378 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:14:50.838378 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:14:50.838378 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:14:50.838378 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:14:50.838378 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:14:50.838378 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:14:50.838378 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 10:14:50.838378 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 10:14:50.838378 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 10:14:50.838378 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 10:14:50.838378 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:14:50.838378 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:14:50.838378 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:14:50.838378 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:14:50.838378 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:14:50.838378 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:14:50.839247 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:14:50.839247 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Sep 19 10:14:50.839247 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:14:50.839247 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:14:50.839247 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:14:50.839247 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:14:50.839247 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:14:50.839247 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:14:50.839247 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:14:50.839247 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:14:50.839247 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 10:14:50.839247 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 10:14:50.839247 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 19 10:14:50.839247 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Sep 19 10:14:50.839247 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 521/1053] 10.222.0.66 () {56 vars in 1105 bytes} [Mon Sep 19 10:14:50 2022] GET /identity/v3/services/image => generated 86 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:14:50.844518 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8f5105-9315-408e-adbf-de50a08a8515 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:50.847236 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c82fc6d-9f7f-4c78-94bd-5960689487f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:50.847858 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c82fc6d-9f7f-4c78-94bd-5960689487f1 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:50.848136 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c82fc6d-9f7f-4c78-94bd-5960689487f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:50.848538 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c82fc6d-9f7f-4c78-94bd-5960689487f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:50.923132 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c82fc6d-9f7f-4c78-94bd-5960689487f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:50.925320 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c82fc6d-9f7f-4c78-94bd-5960689487f1 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:50.938110 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:50.948055 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:50.959477 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8f5105-9315-408e-adbf-de50a08a8515 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:50.995135 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0d21d9-2bbd-4482-9640-bf4c12585fc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:50.995756 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0d21d9-2bbd-4482-9640-bf4c12585fc3 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:50.996029 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0d21d9-2bbd-4482-9640-bf4c12585fc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:50.996357 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0d21d9-2bbd-4482-9640-bf4c12585fc3 None admin] PATH_INFO: `/v3/services` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:50.996979 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0d21d9-2bbd-4482-9640-bf4c12585fc3 None admin] RBAC: Adding query filter params (name=image) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:14:50.997296 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0d21d9-2bbd-4482-9640-bf4c12585fc3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:50.998660 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0d21d9-2bbd-4482-9640-bf4c12585fc3 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:51.004045 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 522/1054] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 19 10:14:50 2022] GET /identity/v3/services?name=image => generated 122 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 10:14:51.009585 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0d21d9-2bbd-4482-9640-bf4c12585fc3 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:51.049080 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 533/1055] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Sep 19 10:14:50 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 19 10:14:51.055098 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c82fc6d-9f7f-4c78-94bd-5960689487f1 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:51.116945 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0d21d9-2bbd-4482-9640-bf4c12585fc3 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:51.154678 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d752c65c-2a3a-4977-8e41-e30c3ff194b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:51.155655 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d752c65c-2a3a-4977-8e41-e30c3ff194b8 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:51.155936 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d752c65c-2a3a-4977-8e41-e30c3ff194b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:51.156233 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d752c65c-2a3a-4977-8e41-e30c3ff194b8 None admin] PATH_INFO: `/v3/services` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:51.156865 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d752c65c-2a3a-4977-8e41-e30c3ff194b8 None admin] RBAC: Adding query filter params (type=image) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:14:51.157164 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d752c65c-2a3a-4977-8e41-e30c3ff194b8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:51.158738 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d752c65c-2a3a-4977-8e41-e30c3ff194b8 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:51.164210 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 523/1056] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 19 10:14:51 2022] GET /identity/v3/services?type=image => generated 350 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 10:14:51.167358 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c82fc6d-9f7f-4c78-94bd-5960689487f1 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:51.169996 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d752c65c-2a3a-4977-8e41-e30c3ff194b8 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:51.179100 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:51.192082 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:51.208759 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9175da0c-b9a9-46e4-becc-9df807aa3418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:51.209551 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9175da0c-b9a9-46e4-becc-9df807aa3418 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:51.210608 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9175da0c-b9a9-46e4-becc-9df807aa3418 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:51.210886 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9175da0c-b9a9-46e4-becc-9df807aa3418 None admin] PATH_INFO: `/v3/projects/fe2188a065ee4bf0b443e4d3f5f17ecb` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:51.212001 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9175da0c-b9a9-46e4-becc-9df807aa3418 None admin] RBAC: Authorizing `identity:get_project(project_id=fe2188a065ee4bf0b443e4d3f5f17ecb)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:51.213473 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9175da0c-b9a9-46e4-becc-9df807aa3418 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:51.215676 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 534/1057] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Sep 19 10:14:51 2022] GET /identity/v3/projects/fe2188a065ee4bf0b443e4d3f5f17ecb => generated 311 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 10:14:51.221975 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9175da0c-b9a9-46e4-becc-9df807aa3418 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:51.281142 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d752c65c-2a3a-4977-8e41-e30c3ff194b8 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:51.316620 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe6df0c-4521-44c4-9945-482f8f4859c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:51.317230 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe6df0c-4521-44c4-9945-482f8f4859c1 None admin] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:51.317510 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe6df0c-4521-44c4-9945-482f8f4859c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:51.317807 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe6df0c-4521-44c4-9945-482f8f4859c1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:51.318504 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe6df0c-4521-44c4-9945-482f8f4859c1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:51.319871 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe6df0c-4521-44c4-9945-482f8f4859c1 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:51.328443 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9175da0c-b9a9-46e4-becc-9df807aa3418 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:51.352194 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 524/1058] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 19 10:14:51 2022] POST /identity/v3/endpoints => generated 327 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 10:14:51.378783 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c81e175-a7cf-4425-952b-6edff0907265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:51.379365 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c81e175-a7cf-4425-952b-6edff0907265 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:51.379647 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c81e175-a7cf-4425-952b-6edff0907265 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:51.379918 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c81e175-a7cf-4425-952b-6edff0907265 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:51.380682 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c81e175-a7cf-4425-952b-6edff0907265 None admin] RBAC: Adding query filter params (role.id=5c8b89fae4fa45bd944cbeaf442136e1, scope.project.id=fe2188a065ee4bf0b443e4d3f5f17ecb, user.id=b152c10680e94281ba9ccb46115d302a) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:14:51.380990 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c81e175-a7cf-4425-952b-6edff0907265 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:51.382451 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c81e175-a7cf-4425-952b-6edff0907265 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:51.388741 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 535/1059] 10.222.0.66 () {56 vars in 1374 bytes} [Mon Sep 19 10:14:51 2022] GET /identity/v3/role_assignments?user.id=b152c10680e94281ba9ccb46115d302a&scope.project.id=fe2188a065ee4bf0b443e4d3f5f17ecb&role.id=5c8b89fae4fa45bd944cbeaf442136e1 => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 10:14:52.812136 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c644cfbf-d763-423a-9611-2e67ee14a563 None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:52.812745 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c644cfbf-d763-423a-9611-2e67ee14a563 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:52.812745 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c644cfbf-d763-423a-9611-2e67ee14a563 None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:52.814072 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 525/1060] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:14:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:14:52.819351 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e4a8b2-d227-4a5a-8e6c-a8887be0c015 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:52.819752 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e4a8b2-d227-4a5a-8e6c-a8887be0c015 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:52.819933 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e4a8b2-d227-4a5a-8e6c-a8887be0c015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:52.838421 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-03e4a8b2-d227-4a5a-8e6c-a8887be0c015 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:14:52.839597 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-03e4a8b2-d227-4a5a-8e6c-a8887be0c015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:14:52.871909 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:52.915574 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 536/1061] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:14:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 10:14:53.188812 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c644cfbf-d763-423a-9611-2e67ee14a563 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:53.267353 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:53.296534 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c644cfbf-d763-423a-9611-2e67ee14a563 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:53.332869 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b60856-0c12-4d54-ac45-a552d2bcce18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:53.333498 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b60856-0c12-4d54-ac45-a552d2bcce18 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:53.333827 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b60856-0c12-4d54-ac45-a552d2bcce18 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:53.334103 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b60856-0c12-4d54-ac45-a552d2bcce18 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:53.344111 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b60856-0c12-4d54-ac45-a552d2bcce18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 10:14:53.348888 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-54b60856-0c12-4d54-ac45-a552d2bcce18 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 19 10:14:53.348888 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:14:53.348888 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:14:53.348888 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:14:53.348888 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:14:53.348888 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:14:53.348888 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:14:53.348888 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:14:53.348888 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:14:53.348888 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:14:53.348888 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:14:53.348888 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:14:53.348888 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 10:14:53.348888 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 10:14:53.348888 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 10:14:53.348888 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 10:14:53.349886 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 10:14:53.349886 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 10:14:53.349886 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 10:14:53.349886 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 10:14:53.349886 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:14:53.349886 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:14:53.349886 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:14:53.349886 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:14:53.349886 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:14:53.349886 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:14:53.349886 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:14:53.349886 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Sep 19 10:14:53.349886 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:14:53.349886 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:14:53.349886 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:14:53.349886 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:14:53.350808 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:14:53.350808 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:14:53.350808 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:14:53.350808 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:14:53.350808 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 10:14:53.350808 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 10:14:53.350808 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 10:14:53.350808 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 10:14:53.350808 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 10:14:53.350808 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 10:14:53.350808 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 19 10:14:53.350808 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Sep 19 10:14:53.352247 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 526/1062] 10.222.0.66 () {56 vars in 1120 bytes} [Mon Sep 19 10:14:53 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:14:53.356272 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e4a8b2-d227-4a5a-8e6c-a8887be0c015 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:53.462009 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e4a8b2-d227-4a5a-8e6c-a8887be0c015 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:53.500669 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abcd7fa-ddfd-4c69-9824-56d2b143208e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:53.501284 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abcd7fa-ddfd-4c69-9824-56d2b143208e None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:53.501569 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abcd7fa-ddfd-4c69-9824-56d2b143208e None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:53.501843 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abcd7fa-ddfd-4c69-9824-56d2b143208e None admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:53.502545 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abcd7fa-ddfd-4c69-9824-56d2b143208e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:14:53.502847 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abcd7fa-ddfd-4c69-9824-56d2b143208e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:53.504239 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abcd7fa-ddfd-4c69-9824-56d2b143208e None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:53.512956 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 537/1063] 10.222.0.66 () {56 vars in 1115 bytes} [Mon Sep 19 10:14:53 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:14:53.519269 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b60856-0c12-4d54-ac45-a552d2bcce18 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:53.563283 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420bc872-cbf9-4432-9adc-7184446366fc None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:53.563615 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420bc872-cbf9-4432-9adc-7184446366fc None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:53.563839 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420bc872-cbf9-4432-9adc-7184446366fc None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:53.565847 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 538/1064] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:14:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:14:53.570658 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e6851c-d826-4415-8983-292fb8b47253 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:53.570942 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e6851c-d826-4415-8983-292fb8b47253 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:53.571215 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e6851c-d826-4415-8983-292fb8b47253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:53.590312 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-c4e6851c-d826-4415-8983-292fb8b47253 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:14:53.591505 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-c4e6851c-d826-4415-8983-292fb8b47253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:14:53.614317 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:53.628925 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b60856-0c12-4d54-ac45-a552d2bcce18 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:53.658819 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 539/1065] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:14:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 10:14:53.660399 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ea334f-0f69-42c1-8c8a-1d8291b67254 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:53.660839 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ea334f-0f69-42c1-8c8a-1d8291b67254 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:53.661113 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ea334f-0f69-42c1-8c8a-1d8291b67254 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:53.662351 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 540/1066] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:14:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:14:53.665547 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a884862d-9569-4d25-b5dc-f719161c8468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:53.666482 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a884862d-9569-4d25-b5dc-f719161c8468 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:53.666949 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a884862d-9569-4d25-b5dc-f719161c8468 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:53.667442 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a884862d-9569-4d25-b5dc-f719161c8468 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:53.667566 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e370be8f-63ae-48b6-95f9-f47f5e5e70eb None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:53.667790 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e370be8f-63ae-48b6-95f9-f47f5e5e70eb None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:53.668058 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e370be8f-63ae-48b6-95f9-f47f5e5e70eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:53.678953 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:53.683270 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a884862d-9569-4d25-b5dc-f719161c8468 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:53.687191 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-e370be8f-63ae-48b6-95f9-f47f5e5e70eb None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:14:53.688018 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a884862d-9569-4d25-b5dc-f719161c8468 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:53.688951 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-e370be8f-63ae-48b6-95f9-f47f5e5e70eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:14:53.707685 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-a884862d-9569-4d25-b5dc-f719161c8468 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 10:14:53.707685 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:14:53.707685 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:14:53.707685 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:14:53.707685 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:14:53.707685 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:14:53.707685 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:14:53.707685 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:14:53.707685 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:14:53.707685 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:14:53.707685 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:14:53.707685 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:14:53.707685 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 10:14:53.707685 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 10:14:53.707685 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 10:14:53.707685 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 10:14:53.708737 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:14:53.708737 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:14:53.708737 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:14:53.708737 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:14:53.708737 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:14:53.708737 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:14:53.708737 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:14:53.708737 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Sep 19 10:14:53.708737 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:14:53.708737 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:14:53.708737 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:14:53.708737 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:14:53.708737 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:14:53.708737 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:14:53.708737 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:14:53.708737 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:14:53.708737 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 10:14:53.709659 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 10:14:53.709659 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 10:14:53.709659 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Sep 19 10:14:53.710792 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 527/1067] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 19 10:14:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:14:53.715408 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a884862d-9569-4d25-b5dc-f719161c8468 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:53.759829 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 541/1068] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:14:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 10:14:53.820355 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a884862d-9569-4d25-b5dc-f719161c8468 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:53.855773 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c6cf60-decc-4d0f-ad5d-0f40ae180728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:53.856414 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c6cf60-decc-4d0f-ad5d-0f40ae180728 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:53.856694 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c6cf60-decc-4d0f-ad5d-0f40ae180728 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:53.857015 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c6cf60-decc-4d0f-ad5d-0f40ae180728 None admin] PATH_INFO: `/v3/domains` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:53.857694 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c6cf60-decc-4d0f-ad5d-0f40ae180728 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:14:53.857895 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c6cf60-decc-4d0f-ad5d-0f40ae180728 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:53.859256 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c6cf60-decc-4d0f-ad5d-0f40ae180728 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:53.871177 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 528/1069] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Sep 19 10:14:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 10:14:53.876610 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e370be8f-63ae-48b6-95f9-f47f5e5e70eb None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:53.932307 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c6cf60-decc-4d0f-ad5d-0f40ae180728 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:53.973134 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:53.981261 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:53.983947 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e370be8f-63ae-48b6-95f9-f47f5e5e70eb None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:54.024949 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f39ff2-1d91-4d84-869a-88ab6482e3c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:54.025638 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f39ff2-1d91-4d84-869a-88ab6482e3c1 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:54.025880 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f39ff2-1d91-4d84-869a-88ab6482e3c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:54.026122 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f39ff2-1d91-4d84-869a-88ab6482e3c1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:54.033738 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f39ff2-1d91-4d84-869a-88ab6482e3c1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:54.035074 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f39ff2-1d91-4d84-869a-88ab6482e3c1 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:54.042242 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c6cf60-decc-4d0f-ad5d-0f40ae180728 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:54.047030 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-c6f39ff2-1d91-4d84-869a-88ab6482e3c1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 19 10:14:54.047030 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:14:54.047030 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:14:54.047030 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:14:54.047030 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:14:54.047030 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:14:54.047030 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:14:54.047030 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:14:54.047030 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:14:54.047030 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:14:54.047030 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:14:54.047030 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:14:54.047030 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 10:14:54.047030 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 10:14:54.047030 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 10:14:54.047030 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 10:14:54.048133 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:14:54.048133 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:14:54.048133 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 10:14:54.048133 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 10:14:54.048133 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 10:14:54.048133 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 10:14:54.048133 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:14:54.048133 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:14:54.048133 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:14:54.048133 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:14:54.048133 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:14:54.048133 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 19 10:14:54.048133 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:14:54.048133 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:14:54.048133 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:14:54.048133 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:14:54.048133 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:14:54.048133 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:14:54.049800 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:14:54.049800 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:14:54.049800 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 10:14:54.049800 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 10:14:54.049800 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 10:14:54.049800 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 10:14:54.049800 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 10:14:54.049800 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 10:14:54.049800 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 19 10:14:54.049800 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 19 10:14:54.049800 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 542/1070] 10.222.0.66 () {56 vars in 1093 bytes} [Mon Sep 19 10:14:53 2022] GET /identity/v3/users/nova => generated 82 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:14:54.049800 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f39ff2-1d91-4d84-869a-88ab6482e3c1 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:54.077410 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd1d9cc-b126-468a-86b7-a025a8dc67ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:54.078021 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd1d9cc-b126-468a-86b7-a025a8dc67ab None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:54.078307 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd1d9cc-b126-468a-86b7-a025a8dc67ab None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:54.078585 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd1d9cc-b126-468a-86b7-a025a8dc67ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:54.145585 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd1d9cc-b126-468a-86b7-a025a8dc67ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:54.147057 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd1d9cc-b126-468a-86b7-a025a8dc67ab None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:54.150738 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f39ff2-1d91-4d84-869a-88ab6482e3c1 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:54.184369 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fecfe3-d66e-4395-a68d-8b7cb4eabb6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:54.184986 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fecfe3-d66e-4395-a68d-8b7cb4eabb6f None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:54.185271 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fecfe3-d66e-4395-a68d-8b7cb4eabb6f None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:54.185540 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fecfe3-d66e-4395-a68d-8b7cb4eabb6f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:54.192313 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:54.196465 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fecfe3-d66e-4395-a68d-8b7cb4eabb6f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 10:14:54.201646 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-82fecfe3-d66e-4395-a68d-8b7cb4eabb6f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 10:14:54.201646 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:14:54.201646 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:14:54.201646 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:14:54.201646 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:14:54.201646 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:14:54.201646 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:14:54.201646 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:14:54.201646 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:14:54.201646 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:14:54.201646 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:14:54.201646 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:14:54.201646 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 10:14:54.201646 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 10:14:54.201646 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 10:14:54.201646 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 10:14:54.202647 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 10:14:54.202647 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 10:14:54.202647 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 10:14:54.202647 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 10:14:54.202647 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:14:54.202647 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:14:54.202647 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:14:54.202647 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:14:54.202647 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:14:54.202647 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:14:54.202647 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:14:54.202647 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 19 10:14:54.202647 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:14:54.202647 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:14:54.202647 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:14:54.202647 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:14:54.203473 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:14:54.203473 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:14:54.203473 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:14:54.203473 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:14:54.203473 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 10:14:54.203473 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 10:14:54.203473 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 10:14:54.203473 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 10:14:54.203473 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 10:14:54.203473 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 10:14:54.203473 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 10:14:54.203473 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 19 10:14:54.203473 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 543/1071] 10.222.0.66 () {56 vars in 1096 bytes} [Mon Sep 19 10:14:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:14:54.204155 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fecfe3-d66e-4395-a68d-8b7cb4eabb6f None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:54.217216 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:54.250209 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 529/1072] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Sep 19 10:14:53 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 19 10:14:54.251113 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd1d9cc-b126-468a-86b7-a025a8dc67ab None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:54.307456 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fecfe3-d66e-4395-a68d-8b7cb4eabb6f None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:54.342095 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4ef69f-db3a-4057-b296-cfc36624fc69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:54.342735 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4ef69f-db3a-4057-b296-cfc36624fc69 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:54.343191 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4ef69f-db3a-4057-b296-cfc36624fc69 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:54.343514 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4ef69f-db3a-4057-b296-cfc36624fc69 None admin] PATH_INFO: `/v3/users` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:54.344398 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4ef69f-db3a-4057-b296-cfc36624fc69 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:14:54.344707 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4ef69f-db3a-4057-b296-cfc36624fc69 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:54.346190 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4ef69f-db3a-4057-b296-cfc36624fc69 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:54.352280 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd1d9cc-b126-468a-86b7-a025a8dc67ab None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:54.363476 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 544/1073] 10.222.0.66 () {56 vars in 1133 bytes} [Mon Sep 19 10:14:54 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:14:54.364318 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4ef69f-db3a-4057-b296-cfc36624fc69 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:54.392489 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fa45fa-b17f-4536-9e84-49f9e03f5bfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:54.393635 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fa45fa-b17f-4536-9e84-49f9e03f5bfd None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:54.393915 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fa45fa-b17f-4536-9e84-49f9e03f5bfd None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:54.394185 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fa45fa-b17f-4536-9e84-49f9e03f5bfd None admin] PATH_INFO: `/v3/roles` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:54.394837 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fa45fa-b17f-4536-9e84-49f9e03f5bfd None admin] RBAC: Adding query filter params (name=admin) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:14:54.395138 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fa45fa-b17f-4536-9e84-49f9e03f5bfd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:54.396522 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fa45fa-b17f-4536-9e84-49f9e03f5bfd None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:54.404809 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 530/1074] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Sep 19 10:14:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:14:54.405595 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fa45fa-b17f-4536-9e84-49f9e03f5bfd None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:54.416433 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:54.437264 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:54.471029 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4ef69f-db3a-4057-b296-cfc36624fc69 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:54.504896 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fa45fa-b17f-4536-9e84-49f9e03f5bfd None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:54.506532 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c2565d-657a-4219-b2bb-59a0bc14a43b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:54.507170 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c2565d-657a-4219-b2bb-59a0bc14a43b None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:54.507447 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c2565d-657a-4219-b2bb-59a0bc14a43b None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:54.507716 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c2565d-657a-4219-b2bb-59a0bc14a43b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:54.517492 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c2565d-657a-4219-b2bb-59a0bc14a43b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:54.519528 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c2565d-657a-4219-b2bb-59a0bc14a43b None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:54.534449 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-39c2565d-657a-4219-b2bb-59a0bc14a43b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 10:14:54.534449 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:14:54.534449 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:14:54.534449 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:14:54.534449 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:14:54.534449 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:14:54.534449 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:14:54.534449 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:14:54.534449 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:14:54.534449 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:14:54.534449 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:14:54.534449 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:14:54.534449 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 10:14:54.534449 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 10:14:54.534449 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 10:14:54.534449 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 10:14:54.535563 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:14:54.535563 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:14:54.535563 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:14:54.535563 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:14:54.535563 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:14:54.535563 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:14:54.535563 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:14:54.535563 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 19 10:14:54.535563 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:14:54.535563 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:14:54.535563 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:14:54.535563 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:14:54.535563 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:14:54.535563 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:14:54.535563 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:14:54.535563 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:14:54.535563 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 10:14:54.536715 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 10:14:54.536715 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 10:14:54.536715 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 19 10:14:54.536715 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 545/1075] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 19 10:14:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:14:54.536715 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c2565d-657a-4219-b2bb-59a0bc14a43b None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:54.543210 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc118211-7ef6-4496-be8d-857cae6029e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:54.543846 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc118211-7ef6-4496-be8d-857cae6029e9 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:54.544395 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc118211-7ef6-4496-be8d-857cae6029e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:54.544679 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc118211-7ef6-4496-be8d-857cae6029e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:54.555610 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc118211-7ef6-4496-be8d-857cae6029e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:54.557091 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc118211-7ef6-4496-be8d-857cae6029e9 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:54.571391 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-bc118211-7ef6-4496-be8d-857cae6029e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 10:14:54.571391 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:14:54.571391 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:14:54.571391 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:14:54.571391 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:14:54.571391 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:14:54.571391 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:14:54.571391 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:14:54.571391 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:14:54.571391 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:14:54.571391 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:14:54.571391 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:14:54.571391 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 10:14:54.571391 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 10:14:54.571391 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 10:14:54.571391 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 10:14:54.572563 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:14:54.572563 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:14:54.572563 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:14:54.572563 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:14:54.572563 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:14:54.572563 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:14:54.572563 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:14:54.572563 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Sep 19 10:14:54.572563 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:14:54.572563 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:14:54.572563 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:14:54.572563 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:14:54.572563 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:14:54.572563 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:14:54.572563 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:14:54.572563 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:14:54.572563 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 10:14:54.573567 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 10:14:54.573567 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 10:14:54.573567 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Sep 19 10:14:54.573567 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 531/1076] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 19 10:14:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:14:54.573567 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc118211-7ef6-4496-be8d-857cae6029e9 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:54.636684 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:54.645484 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c2565d-657a-4219-b2bb-59a0bc14a43b None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:54.665036 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:54.681304 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf8f7dd-4138-402e-8592-b9072dff0c2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:54.681877 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc118211-7ef6-4496-be8d-857cae6029e9 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:54.681997 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf8f7dd-4138-402e-8592-b9072dff0c2d None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:54.682192 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf8f7dd-4138-402e-8592-b9072dff0c2d None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:54.682462 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf8f7dd-4138-402e-8592-b9072dff0c2d None admin] PATH_INFO: `/v3/users/b152c10680e94281ba9ccb46115d302a` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:54.683581 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf8f7dd-4138-402e-8592-b9072dff0c2d None admin] RBAC: Authorizing `identity:get_user(user_id=b152c10680e94281ba9ccb46115d302a)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:54.685051 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf8f7dd-4138-402e-8592-b9072dff0c2d None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:54.692095 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 546/1077] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Sep 19 10:14:54 2022] GET /identity/v3/users/b152c10680e94281ba9ccb46115d302a => generated 285 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:14:54.692095 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf8f7dd-4138-402e-8592-b9072dff0c2d None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:54.727408 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2202346-c238-45c1-a775-1e43e53ad228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:54.728020 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2202346-c238-45c1-a775-1e43e53ad228 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:54.728337 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2202346-c238-45c1-a775-1e43e53ad228 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:54.728601 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2202346-c238-45c1-a775-1e43e53ad228 None admin] PATH_INFO: `/v3/domains` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:54.729232 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2202346-c238-45c1-a775-1e43e53ad228 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:14:54.729525 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2202346-c238-45c1-a775-1e43e53ad228 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:54.730878 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2202346-c238-45c1-a775-1e43e53ad228 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:54.742998 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 532/1078] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Sep 19 10:14:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:14:54.743822 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2202346-c238-45c1-a775-1e43e53ad228 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:54.819004 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf8f7dd-4138-402e-8592-b9072dff0c2d None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:54.861485 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2202346-c238-45c1-a775-1e43e53ad228 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:54.864954 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b881c3e2-badc-43dd-a110-9f40a2cc9de0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:54.865584 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b881c3e2-badc-43dd-a110-9f40a2cc9de0 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:54.865865 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b881c3e2-badc-43dd-a110-9f40a2cc9de0 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:54.866136 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b881c3e2-badc-43dd-a110-9f40a2cc9de0 None admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:54.866785 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b881c3e2-badc-43dd-a110-9f40a2cc9de0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:14:54.867086 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b881c3e2-badc-43dd-a110-9f40a2cc9de0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:54.868518 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b881c3e2-badc-43dd-a110-9f40a2cc9de0 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:54.885061 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:54.888436 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 547/1079] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Sep 19 10:14:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:14:54.891468 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b881c3e2-badc-43dd-a110-9f40a2cc9de0 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:54.905183 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6299b1b0-0792-46d0-837f-57e4d30fe835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:54.905810 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6299b1b0-0792-46d0-837f-57e4d30fe835 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:54.906093 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6299b1b0-0792-46d0-837f-57e4d30fe835 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:54.906366 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6299b1b0-0792-46d0-837f-57e4d30fe835 None admin] PATH_INFO: `/v3/projects/fe2188a065ee4bf0b443e4d3f5f17ecb` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:54.907648 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6299b1b0-0792-46d0-837f-57e4d30fe835 None admin] RBAC: Authorizing `identity:get_project(project_id=fe2188a065ee4bf0b443e4d3f5f17ecb)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:54.909179 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6299b1b0-0792-46d0-837f-57e4d30fe835 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:54.910919 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 533/1080] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Sep 19 10:14:54 2022] GET /identity/v3/projects/fe2188a065ee4bf0b443e4d3f5f17ecb => generated 311 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:14:54.917276 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6299b1b0-0792-46d0-837f-57e4d30fe835 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:54.954325 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:55.017381 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b881c3e2-badc-43dd-a110-9f40a2cc9de0 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:55.049999 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6299b1b0-0792-46d0-837f-57e4d30fe835 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:55.062636 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d441ac2-7892-409f-8d39-eeaed276c748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:55.063280 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d441ac2-7892-409f-8d39-eeaed276c748 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:55.063557 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d441ac2-7892-409f-8d39-eeaed276c748 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:55.063827 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d441ac2-7892-409f-8d39-eeaed276c748 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:55.070611 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d441ac2-7892-409f-8d39-eeaed276c748 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:55.072041 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d441ac2-7892-409f-8d39-eeaed276c748 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:55.085162 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-1d441ac2-7892-409f-8d39-eeaed276c748 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 10:14:55.085162 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:14:55.085162 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:14:55.085162 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:14:55.085162 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:14:55.085162 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:14:55.085162 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:14:55.085162 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:14:55.085162 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:14:55.085162 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:14:55.085162 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:14:55.085162 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:14:55.085162 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 10:14:55.085162 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 10:14:55.085162 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 10:14:55.086204 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 10:14:55.086204 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:14:55.086204 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:14:55.086204 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:14:55.086204 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:14:55.086204 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:14:55.086204 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:14:55.086204 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:14:55.086204 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 19 10:14:55.086204 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:14:55.086204 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:14:55.086204 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:14:55.086204 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:14:55.086204 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:14:55.086204 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:14:55.086204 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:14:55.086204 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:14:55.087101 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 10:14:55.087101 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 10:14:55.087101 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 10:14:55.087101 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 10:14:55.087101 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 10:14:55.087101 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 10:14:55.087101 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 10:14:55.087101 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 19 10:14:55.087101 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 548/1081] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Sep 19 10:14:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:14:55.092234 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d441ac2-7892-409f-8d39-eeaed276c748 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:55.093120 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f3e664-7faa-4678-acc1-86093a640325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:55.094182 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f3e664-7faa-4678-acc1-86093a640325 None admin] REQUEST_METHOD: `PUT` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:55.094678 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f3e664-7faa-4678-acc1-86093a640325 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:55.095259 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f3e664-7faa-4678-acc1-86093a640325 None admin] PATH_INFO: `/v3/projects/fe2188a065ee4bf0b443e4d3f5f17ecb/users/b152c10680e94281ba9ccb46115d302a/roles/5c8b89fae4fa45bd944cbeaf442136e1` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:55.101050 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f3e664-7faa-4678-acc1-86093a640325 None admin] RBAC: Authorizing `identity:create_grant(project_id=fe2188a065ee4bf0b443e4d3f5f17ecb, user_id=b152c10680e94281ba9ccb46115d302a, role_id=5c8b89fae4fa45bd944cbeaf442136e1)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:55.103092 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f3e664-7faa-4678-acc1-86093a640325 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:55.126226 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 534/1082] 10.222.0.66 () {58 vars in 1439 bytes} [Mon Sep 19 10:14:54 2022] PUT /identity/v3/projects/fe2188a065ee4bf0b443e4d3f5f17ecb/users/b152c10680e94281ba9ccb46115d302a/roles/5c8b89fae4fa45bd944cbeaf442136e1 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 10:14:55.214655 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d441ac2-7892-409f-8d39-eeaed276c748 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:55.225407 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:55.256186 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85b0a33-6037-4b4b-8b80-ccea44f07a17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:55.256924 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85b0a33-6037-4b4b-8b80-ccea44f07a17 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:55.257278 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85b0a33-6037-4b4b-8b80-ccea44f07a17 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:55.257624 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85b0a33-6037-4b4b-8b80-ccea44f07a17 None admin] PATH_INFO: `/v3/projects` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:55.258405 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85b0a33-6037-4b4b-8b80-ccea44f07a17 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:14:55.258789 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85b0a33-6037-4b4b-8b80-ccea44f07a17 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:55.260352 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85b0a33-6037-4b4b-8b80-ccea44f07a17 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:55.276428 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 549/1083] 10.222.0.66 () {56 vars in 1148 bytes} [Mon Sep 19 10:14:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 10:14:55.280575 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f3e664-7faa-4678-acc1-86093a640325 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:55.342799 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:55.399976 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f3e664-7faa-4678-acc1-86093a640325 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:55.433619 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c99ec0-5c0f-48bf-a87e-d382293074ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:55.434280 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c99ec0-5c0f-48bf-a87e-d382293074ea None admin] REQUEST_METHOD: `PUT` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:55.434559 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c99ec0-5c0f-48bf-a87e-d382293074ea None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:55.434835 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c99ec0-5c0f-48bf-a87e-d382293074ea None admin] PATH_INFO: `/v3/projects/be6b93ef3359434d9c776343f0aea333/users/15c70bfb085a44e9b84942b480ff22f1/roles/89dc9467e2a84e2e9602562960b6668f` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:55.436970 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c99ec0-5c0f-48bf-a87e-d382293074ea None admin] RBAC: Authorizing `identity:create_grant(project_id=be6b93ef3359434d9c776343f0aea333, user_id=15c70bfb085a44e9b84942b480ff22f1, role_id=89dc9467e2a84e2e9602562960b6668f)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:55.438409 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c99ec0-5c0f-48bf-a87e-d382293074ea None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:55.453634 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 535/1084] 10.222.0.66 () {58 vars in 1439 bytes} [Mon Sep 19 10:14:55 2022] PUT /identity/v3/projects/be6b93ef3359434d9c776343f0aea333/users/15c70bfb085a44e9b84942b480ff22f1/roles/89dc9467e2a84e2e9602562960b6668f => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:14:57.296789 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83e4883-aba7-42d8-93d5-19a0c68c624c None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:57.297314 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83e4883-aba7-42d8-93d5-19a0c68c624c None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:57.297314 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83e4883-aba7-42d8-93d5-19a0c68c624c None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:57.298706 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 550/1085] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:14:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:14:57.304841 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60550593-424b-4d4a-9f0d-2311f1bd9366 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:57.305246 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60550593-424b-4d4a-9f0d-2311f1bd9366 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:57.305387 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60550593-424b-4d4a-9f0d-2311f1bd9366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:57.323136 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-60550593-424b-4d4a-9f0d-2311f1bd9366 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:14:57.324333 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-60550593-424b-4d4a-9f0d-2311f1bd9366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:14:57.390118 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 536/1086] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:14:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 10:14:57.621738 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7f71ad-8850-4b8c-bf63-7fac3943966f None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:57.621919 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7f71ad-8850-4b8c-bf63-7fac3943966f None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:57.622197 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7f71ad-8850-4b8c-bf63-7fac3943966f None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:57.623534 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 551/1087] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:14:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:14:57.628667 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da408ac-726a-4986-9947-767d58dd5c4b None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:57.628960 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da408ac-726a-4986-9947-767d58dd5c4b None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:57.629238 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da408ac-726a-4986-9947-767d58dd5c4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:57.647911 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-8da408ac-726a-4986-9947-767d58dd5c4b None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:14:57.649120 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-8da408ac-726a-4986-9947-767d58dd5c4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:14:57.668497 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7f71ad-8850-4b8c-bf63-7fac3943966f None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:57.678717 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:57.717747 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 537/1088] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:14:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 10:14:57.771121 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7f71ad-8850-4b8c-bf63-7fac3943966f None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:57.804803 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebcc63d-ff01-428c-8496-d1fdd5398f10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:57.805430 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebcc63d-ff01-428c-8496-d1fdd5398f10 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:57.805708 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebcc63d-ff01-428c-8496-d1fdd5398f10 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:57.805980 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebcc63d-ff01-428c-8496-d1fdd5398f10 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:57.815767 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebcc63d-ff01-428c-8496-d1fdd5398f10 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 10:14:57.820551 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-5ebcc63d-ff01-428c-8496-d1fdd5398f10 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 10:14:57.820551 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:14:57.820551 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:14:57.820551 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:14:57.820551 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:14:57.820551 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:14:57.820551 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:14:57.820551 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:14:57.820551 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:14:57.820551 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:14:57.820551 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:14:57.820551 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:14:57.820551 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 10:14:57.820551 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 10:14:57.820551 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 10:14:57.820551 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 10:14:57.821471 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 10:14:57.821471 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 10:14:57.821471 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 10:14:57.821471 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 10:14:57.821471 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:14:57.821471 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:14:57.821471 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:14:57.821471 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:14:57.821471 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:14:57.821471 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:14:57.821471 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:14:57.821471 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 19 10:14:57.821471 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:14:57.821471 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:14:57.821471 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:14:57.821471 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:14:57.822320 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:14:57.822320 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:14:57.822320 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:14:57.822320 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:14:57.822320 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 10:14:57.822320 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 10:14:57.822320 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 10:14:57.822320 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 10:14:57.822320 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 10:14:57.822320 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 10:14:57.822320 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 10:14:57.822320 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 19 10:14:57.822320 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 552/1089] 10.222.0.66 () {56 vars in 1096 bytes} [Mon Sep 19 10:14:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 10:14:57.827743 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da408ac-726a-4986-9947-767d58dd5c4b None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:57.932573 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da408ac-726a-4986-9947-767d58dd5c4b None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:57.966084 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94976a5b-e686-4a98-bf9a-31b695a206eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:57.966690 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94976a5b-e686-4a98-bf9a-31b695a206eb None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:57.966972 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94976a5b-e686-4a98-bf9a-31b695a206eb None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:57.967245 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94976a5b-e686-4a98-bf9a-31b695a206eb None admin] PATH_INFO: `/v3/roles` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:57.967895 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94976a5b-e686-4a98-bf9a-31b695a206eb None admin] RBAC: Adding query filter params (name=admin) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:14:57.968225 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94976a5b-e686-4a98-bf9a-31b695a206eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:57.969590 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94976a5b-e686-4a98-bf9a-31b695a206eb None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:57.978142 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 538/1090] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Sep 19 10:14:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:14:57.983746 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94976a5b-e686-4a98-bf9a-31b695a206eb None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:57.983902 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebcc63d-ff01-428c-8496-d1fdd5398f10 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:58.012241 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:58.013901 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:58.082390 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94976a5b-e686-4a98-bf9a-31b695a206eb None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:58.085526 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebcc63d-ff01-428c-8496-d1fdd5398f10 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:58.116072 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310875fd-07be-43b6-9f59-e373c392088b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:58.116736 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310875fd-07be-43b6-9f59-e373c392088b None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:58.117017 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310875fd-07be-43b6-9f59-e373c392088b None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:58.117295 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310875fd-07be-43b6-9f59-e373c392088b None admin] PATH_INFO: `/v3/users/b152c10680e94281ba9ccb46115d302a` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:58.118405 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310875fd-07be-43b6-9f59-e373c392088b None admin] RBAC: Authorizing `identity:get_user(user_id=b152c10680e94281ba9ccb46115d302a)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:58.119588 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb2c1ec-44a0-4031-937d-ebb103b7e89d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:58.119838 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310875fd-07be-43b6-9f59-e373c392088b None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:58.120258 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb2c1ec-44a0-4031-937d-ebb103b7e89d None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:58.120541 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb2c1ec-44a0-4031-937d-ebb103b7e89d None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:58.120816 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb2c1ec-44a0-4031-937d-ebb103b7e89d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:58.121492 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 539/1091] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Sep 19 10:14:57 2022] GET /identity/v3/users/b152c10680e94281ba9ccb46115d302a => generated 285 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 10:14:58.127563 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310875fd-07be-43b6-9f59-e373c392088b None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:58.131729 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb2c1ec-44a0-4031-937d-ebb103b7e89d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 10:14:58.136571 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-dfb2c1ec-44a0-4031-937d-ebb103b7e89d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 19 10:14:58.136571 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:14:58.136571 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:14:58.136571 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:14:58.136571 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:14:58.136571 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:14:58.136571 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:14:58.136571 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:14:58.136571 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:14:58.136571 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:14:58.136571 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:14:58.136571 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:14:58.136571 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 10:14:58.136571 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 10:14:58.136571 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 10:14:58.136571 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 10:14:58.137515 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 10:14:58.137515 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 10:14:58.137515 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 10:14:58.137515 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 10:14:58.137515 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:14:58.137515 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:14:58.137515 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:14:58.137515 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:14:58.137515 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:14:58.137515 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:14:58.137515 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:14:58.137515 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 19 10:14:58.137515 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:14:58.137515 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:14:58.137515 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:14:58.137515 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:14:58.138348 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:14:58.138348 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:14:58.138348 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:14:58.138348 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:14:58.138348 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 10:14:58.138348 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 10:14:58.138348 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 10:14:58.138348 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 10:14:58.138348 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 10:14:58.138348 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 10:14:58.138348 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 19 10:14:58.138348 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 19 10:14:58.138348 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 553/1092] 10.222.0.66 () {56 vars in 1120 bytes} [Mon Sep 19 10:14:57 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 10:14:58.144022 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb2c1ec-44a0-4031-937d-ebb103b7e89d None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:58.228619 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:58.232565 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310875fd-07be-43b6-9f59-e373c392088b None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:58.233374 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:58.245989 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb2c1ec-44a0-4031-937d-ebb103b7e89d None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:58.267014 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997d11d8-cccf-48d6-a032-c8e1e1f78301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:58.267647 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997d11d8-cccf-48d6-a032-c8e1e1f78301 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:58.268512 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997d11d8-cccf-48d6-a032-c8e1e1f78301 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:58.268789 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997d11d8-cccf-48d6-a032-c8e1e1f78301 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:58.280738 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351e683e-b7eb-4464-a86c-e5deebd81dfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:58.281338 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351e683e-b7eb-4464-a86c-e5deebd81dfc None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:58.281606 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351e683e-b7eb-4464-a86c-e5deebd81dfc None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:58.281874 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351e683e-b7eb-4464-a86c-e5deebd81dfc None admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:58.282521 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351e683e-b7eb-4464-a86c-e5deebd81dfc None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:14:58.282817 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351e683e-b7eb-4464-a86c-e5deebd81dfc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:58.284246 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351e683e-b7eb-4464-a86c-e5deebd81dfc None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:58.293421 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 554/1093] 10.222.0.66 () {56 vars in 1115 bytes} [Mon Sep 19 10:14:58 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 10:14:58.300091 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351e683e-b7eb-4464-a86c-e5deebd81dfc None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:58.343957 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997d11d8-cccf-48d6-a032-c8e1e1f78301 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:58.345454 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997d11d8-cccf-48d6-a032-c8e1e1f78301 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:58.400142 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351e683e-b7eb-4464-a86c-e5deebd81dfc None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:58.434298 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5402b4-b42f-496c-9335-07b88c56b34a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:58.434930 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5402b4-b42f-496c-9335-07b88c56b34a None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:58.435214 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5402b4-b42f-496c-9335-07b88c56b34a None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:58.435485 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5402b4-b42f-496c-9335-07b88c56b34a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:58.443612 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:58.446914 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5402b4-b42f-496c-9335-07b88c56b34a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:58.448389 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5402b4-b42f-496c-9335-07b88c56b34a None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:58.453768 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 540/1094] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Sep 19 10:14:58 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 19 10:14:58.454633 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997d11d8-cccf-48d6-a032-c8e1e1f78301 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:58.462894 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-bb5402b4-b42f-496c-9335-07b88c56b34a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 10:14:58.462894 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:14:58.462894 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:14:58.462894 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:14:58.462894 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:14:58.462894 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:14:58.462894 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:14:58.462894 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:14:58.462894 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:14:58.462894 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:14:58.462894 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:14:58.462894 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:14:58.462894 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 10:14:58.462894 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 10:14:58.462894 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 10:14:58.462894 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 10:14:58.464085 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:14:58.464085 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:14:58.464085 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:14:58.464085 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:14:58.464085 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:14:58.464085 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:14:58.464085 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:14:58.464085 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 19 10:14:58.464085 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:14:58.464085 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:14:58.464085 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:14:58.464085 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:14:58.464085 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:14:58.464085 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:14:58.464085 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:14:58.464085 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:14:58.464085 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 10:14:58.465097 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 10:14:58.465097 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 10:14:58.465097 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 19 10:14:58.465097 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 555/1095] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 19 10:14:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 10:14:58.471233 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5402b4-b42f-496c-9335-07b88c56b34a None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:58.474017 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:58.554494 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997d11d8-cccf-48d6-a032-c8e1e1f78301 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:58.573989 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5402b4-b42f-496c-9335-07b88c56b34a None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:58.589639 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd25b88-c34b-4b3e-9504-e93ec602e4a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:58.590269 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd25b88-c34b-4b3e-9504-e93ec602e4a3 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:58.590553 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd25b88-c34b-4b3e-9504-e93ec602e4a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:58.590825 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd25b88-c34b-4b3e-9504-e93ec602e4a3 None admin] PATH_INFO: `/v3/projects/fe2188a065ee4bf0b443e4d3f5f17ecb` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:58.591929 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd25b88-c34b-4b3e-9504-e93ec602e4a3 None admin] RBAC: Authorizing `identity:get_project(project_id=fe2188a065ee4bf0b443e4d3f5f17ecb)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:58.593415 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd25b88-c34b-4b3e-9504-e93ec602e4a3 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:58.595041 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 541/1096] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Sep 19 10:14:58 2022] GET /identity/v3/projects/fe2188a065ee4bf0b443e4d3f5f17ecb => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:14:58.601086 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd25b88-c34b-4b3e-9504-e93ec602e4a3 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:58.607125 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a0ebfd-7754-423f-ae1a-4f49fdf95a12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:58.607732 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a0ebfd-7754-423f-ae1a-4f49fdf95a12 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:58.608010 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a0ebfd-7754-423f-ae1a-4f49fdf95a12 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:58.608314 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a0ebfd-7754-423f-ae1a-4f49fdf95a12 None admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:58.608951 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a0ebfd-7754-423f-ae1a-4f49fdf95a12 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:14:58.609256 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a0ebfd-7754-423f-ae1a-4f49fdf95a12 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:58.610624 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a0ebfd-7754-423f-ae1a-4f49fdf95a12 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:58.622554 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 556/1097] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Sep 19 10:14:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 10:14:58.628800 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a0ebfd-7754-423f-ae1a-4f49fdf95a12 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:58.665570 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:58.691156 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:58.705575 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd25b88-c34b-4b3e-9504-e93ec602e4a3 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:58.729871 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a0ebfd-7754-423f-ae1a-4f49fdf95a12 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:58.739570 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90ab5fc-252c-4b31-9a5d-8e188dc6b05b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:58.740171 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90ab5fc-252c-4b31-9a5d-8e188dc6b05b None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:58.740481 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90ab5fc-252c-4b31-9a5d-8e188dc6b05b None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:58.740755 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90ab5fc-252c-4b31-9a5d-8e188dc6b05b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:58.741477 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90ab5fc-252c-4b31-9a5d-8e188dc6b05b None admin] RBAC: Adding query filter params (role.id=5c8b89fae4fa45bd944cbeaf442136e1, scope.project.id=fe2188a065ee4bf0b443e4d3f5f17ecb, user.id=b152c10680e94281ba9ccb46115d302a) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:14:58.741789 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90ab5fc-252c-4b31-9a5d-8e188dc6b05b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:58.743225 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90ab5fc-252c-4b31-9a5d-8e188dc6b05b None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:58.748886 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 542/1098] 10.222.0.66 () {56 vars in 1374 bytes} [Mon Sep 19 10:14:58 2022] GET /identity/v3/role_assignments?user.id=b152c10680e94281ba9ccb46115d302a&scope.project.id=fe2188a065ee4bf0b443e4d3f5f17ecb&role.id=5c8b89fae4fa45bd944cbeaf442136e1 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:14:58.764511 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84235be-ccae-4bf1-a4c7-27e848c04503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:58.765172 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84235be-ccae-4bf1-a4c7-27e848c04503 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:58.765446 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84235be-ccae-4bf1-a4c7-27e848c04503 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:58.765714 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84235be-ccae-4bf1-a4c7-27e848c04503 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:58.773911 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84235be-ccae-4bf1-a4c7-27e848c04503 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:58.775380 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84235be-ccae-4bf1-a4c7-27e848c04503 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:58.789351 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-f84235be-ccae-4bf1-a4c7-27e848c04503 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 19 10:14:58.789351 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:14:58.789351 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:14:58.789351 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:14:58.789351 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:14:58.789351 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:14:58.789351 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:14:58.789351 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:14:58.789351 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:14:58.789351 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:14:58.789351 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:14:58.789351 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:14:58.789351 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 10:14:58.789351 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 10:14:58.789351 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 10:14:58.789351 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 10:14:58.790593 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:14:58.790593 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:14:58.790593 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 10:14:58.790593 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 10:14:58.790593 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 10:14:58.790593 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 10:14:58.790593 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:14:58.790593 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:14:58.790593 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:14:58.790593 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:14:58.790593 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:14:58.790593 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 19 10:14:58.790593 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:14:58.790593 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:14:58.790593 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:14:58.790593 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:14:58.790593 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:14:58.790593 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:14:58.791553 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:14:58.791553 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:14:58.791553 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 10:14:58.791553 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 10:14:58.791553 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 10:14:58.791553 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 10:14:58.791553 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 10:14:58.791553 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 10:14:58.791553 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 19 10:14:58.791553 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 19 10:14:58.791553 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 557/1099] 10.222.0.66 () {56 vars in 1093 bytes} [Mon Sep 19 10:14:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 10:14:58.797407 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90ab5fc-252c-4b31-9a5d-8e188dc6b05b None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:58.914972 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90ab5fc-252c-4b31-9a5d-8e188dc6b05b None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:58.947408 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:58.954177 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3190fe22-38ee-444d-9ed4-0ee295ec583d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:58.954357 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3190fe22-38ee-444d-9ed4-0ee295ec583d None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:58.954555 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3190fe22-38ee-444d-9ed4-0ee295ec583d None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:58.954830 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3190fe22-38ee-444d-9ed4-0ee295ec583d None admin] PATH_INFO: `/v3/users` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:58.956182 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3190fe22-38ee-444d-9ed4-0ee295ec583d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:14:58.956552 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3190fe22-38ee-444d-9ed4-0ee295ec583d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:58.957984 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3190fe22-38ee-444d-9ed4-0ee295ec583d None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:58.975682 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 543/1100] 10.222.0.66 () {56 vars in 1133 bytes} [Mon Sep 19 10:14:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:14:58.981565 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84235be-ccae-4bf1-a4c7-27e848c04503 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:59.082312 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84235be-ccae-4bf1-a4c7-27e848c04503 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:59.103651 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:59.115401 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a064bc-2b33-4f4b-8563-7e902983f436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:59.116013 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a064bc-2b33-4f4b-8563-7e902983f436 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:59.116336 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a064bc-2b33-4f4b-8563-7e902983f436 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:59.116612 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a064bc-2b33-4f4b-8563-7e902983f436 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:59.184842 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a064bc-2b33-4f4b-8563-7e902983f436 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:59.186288 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a064bc-2b33-4f4b-8563-7e902983f436 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:59.290572 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 558/1101] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Sep 19 10:14:58 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 19 10:14:59.292086 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3190fe22-38ee-444d-9ed4-0ee295ec583d None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:59.390183 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3190fe22-38ee-444d-9ed4-0ee295ec583d None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:59.424976 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a84f35-a6d4-45af-970d-ba99fe7ac5b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:59.425602 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a84f35-a6d4-45af-970d-ba99fe7ac5b5 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:59.425879 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a84f35-a6d4-45af-970d-ba99fe7ac5b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:59.426148 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a84f35-a6d4-45af-970d-ba99fe7ac5b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:59.436306 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a84f35-a6d4-45af-970d-ba99fe7ac5b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:59.437672 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a84f35-a6d4-45af-970d-ba99fe7ac5b5 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:59.452035 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-e2a84f35-a6d4-45af-970d-ba99fe7ac5b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 10:14:59.452035 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:14:59.452035 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:14:59.452035 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:14:59.452035 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:14:59.452035 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:14:59.452035 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:14:59.452035 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:14:59.452035 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:14:59.452035 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:14:59.452035 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:14:59.452035 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:14:59.452035 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 10:14:59.452035 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 10:14:59.452035 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 10:14:59.452035 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 10:14:59.453139 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:14:59.453139 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:14:59.453139 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:14:59.453139 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:14:59.453139 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:14:59.453139 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:14:59.453139 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:14:59.453139 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Sep 19 10:14:59.453139 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:14:59.453139 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:14:59.453139 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:14:59.453139 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:14:59.453139 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:14:59.453139 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:14:59.453139 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:14:59.453139 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:14:59.453139 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 10:14:59.454037 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 10:14:59.454037 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 10:14:59.454037 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Sep 19 10:14:59.454037 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 544/1102] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 19 10:14:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:14:59.459260 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a064bc-2b33-4f4b-8563-7e902983f436 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:59.482754 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:59.558983 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a064bc-2b33-4f4b-8563-7e902983f436 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:59.599405 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921e0385-d8ce-40c0-8f60-38b2478d1bf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:59.600326 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921e0385-d8ce-40c0-8f60-38b2478d1bf9 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:59.600743 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921e0385-d8ce-40c0-8f60-38b2478d1bf9 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:59.601148 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921e0385-d8ce-40c0-8f60-38b2478d1bf9 None admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:59.602117 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921e0385-d8ce-40c0-8f60-38b2478d1bf9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:14:59.602581 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921e0385-d8ce-40c0-8f60-38b2478d1bf9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:59.604789 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921e0385-d8ce-40c0-8f60-38b2478d1bf9 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:59.617839 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 559/1103] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Sep 19 10:14:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:14:59.623821 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a84f35-a6d4-45af-970d-ba99fe7ac5b5 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:59.666885 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:59.729547 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a84f35-a6d4-45af-970d-ba99fe7ac5b5 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:59.762857 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7c60de-3663-4213-8b51-53f29fb8d197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:59.763481 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7c60de-3663-4213-8b51-53f29fb8d197 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:59.763764 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7c60de-3663-4213-8b51-53f29fb8d197 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:59.764038 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7c60de-3663-4213-8b51-53f29fb8d197 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:59.771446 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7c60de-3663-4213-8b51-53f29fb8d197 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:59.772834 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7c60de-3663-4213-8b51-53f29fb8d197 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:59.783981 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-ad7c60de-3663-4213-8b51-53f29fb8d197 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 10:14:59.783981 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:14:59.783981 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:14:59.783981 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:14:59.783981 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:14:59.783981 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:14:59.783981 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:14:59.783981 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:14:59.783981 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:14:59.783981 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:14:59.783981 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:14:59.783981 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:14:59.783981 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 10:14:59.783981 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 10:14:59.783981 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 10:14:59.784925 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 10:14:59.784925 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:14:59.784925 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:14:59.784925 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:14:59.784925 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:14:59.784925 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:14:59.784925 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:14:59.784925 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:14:59.784925 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Sep 19 10:14:59.784925 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:14:59.784925 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:14:59.784925 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:14:59.784925 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:14:59.784925 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:14:59.784925 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:14:59.784925 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:14:59.784925 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:14:59.785828 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 10:14:59.785828 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 10:14:59.785828 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 10:14:59.785828 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 10:14:59.785828 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 10:14:59.785828 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 10:14:59.785828 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 10:14:59.785828 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Sep 19 10:14:59.785828 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 545/1104] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Sep 19 10:14:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:14:59.790864 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921e0385-d8ce-40c0-8f60-38b2478d1bf9 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:14:59.869676 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:14:59.887397 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921e0385-d8ce-40c0-8f60-38b2478d1bf9 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:14:59.924571 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f49c1c2-13e9-4151-8936-78707aef5cdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:14:59.925177 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f49c1c2-13e9-4151-8936-78707aef5cdb None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:14:59.925456 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f49c1c2-13e9-4151-8936-78707aef5cdb None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:14:59.925725 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f49c1c2-13e9-4151-8936-78707aef5cdb None admin] PATH_INFO: `/v3/projects` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:14:59.926406 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f49c1c2-13e9-4151-8936-78707aef5cdb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:14:59.926708 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f49c1c2-13e9-4151-8936-78707aef5cdb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:14:59.928131 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f49c1c2-13e9-4151-8936-78707aef5cdb None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:14:59.940576 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 560/1105] 10.222.0.66 () {56 vars in 1148 bytes} [Mon Sep 19 10:14:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:14:59.946543 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7c60de-3663-4213-8b51-53f29fb8d197 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:15:00.042725 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:15:00.046051 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7c60de-3663-4213-8b51-53f29fb8d197 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:15:00.080350 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c270b3-01e8-436f-b7ea-ea185090ef38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:15:00.080957 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c270b3-01e8-436f-b7ea-ea185090ef38 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:15:00.081237 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c270b3-01e8-436f-b7ea-ea185090ef38 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:15:00.081509 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c270b3-01e8-436f-b7ea-ea185090ef38 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:15:00.082231 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c270b3-01e8-436f-b7ea-ea185090ef38 None admin] RBAC: Adding query filter params (role.id=89dc9467e2a84e2e9602562960b6668f, scope.project.id=be6b93ef3359434d9c776343f0aea333, user.id=15c70bfb085a44e9b84942b480ff22f1) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:15:00.082540 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c270b3-01e8-436f-b7ea-ea185090ef38 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:15:00.083981 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c270b3-01e8-436f-b7ea-ea185090ef38 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:15:00.089717 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 546/1106] 10.222.0.66 () {56 vars in 1374 bytes} [Mon Sep 19 10:14:59 2022] GET /identity/v3/role_assignments?user.id=15c70bfb085a44e9b84942b480ff22f1&scope.project.id=be6b93ef3359434d9c776343f0aea333&role.id=89dc9467e2a84e2e9602562960b6668f => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 10:15:01.016181 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f48f17b-6b5c-4811-ab7f-889a0972ff9d None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:15:01.016706 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f48f17b-6b5c-4811-ab7f-889a0972ff9d None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:15:01.016706 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f48f17b-6b5c-4811-ab7f-889a0972ff9d None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:15:01.017997 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 561/1107] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:15:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:15:01.023300 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc75c0b-bf7c-4e3b-b63d-6bd0de7cc093 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:15:01.023707 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc75c0b-bf7c-4e3b-b63d-6bd0de7cc093 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:15:01.023861 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc75c0b-bf7c-4e3b-b63d-6bd0de7cc093 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:15:01.046474 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-cdc75c0b-bf7c-4e3b-b63d-6bd0de7cc093 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:15:01.047811 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-cdc75c0b-bf7c-4e3b-b63d-6bd0de7cc093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:15:01.112846 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 547/1108] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:15:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 10:15:01.382453 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f48f17b-6b5c-4811-ab7f-889a0972ff9d None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:15:01.483427 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f48f17b-6b5c-4811-ab7f-889a0972ff9d None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:15:01.515409 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1405fa-3fa7-4d7c-af4f-c413984f2e4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:15:01.516026 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1405fa-3fa7-4d7c-af4f-c413984f2e4c None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:15:01.516330 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1405fa-3fa7-4d7c-af4f-c413984f2e4c None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:15:01.516604 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1405fa-3fa7-4d7c-af4f-c413984f2e4c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:15:01.518225 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1405fa-3fa7-4d7c-af4f-c413984f2e4c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:15:01.519644 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1405fa-3fa7-4d7c-af4f-c413984f2e4c None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:15:01.521238 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 562/1109] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 19 10:15:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:15:01.527036 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc75c0b-bf7c-4e3b-b63d-6bd0de7cc093 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:15:01.617080 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:15:01.624667 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc75c0b-bf7c-4e3b-b63d-6bd0de7cc093 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:15:01.658087 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36685eb5-c3a1-4a89-96ce-f968b2b0cef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:15:01.659236 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36685eb5-c3a1-4a89-96ce-f968b2b0cef9 None admin] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:15:01.659519 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36685eb5-c3a1-4a89-96ce-f968b2b0cef9 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:15:01.659787 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36685eb5-c3a1-4a89-96ce-f968b2b0cef9 None admin] PATH_INFO: `/v3/users` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:15:01.660471 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36685eb5-c3a1-4a89-96ce-f968b2b0cef9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:15:01.661904 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36685eb5-c3a1-4a89-96ce-f968b2b0cef9 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:15:01.682291 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 548/1110] 10.222.0.66 () {60 vars in 1132 bytes} [Mon Sep 19 10:15:01 2022] POST /identity/v3/users => generated 286 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:15:03.862302 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcac1655-3355-4d23-9d02-8e9de5ac5e62 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:15:03.862821 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcac1655-3355-4d23-9d02-8e9de5ac5e62 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:15:03.862821 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcac1655-3355-4d23-9d02-8e9de5ac5e62 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:15:03.864184 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 563/1111] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:15:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:15:03.869510 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d9f11d-c4c3-4616-b977-01b1d47dfe93 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:15:03.869926 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d9f11d-c4c3-4616-b977-01b1d47dfe93 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:15:03.870072 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d9f11d-c4c3-4616-b977-01b1d47dfe93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:15:03.888534 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-31d9f11d-c4c3-4616-b977-01b1d47dfe93 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:15:03.889726 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-31d9f11d-c4c3-4616-b977-01b1d47dfe93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:15:03.955655 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 549/1112] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:15:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 10:15:04.222101 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcac1655-3355-4d23-9d02-8e9de5ac5e62 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:15:04.234173 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:15:04.324042 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcac1655-3355-4d23-9d02-8e9de5ac5e62 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:15:04.357140 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffc118b-5ab8-4c23-b26e-e781b6203007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:15:04.357754 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffc118b-5ab8-4c23-b26e-e781b6203007 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:15:04.358028 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffc118b-5ab8-4c23-b26e-e781b6203007 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:15:04.358298 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffc118b-5ab8-4c23-b26e-e781b6203007 None admin] PATH_INFO: `/v3/roles/43fe0942f9c9486ca3e7c83be55eb915` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:15:04.359658 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffc118b-5ab8-4c23-b26e-e781b6203007 None admin] RBAC: Authorizing `identity:get_role(role_id=43fe0942f9c9486ca3e7c83be55eb915)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:15:04.361024 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffc118b-5ab8-4c23-b26e-e781b6203007 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:15:04.362343 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 564/1113] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Sep 19 10:15:04 2022] GET /identity/v3/roles/43fe0942f9c9486ca3e7c83be55eb915 => generated 223 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:15:04.368325 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d9f11d-c4c3-4616-b977-01b1d47dfe93 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:15:04.448114 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:15:04.467358 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d9f11d-c4c3-4616-b977-01b1d47dfe93 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:15:04.500444 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3da00ca-2f66-4e16-8605-df448db86d55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:15:04.501002 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3da00ca-2f66-4e16-8605-df448db86d55 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:15:04.501287 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3da00ca-2f66-4e16-8605-df448db86d55 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:15:04.501562 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3da00ca-2f66-4e16-8605-df448db86d55 None admin] PATH_INFO: `/v3/users/295372c869824ad796718cda3c61790d` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:15:04.514906 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3da00ca-2f66-4e16-8605-df448db86d55 None admin] RBAC: Authorizing `identity:get_user(user_id=295372c869824ad796718cda3c61790d)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:15:04.516435 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3da00ca-2f66-4e16-8605-df448db86d55 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:15:04.518063 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 550/1114] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Sep 19 10:15:04 2022] GET /identity/v3/users/295372c869824ad796718cda3c61790d => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:15:04.524092 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffc118b-5ab8-4c23-b26e-e781b6203007 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:15:04.599872 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:15:04.621198 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffc118b-5ab8-4c23-b26e-e781b6203007 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:15:04.654254 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140c881b-3362-461b-bdfc-9cfbbf5ac0f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:15:04.654858 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140c881b-3362-461b-bdfc-9cfbbf5ac0f4 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:15:04.655138 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140c881b-3362-461b-bdfc-9cfbbf5ac0f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:15:04.655413 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140c881b-3362-461b-bdfc-9cfbbf5ac0f4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:15:04.720289 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140c881b-3362-461b-bdfc-9cfbbf5ac0f4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:15:04.721783 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140c881b-3362-461b-bdfc-9cfbbf5ac0f4 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:15:04.795855 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:15:04.817913 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 565/1115] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Sep 19 10:15:04 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 19 10:15:04.823959 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3da00ca-2f66-4e16-8605-df448db86d55 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:15:04.921213 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3da00ca-2f66-4e16-8605-df448db86d55 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:15:04.954165 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959ce2ec-bc9e-4c32-a394-d33d8a825a8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:15:04.954782 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959ce2ec-bc9e-4c32-a394-d33d8a825a8a None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:15:04.955090 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959ce2ec-bc9e-4c32-a394-d33d8a825a8a None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:15:04.955367 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959ce2ec-bc9e-4c32-a394-d33d8a825a8a None admin] PATH_INFO: `/v3/projects/fe2188a065ee4bf0b443e4d3f5f17ecb` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:15:04.956500 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959ce2ec-bc9e-4c32-a394-d33d8a825a8a None admin] RBAC: Authorizing `identity:get_project(project_id=fe2188a065ee4bf0b443e4d3f5f17ecb)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:15:04.957945 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959ce2ec-bc9e-4c32-a394-d33d8a825a8a None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:15:04.959565 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 551/1116] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Sep 19 10:15:04 2022] GET /identity/v3/projects/fe2188a065ee4bf0b443e4d3f5f17ecb => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:15:04.965947 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140c881b-3362-461b-bdfc-9cfbbf5ac0f4 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:15:05.065914 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140c881b-3362-461b-bdfc-9cfbbf5ac0f4 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:15:05.101671 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a0f75d-b989-4ab3-8a42-da00926ad8c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:15:05.102269 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a0f75d-b989-4ab3-8a42-da00926ad8c7 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:15:05.102554 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a0f75d-b989-4ab3-8a42-da00926ad8c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:15:05.102834 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a0f75d-b989-4ab3-8a42-da00926ad8c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:15:05.103549 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a0f75d-b989-4ab3-8a42-da00926ad8c7 None admin] RBAC: Adding query filter params (role.id=43fe0942f9c9486ca3e7c83be55eb915, scope.project.id=fe2188a065ee4bf0b443e4d3f5f17ecb, user.id=295372c869824ad796718cda3c61790d) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:15:05.103853 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a0f75d-b989-4ab3-8a42-da00926ad8c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:15:05.105305 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a0f75d-b989-4ab3-8a42-da00926ad8c7 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:15:05.110504 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 566/1117] 10.222.0.66 () {56 vars in 1374 bytes} [Mon Sep 19 10:15:04 2022] GET /identity/v3/role_assignments?user.id=295372c869824ad796718cda3c61790d&scope.project.id=fe2188a065ee4bf0b443e4d3f5f17ecb&role.id=43fe0942f9c9486ca3e7c83be55eb915 => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:15:07.222501 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e01e75-5120-4779-9e96-2456a827eecc None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:15:07.223060 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e01e75-5120-4779-9e96-2456a827eecc None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:15:07.223060 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e01e75-5120-4779-9e96-2456a827eecc None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:15:07.224422 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 552/1118] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:15:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:15:07.229744 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f9d97c-d0d4-40b8-aa02-a7509d903cef None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:15:07.230143 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f9d97c-d0d4-40b8-aa02-a7509d903cef None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:15:07.230288 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f9d97c-d0d4-40b8-aa02-a7509d903cef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:15:07.248114 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-55f9d97c-d0d4-40b8-aa02-a7509d903cef None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:15:07.249332 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-55f9d97c-d0d4-40b8-aa02-a7509d903cef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:15:07.285239 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:15:07.317594 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 567/1119] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:15:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 10:15:07.582614 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e01e75-5120-4779-9e96-2456a827eecc None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:15:07.591534 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:15:07.683831 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e01e75-5120-4779-9e96-2456a827eecc None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:15:07.717489 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce27ae5-7686-458a-8f1c-62f034f62ce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:15:07.718100 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce27ae5-7686-458a-8f1c-62f034f62ce7 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:15:07.718378 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce27ae5-7686-458a-8f1c-62f034f62ce7 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:15:07.718648 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce27ae5-7686-458a-8f1c-62f034f62ce7 None admin] PATH_INFO: `/v3/roles/43fe0942f9c9486ca3e7c83be55eb915` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:15:07.720032 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce27ae5-7686-458a-8f1c-62f034f62ce7 None admin] RBAC: Authorizing `identity:get_role(role_id=43fe0942f9c9486ca3e7c83be55eb915)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:15:07.721463 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce27ae5-7686-458a-8f1c-62f034f62ce7 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:15:07.722772 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 553/1120] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Sep 19 10:15:07 2022] GET /identity/v3/roles/43fe0942f9c9486ca3e7c83be55eb915 => generated 223 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:15:07.728755 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f9d97c-d0d4-40b8-aa02-a7509d903cef None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:15:07.823394 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f9d97c-d0d4-40b8-aa02-a7509d903cef None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:15:07.855950 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa50d516-feb5-4202-b8a7-d18cc0105ade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:15:07.856531 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa50d516-feb5-4202-b8a7-d18cc0105ade None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:15:07.856809 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa50d516-feb5-4202-b8a7-d18cc0105ade None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:15:07.857080 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa50d516-feb5-4202-b8a7-d18cc0105ade None admin] PATH_INFO: `/v3/users/295372c869824ad796718cda3c61790d` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:15:07.858208 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa50d516-feb5-4202-b8a7-d18cc0105ade None admin] RBAC: Authorizing `identity:get_user(user_id=295372c869824ad796718cda3c61790d)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:15:07.859639 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa50d516-feb5-4202-b8a7-d18cc0105ade None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:15:07.861849 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 568/1121] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Sep 19 10:15:07 2022] GET /identity/v3/users/295372c869824ad796718cda3c61790d => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:15:07.867722 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce27ae5-7686-458a-8f1c-62f034f62ce7 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:15:07.941532 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:15:07.965599 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce27ae5-7686-458a-8f1c-62f034f62ce7 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:15:07.998559 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7564d06-d9ab-4481-b2cd-152f9e4a2da0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:15:07.999185 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7564d06-d9ab-4481-b2cd-152f9e4a2da0 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:15:07.999470 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7564d06-d9ab-4481-b2cd-152f9e4a2da0 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:15:07.999752 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7564d06-d9ab-4481-b2cd-152f9e4a2da0 None admin] PATH_INFO: `/v3/projects/fe2188a065ee4bf0b443e4d3f5f17ecb` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:15:08.000940 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7564d06-d9ab-4481-b2cd-152f9e4a2da0 None admin] RBAC: Authorizing `identity:get_project(project_id=fe2188a065ee4bf0b443e4d3f5f17ecb)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:15:08.002404 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7564d06-d9ab-4481-b2cd-152f9e4a2da0 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:15:08.004024 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 554/1122] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Sep 19 10:15:07 2022] GET /identity/v3/projects/fe2188a065ee4bf0b443e4d3f5f17ecb => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:15:08.010060 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa50d516-feb5-4202-b8a7-d18cc0105ade None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:15:08.051653 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:15:08.106092 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa50d516-feb5-4202-b8a7-d18cc0105ade None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:15:08.139215 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63df494c-1cf8-4ed3-aa5d-98218ceaaaaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:15:08.139863 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63df494c-1cf8-4ed3-aa5d-98218ceaaaaf None admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:15:08.140139 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63df494c-1cf8-4ed3-aa5d-98218ceaaaaf None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:15:08.140443 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63df494c-1cf8-4ed3-aa5d-98218ceaaaaf None admin] PATH_INFO: `/v3/projects/fe2188a065ee4bf0b443e4d3f5f17ecb/users/295372c869824ad796718cda3c61790d/roles/43fe0942f9c9486ca3e7c83be55eb915` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:15:08.143091 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63df494c-1cf8-4ed3-aa5d-98218ceaaaaf None admin] RBAC: Authorizing `identity:create_grant(project_id=fe2188a065ee4bf0b443e4d3f5f17ecb, user_id=295372c869824ad796718cda3c61790d, role_id=43fe0942f9c9486ca3e7c83be55eb915)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:15:08.144535 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63df494c-1cf8-4ed3-aa5d-98218ceaaaaf None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:15:08.156853 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 569/1123] 10.222.0.66 () {58 vars in 1439 bytes} [Mon Sep 19 10:15:08 2022] PUT /identity/v3/projects/fe2188a065ee4bf0b443e4d3f5f17ecb/users/295372c869824ad796718cda3c61790d/roles/43fe0942f9c9486ca3e7c83be55eb915 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:15:10.290899 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4da0f38-7666-4a90-bccb-67dc52c5ef03 None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:15:10.291431 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4da0f38-7666-4a90-bccb-67dc52c5ef03 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:15:10.291431 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4da0f38-7666-4a90-bccb-67dc52c5ef03 None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:15:10.292810 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 555/1124] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:15:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:15:10.298184 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a789afee-7f8a-4198-b9b6-e3ba1cfd449a None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:15:10.298607 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a789afee-7f8a-4198-b9b6-e3ba1cfd449a None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:15:10.298771 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a789afee-7f8a-4198-b9b6-e3ba1cfd449a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:15:10.316928 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-a789afee-7f8a-4198-b9b6-e3ba1cfd449a None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:15:10.318122 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-a789afee-7f8a-4198-b9b6-e3ba1cfd449a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:15:10.381196 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 570/1125] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:15:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 10:15:10.648022 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4da0f38-7666-4a90-bccb-67dc52c5ef03 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:15:10.752809 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4da0f38-7666-4a90-bccb-67dc52c5ef03 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:15:10.785652 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e02449-c17e-4b10-8aa8-d953f781da95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:15:10.786277 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e02449-c17e-4b10-8aa8-d953f781da95 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:15:10.786558 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e02449-c17e-4b10-8aa8-d953f781da95 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:15:10.786833 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e02449-c17e-4b10-8aa8-d953f781da95 None admin] PATH_INFO: `/v3/roles/43fe0942f9c9486ca3e7c83be55eb915` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:15:10.788234 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e02449-c17e-4b10-8aa8-d953f781da95 None admin] RBAC: Authorizing `identity:get_role(role_id=43fe0942f9c9486ca3e7c83be55eb915)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:15:10.789607 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e02449-c17e-4b10-8aa8-d953f781da95 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:15:10.790910 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 556/1126] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Sep 19 10:15:10 2022] GET /identity/v3/roles/43fe0942f9c9486ca3e7c83be55eb915 => generated 223 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:15:10.797109 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a789afee-7f8a-4198-b9b6-e3ba1cfd449a None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:15:10.827111 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:15:10.895088 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a789afee-7f8a-4198-b9b6-e3ba1cfd449a None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:15:10.929570 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3961a8-1b69-42ae-995a-534cf25c7500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:15:10.929994 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3961a8-1b69-42ae-995a-534cf25c7500 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:15:10.930276 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3961a8-1b69-42ae-995a-534cf25c7500 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:15:10.930554 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3961a8-1b69-42ae-995a-534cf25c7500 None admin] PATH_INFO: `/v3/users/295372c869824ad796718cda3c61790d` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:15:10.931683 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3961a8-1b69-42ae-995a-534cf25c7500 None admin] RBAC: Authorizing `identity:get_user(user_id=295372c869824ad796718cda3c61790d)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:15:10.933150 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3961a8-1b69-42ae-995a-534cf25c7500 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:15:10.934739 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 571/1127] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Sep 19 10:15:10 2022] GET /identity/v3/users/295372c869824ad796718cda3c61790d => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:15:10.940605 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e02449-c17e-4b10-8aa8-d953f781da95 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:15:10.953093 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:15:11.037685 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e02449-c17e-4b10-8aa8-d953f781da95 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:15:11.070352 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc77855d-0a75-4ed4-99c0-63dc42729cb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:15:11.070945 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc77855d-0a75-4ed4-99c0-63dc42729cb3 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:15:11.071227 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc77855d-0a75-4ed4-99c0-63dc42729cb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:15:11.071501 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc77855d-0a75-4ed4-99c0-63dc42729cb3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:15:11.139406 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc77855d-0a75-4ed4-99c0-63dc42729cb3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:15:11.140888 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc77855d-0a75-4ed4-99c0-63dc42729cb3 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:15:11.152136 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:15:11.237114 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 557/1128] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Sep 19 10:15:10 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 19 10:15:11.242918 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3961a8-1b69-42ae-995a-534cf25c7500 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:15:11.336142 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:15:11.340466 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3961a8-1b69-42ae-995a-534cf25c7500 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:15:11.374040 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7dcfd8-5147-4b27-ab5c-418e12c4e368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:15:11.374662 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7dcfd8-5147-4b27-ab5c-418e12c4e368 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:15:11.374944 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7dcfd8-5147-4b27-ab5c-418e12c4e368 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:15:11.375220 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7dcfd8-5147-4b27-ab5c-418e12c4e368 None admin] PATH_INFO: `/v3/projects/fe2188a065ee4bf0b443e4d3f5f17ecb` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:15:11.376357 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7dcfd8-5147-4b27-ab5c-418e12c4e368 None admin] RBAC: Authorizing `identity:get_project(project_id=fe2188a065ee4bf0b443e4d3f5f17ecb)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:15:11.377829 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7dcfd8-5147-4b27-ab5c-418e12c4e368 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:15:11.379450 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 572/1129] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Sep 19 10:15:11 2022] GET /identity/v3/projects/fe2188a065ee4bf0b443e4d3f5f17ecb => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:15:11.385805 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc77855d-0a75-4ed4-99c0-63dc42729cb3 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:15:11.482945 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc77855d-0a75-4ed4-99c0-63dc42729cb3 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:15:11.495642 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:15:11.519194 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346f630c-a346-427d-bf32-16daf99f46f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:15:11.519873 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346f630c-a346-427d-bf32-16daf99f46f1 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:15:11.520155 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346f630c-a346-427d-bf32-16daf99f46f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:15:11.520454 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346f630c-a346-427d-bf32-16daf99f46f1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:15:11.521162 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346f630c-a346-427d-bf32-16daf99f46f1 None admin] RBAC: Adding query filter params (role.id=43fe0942f9c9486ca3e7c83be55eb915, scope.project.id=fe2188a065ee4bf0b443e4d3f5f17ecb, user.id=295372c869824ad796718cda3c61790d) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:15:11.521466 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346f630c-a346-427d-bf32-16daf99f46f1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:15:11.522893 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346f630c-a346-427d-bf32-16daf99f46f1 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:15:11.528454 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 558/1130] 10.222.0.66 () {56 vars in 1374 bytes} [Mon Sep 19 10:15:11 2022] GET /identity/v3/role_assignments?user.id=295372c869824ad796718cda3c61790d&scope.project.id=fe2188a065ee4bf0b443e4d3f5f17ecb&role.id=43fe0942f9c9486ca3e7c83be55eb915 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:15:13.667706 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7759ad1e-cabe-4024-a4c1-8feb8f3e918a None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:15:13.668293 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7759ad1e-cabe-4024-a4c1-8feb8f3e918a None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:15:13.668293 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7759ad1e-cabe-4024-a4c1-8feb8f3e918a None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:15:13.669887 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 573/1131] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:15:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:15:13.675742 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae36f34-f721-44e1-9798-2a01dbdf4b9d None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:15:13.676154 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae36f34-f721-44e1-9798-2a01dbdf4b9d None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:15:13.676334 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae36f34-f721-44e1-9798-2a01dbdf4b9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:15:13.695430 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-5ae36f34-f721-44e1-9798-2a01dbdf4b9d None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:15:13.696667 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-5ae36f34-f721-44e1-9798-2a01dbdf4b9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:15:13.768799 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 559/1132] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:15:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 10:15:14.036334 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7759ad1e-cabe-4024-a4c1-8feb8f3e918a None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:15:14.134392 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7759ad1e-cabe-4024-a4c1-8feb8f3e918a None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:15:14.167088 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd1582e-650d-4427-bb6e-a1fdfd953d67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:15:14.167699 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd1582e-650d-4427-bb6e-a1fdfd953d67 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:15:14.167977 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd1582e-650d-4427-bb6e-a1fdfd953d67 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:15:14.168275 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd1582e-650d-4427-bb6e-a1fdfd953d67 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:15:14.169623 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd1582e-650d-4427-bb6e-a1fdfd953d67 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:15:14.171043 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd1582e-650d-4427-bb6e-a1fdfd953d67 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:15:14.172622 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 574/1133] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 19 10:15:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:15:14.178950 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae36f34-f721-44e1-9798-2a01dbdf4b9d None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:15:14.274859 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae36f34-f721-44e1-9798-2a01dbdf4b9d None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:15:14.277128 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:15:14.315292 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b859f5e3-a983-4767-8253-189ed8a45661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:15:14.315806 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b859f5e3-a983-4767-8253-189ed8a45661 None admin] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:15:14.316082 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b859f5e3-a983-4767-8253-189ed8a45661 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:15:14.316380 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b859f5e3-a983-4767-8253-189ed8a45661 None admin] PATH_INFO: `/v3/projects` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:15:14.317028 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b859f5e3-a983-4767-8253-189ed8a45661 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:15:14.318490 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b859f5e3-a983-4767-8253-189ed8a45661 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:15:14.344528 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 560/1134] 10.222.0.66 () {60 vars in 1141 bytes} [Mon Sep 19 10:15:14 2022] POST /identity/v3/projects => generated 311 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:15:16.508678 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c755af8-7c83-4ac1-bfa0-4212bc6ae525 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:15:16.509211 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c755af8-7c83-4ac1-bfa0-4212bc6ae525 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:15:16.509211 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c755af8-7c83-4ac1-bfa0-4212bc6ae525 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:15:16.510602 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 575/1135] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:15:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:15:16.515741 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de43284-1843-470b-80ea-13484af3f64a None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:15:16.516148 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de43284-1843-470b-80ea-13484af3f64a None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:15:16.516342 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de43284-1843-470b-80ea-13484af3f64a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:15:16.535101 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-9de43284-1843-470b-80ea-13484af3f64a None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:15:16.536297 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-9de43284-1843-470b-80ea-13484af3f64a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:15:16.599943 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 561/1136] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:15:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 10:15:16.871001 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c755af8-7c83-4ac1-bfa0-4212bc6ae525 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:15:16.908835 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:15:16.978524 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c755af8-7c83-4ac1-bfa0-4212bc6ae525 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:15:17.011631 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbf9190-df9c-456e-8e48-64c40786d2ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:15:17.012280 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbf9190-df9c-456e-8e48-64c40786d2ef None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:15:17.012566 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbf9190-df9c-456e-8e48-64c40786d2ef None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:15:17.012840 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbf9190-df9c-456e-8e48-64c40786d2ef None admin] PATH_INFO: `/v3/domains/default` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:15:17.013948 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbf9190-df9c-456e-8e48-64c40786d2ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:15:17.015380 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbf9190-df9c-456e-8e48-64c40786d2ef None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:15:17.017046 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 576/1137] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 19 10:15:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:15:17.023704 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de43284-1843-470b-80ea-13484af3f64a None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:15:17.105550 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:15:17.121386 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de43284-1843-470b-80ea-13484af3f64a None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:15:17.158809 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9beb60-c233-4fd1-8e42-b2c9c2c0754f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:15:17.159417 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9beb60-c233-4fd1-8e42-b2c9c2c0754f None admin] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:15:17.159700 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9beb60-c233-4fd1-8e42-b2c9c2c0754f None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:15:17.159981 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9beb60-c233-4fd1-8e42-b2c9c2c0754f None admin] PATH_INFO: `/v3/users` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:15:17.160652 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9beb60-c233-4fd1-8e42-b2c9c2c0754f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:15:17.162074 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9beb60-c233-4fd1-8e42-b2c9c2c0754f None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:15:17.183140 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 562/1138] 10.222.0.66 () {60 vars in 1132 bytes} [Mon Sep 19 10:15:17 2022] POST /identity/v3/users => generated 286 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:15:19.358405 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8959934c-5ed1-4b4a-99d2-1087582ca5e2 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:15:19.358961 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8959934c-5ed1-4b4a-99d2-1087582ca5e2 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:15:19.358961 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8959934c-5ed1-4b4a-99d2-1087582ca5e2 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:15:19.360279 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 577/1139] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:15:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:15:19.366240 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b8ae2c-f7f4-404d-8fed-1ba61c97c88c None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:15:19.366675 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b8ae2c-f7f4-404d-8fed-1ba61c97c88c None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:15:19.366775 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b8ae2c-f7f4-404d-8fed-1ba61c97c88c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:15:19.384722 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-02b8ae2c-f7f4-404d-8fed-1ba61c97c88c None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:15:19.385914 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-02b8ae2c-f7f4-404d-8fed-1ba61c97c88c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:15:19.454288 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 563/1140] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:15:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 10:15:19.731022 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8959934c-5ed1-4b4a-99d2-1087582ca5e2 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:15:19.829784 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8959934c-5ed1-4b4a-99d2-1087582ca5e2 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:15:19.831238 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:15:19.863827 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a09df32-d463-4a58-914a-6a54e4e44c30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:15:19.864477 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a09df32-d463-4a58-914a-6a54e4e44c30 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:15:19.864752 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a09df32-d463-4a58-914a-6a54e4e44c30 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:15:19.865017 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a09df32-d463-4a58-914a-6a54e4e44c30 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:15:19.874826 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a09df32-d463-4a58-914a-6a54e4e44c30 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 10:15:19.879619 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-8a09df32-d463-4a58-914a-6a54e4e44c30 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 10:15:19.879619 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:15:19.879619 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:15:19.879619 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:15:19.879619 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:15:19.879619 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:15:19.879619 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:15:19.879619 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:15:19.879619 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:15:19.879619 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:15:19.879619 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:15:19.879619 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:15:19.879619 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 10:15:19.879619 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 10:15:19.879619 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 10:15:19.879619 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 10:15:19.880766 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 10:15:19.880766 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 10:15:19.880766 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 10:15:19.880766 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 10:15:19.880766 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:15:19.880766 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:15:19.880766 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:15:19.880766 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:15:19.880766 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:15:19.880766 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:15:19.880766 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:15:19.880766 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 19 10:15:19.880766 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:15:19.880766 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:15:19.880766 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:15:19.880766 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:15:19.881829 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:15:19.881829 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:15:19.881829 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:15:19.881829 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:15:19.881829 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 10:15:19.881829 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 10:15:19.881829 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 10:15:19.881829 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 10:15:19.881829 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 10:15:19.881829 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 10:15:19.881829 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 10:15:19.881829 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 19 10:15:19.881829 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 578/1141] 10.222.0.66 () {56 vars in 1096 bytes} [Mon Sep 19 10:15:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:15:19.887086 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b8ae2c-f7f4-404d-8fed-1ba61c97c88c None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:15:19.957096 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:15:19.987963 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b8ae2c-f7f4-404d-8fed-1ba61c97c88c None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:15:20.020072 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d451df14-5031-437f-b97d-c6d87b6ab4c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:15:20.020699 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d451df14-5031-437f-b97d-c6d87b6ab4c7 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:15:20.020980 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d451df14-5031-437f-b97d-c6d87b6ab4c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:15:20.021254 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d451df14-5031-437f-b97d-c6d87b6ab4c7 None admin] PATH_INFO: `/v3/roles` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:15:20.021908 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d451df14-5031-437f-b97d-c6d87b6ab4c7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:15:20.022212 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d451df14-5031-437f-b97d-c6d87b6ab4c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:15:20.023622 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d451df14-5031-437f-b97d-c6d87b6ab4c7 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:15:20.031315 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 564/1142] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Sep 19 10:15:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:15:20.037830 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a09df32-d463-4a58-914a-6a54e4e44c30 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:15:20.133163 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a09df32-d463-4a58-914a-6a54e4e44c30 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:15:20.166591 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c899be1e-fdef-46e0-afd7-6687cf64580c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:15:20.167210 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c899be1e-fdef-46e0-afd7-6687cf64580c None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:15:20.167491 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c899be1e-fdef-46e0-afd7-6687cf64580c None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:15:20.167765 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c899be1e-fdef-46e0-afd7-6687cf64580c None admin] PATH_INFO: `/v3/users/4324a0164f6c49eba68ae60f08a73ff1` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:15:20.180669 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c899be1e-fdef-46e0-afd7-6687cf64580c None admin] RBAC: Authorizing `identity:get_user(user_id=4324a0164f6c49eba68ae60f08a73ff1)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:15:20.182113 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c899be1e-fdef-46e0-afd7-6687cf64580c None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:15:20.183703 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 579/1143] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Sep 19 10:15:20 2022] GET /identity/v3/users/4324a0164f6c49eba68ae60f08a73ff1 => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:15:20.189519 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d451df14-5031-437f-b97d-c6d87b6ab4c7 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:15:20.286531 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d451df14-5031-437f-b97d-c6d87b6ab4c7 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:15:20.318944 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48be6df-d93d-4a14-b582-a0d4ba136e04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:15:20.319543 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48be6df-d93d-4a14-b582-a0d4ba136e04 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:15:20.319823 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48be6df-d93d-4a14-b582-a0d4ba136e04 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:15:20.320098 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48be6df-d93d-4a14-b582-a0d4ba136e04 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:15:20.322634 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:15:20.386206 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48be6df-d93d-4a14-b582-a0d4ba136e04 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:15:20.387655 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48be6df-d93d-4a14-b582-a0d4ba136e04 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:15:20.488638 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 565/1144] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Sep 19 10:15:20 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 19 10:15:20.494614 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c899be1e-fdef-46e0-afd7-6687cf64580c None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:15:20.515486 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:15:20.592368 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c899be1e-fdef-46e0-afd7-6687cf64580c None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:15:20.625031 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf8313b-58ad-4013-aa41-4ff8de7ac9df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:15:20.625656 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf8313b-58ad-4013-aa41-4ff8de7ac9df None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:15:20.625937 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf8313b-58ad-4013-aa41-4ff8de7ac9df None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:15:20.626698 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf8313b-58ad-4013-aa41-4ff8de7ac9df None admin] PATH_INFO: `/v3/projects/94e23e1db0de437b907e5c536f21f970` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:15:20.627808 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf8313b-58ad-4013-aa41-4ff8de7ac9df None admin] RBAC: Authorizing `identity:get_project(project_id=94e23e1db0de437b907e5c536f21f970)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:15:20.629269 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf8313b-58ad-4013-aa41-4ff8de7ac9df None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:15:20.630898 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 580/1145] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Sep 19 10:15:20 2022] GET /identity/v3/projects/94e23e1db0de437b907e5c536f21f970 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:15:20.637073 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48be6df-d93d-4a14-b582-a0d4ba136e04 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:15:20.672825 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:15:20.737700 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48be6df-d93d-4a14-b582-a0d4ba136e04 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:15:20.770984 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836cd770-7fbf-4d5d-93f1-b0ec679f5c44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:15:20.771583 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836cd770-7fbf-4d5d-93f1-b0ec679f5c44 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:15:20.771862 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836cd770-7fbf-4d5d-93f1-b0ec679f5c44 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:15:20.772133 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836cd770-7fbf-4d5d-93f1-b0ec679f5c44 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:15:20.772879 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836cd770-7fbf-4d5d-93f1-b0ec679f5c44 None admin] RBAC: Adding query filter params (role.id=5c8b89fae4fa45bd944cbeaf442136e1, scope.project.id=94e23e1db0de437b907e5c536f21f970, user.id=4324a0164f6c49eba68ae60f08a73ff1) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:15:20.773186 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836cd770-7fbf-4d5d-93f1-b0ec679f5c44 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:15:20.774617 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836cd770-7fbf-4d5d-93f1-b0ec679f5c44 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:15:20.779792 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 566/1146] 10.222.0.66 () {56 vars in 1374 bytes} [Mon Sep 19 10:15:20 2022] GET /identity/v3/role_assignments?user.id=4324a0164f6c49eba68ae60f08a73ff1&scope.project.id=94e23e1db0de437b907e5c536f21f970&role.id=5c8b89fae4fa45bd944cbeaf442136e1 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:15:22.873212 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dcdcb6-d860-44da-8da7-dfb840d592cf None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:15:22.873798 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dcdcb6-d860-44da-8da7-dfb840d592cf None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:15:22.873798 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dcdcb6-d860-44da-8da7-dfb840d592cf None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:15:22.875078 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 581/1147] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:15:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:15:22.880716 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130bc6a8-ed92-46ec-aabe-f2024d094e6a None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:15:22.881125 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130bc6a8-ed92-46ec-aabe-f2024d094e6a None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:15:22.881297 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130bc6a8-ed92-46ec-aabe-f2024d094e6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:15:22.899809 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-130bc6a8-ed92-46ec-aabe-f2024d094e6a None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:15:22.901042 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-130bc6a8-ed92-46ec-aabe-f2024d094e6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:15:22.966492 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 567/1148] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:15:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 10:15:23.232689 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dcdcb6-d860-44da-8da7-dfb840d592cf None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:15:23.316834 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:15:23.329713 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dcdcb6-d860-44da-8da7-dfb840d592cf None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:15:23.362389 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d01697-9b63-4b2c-8fd1-5c03d8f07ce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:15:23.363007 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d01697-9b63-4b2c-8fd1-5c03d8f07ce9 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:15:23.363287 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d01697-9b63-4b2c-8fd1-5c03d8f07ce9 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:15:23.363560 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d01697-9b63-4b2c-8fd1-5c03d8f07ce9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:15:23.373236 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d01697-9b63-4b2c-8fd1-5c03d8f07ce9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 10:15:23.378571 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-32d01697-9b63-4b2c-8fd1-5c03d8f07ce9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 10:15:23.378571 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:15:23.378571 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:15:23.378571 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:15:23.378571 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:15:23.378571 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:15:23.378571 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:15:23.378571 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:15:23.378571 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:15:23.378571 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:15:23.378571 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:15:23.378571 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:15:23.378571 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 10:15:23.378571 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 10:15:23.378571 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 10:15:23.378571 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 10:15:23.379769 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 10:15:23.379769 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 10:15:23.379769 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 10:15:23.379769 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 10:15:23.379769 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:15:23.379769 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:15:23.379769 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:15:23.379769 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:15:23.379769 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:15:23.379769 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:15:23.379769 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:15:23.379769 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 19 10:15:23.379769 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:15:23.379769 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:15:23.379769 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:15:23.379769 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:15:23.380949 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:15:23.380949 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:15:23.380949 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:15:23.380949 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:15:23.380949 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 10:15:23.380949 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 10:15:23.380949 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 10:15:23.380949 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 10:15:23.380949 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 10:15:23.380949 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 10:15:23.380949 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 10:15:23.380949 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 19 10:15:23.380949 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 582/1149] 10.222.0.66 () {56 vars in 1096 bytes} [Mon Sep 19 10:15:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:15:23.385735 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130bc6a8-ed92-46ec-aabe-f2024d094e6a None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:15:23.412204 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:15:23.482283 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130bc6a8-ed92-46ec-aabe-f2024d094e6a None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:15:23.515893 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9ef9fc-3429-4e7e-858c-382b11cfcb89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:15:23.516479 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9ef9fc-3429-4e7e-858c-382b11cfcb89 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:15:23.516758 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9ef9fc-3429-4e7e-858c-382b11cfcb89 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:15:23.517025 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9ef9fc-3429-4e7e-858c-382b11cfcb89 None admin] PATH_INFO: `/v3/roles` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:15:23.517677 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9ef9fc-3429-4e7e-858c-382b11cfcb89 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:15:23.517977 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9ef9fc-3429-4e7e-858c-382b11cfcb89 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:15:23.519405 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9ef9fc-3429-4e7e-858c-382b11cfcb89 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:15:23.527199 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 568/1150] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Sep 19 10:15:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:15:23.533217 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d01697-9b63-4b2c-8fd1-5c03d8f07ce9 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:15:23.629455 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d01697-9b63-4b2c-8fd1-5c03d8f07ce9 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:15:23.662738 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16594cd0-b2a6-4eec-a760-08d7732d8cd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:15:23.663358 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16594cd0-b2a6-4eec-a760-08d7732d8cd1 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:15:23.663636 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16594cd0-b2a6-4eec-a760-08d7732d8cd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:15:23.663911 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16594cd0-b2a6-4eec-a760-08d7732d8cd1 None admin] PATH_INFO: `/v3/users/4324a0164f6c49eba68ae60f08a73ff1` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:15:23.665784 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16594cd0-b2a6-4eec-a760-08d7732d8cd1 None admin] RBAC: Authorizing `identity:get_user(user_id=4324a0164f6c49eba68ae60f08a73ff1)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:15:23.667131 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16594cd0-b2a6-4eec-a760-08d7732d8cd1 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:15:23.668760 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 583/1151] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Sep 19 10:15:23 2022] GET /identity/v3/users/4324a0164f6c49eba68ae60f08a73ff1 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:15:23.675378 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9ef9fc-3429-4e7e-858c-382b11cfcb89 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:15:23.767463 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:15:23.777397 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9ef9fc-3429-4e7e-858c-382b11cfcb89 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:15:23.811328 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f19d50f-2f71-4635-8acb-51c3a4cd1a19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:15:23.811955 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f19d50f-2f71-4635-8acb-51c3a4cd1a19 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:15:23.812265 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f19d50f-2f71-4635-8acb-51c3a4cd1a19 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:15:23.812545 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f19d50f-2f71-4635-8acb-51c3a4cd1a19 None admin] PATH_INFO: `/v3/projects/94e23e1db0de437b907e5c536f21f970` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:15:23.813718 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f19d50f-2f71-4635-8acb-51c3a4cd1a19 None admin] RBAC: Authorizing `identity:get_project(project_id=94e23e1db0de437b907e5c536f21f970)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:15:23.815159 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f19d50f-2f71-4635-8acb-51c3a4cd1a19 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:15:23.816818 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 569/1152] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Sep 19 10:15:23 2022] GET /identity/v3/projects/94e23e1db0de437b907e5c536f21f970 => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:15:23.822927 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16594cd0-b2a6-4eec-a760-08d7732d8cd1 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:15:23.844156 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:15:23.923732 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16594cd0-b2a6-4eec-a760-08d7732d8cd1 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:15:23.957070 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdef5f7-4d19-4029-a50f-79b1ca42ea22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:15:23.957713 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdef5f7-4d19-4029-a50f-79b1ca42ea22 None admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:15:23.957987 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdef5f7-4d19-4029-a50f-79b1ca42ea22 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:15:23.958259 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdef5f7-4d19-4029-a50f-79b1ca42ea22 None admin] PATH_INFO: `/v3/projects/94e23e1db0de437b907e5c536f21f970/users/4324a0164f6c49eba68ae60f08a73ff1/roles/5c8b89fae4fa45bd944cbeaf442136e1` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:15:23.960125 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdef5f7-4d19-4029-a50f-79b1ca42ea22 None admin] RBAC: Authorizing `identity:create_grant(project_id=94e23e1db0de437b907e5c536f21f970, user_id=4324a0164f6c49eba68ae60f08a73ff1, role_id=5c8b89fae4fa45bd944cbeaf442136e1)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:15:23.961570 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdef5f7-4d19-4029-a50f-79b1ca42ea22 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:15:23.974666 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 584/1153] 10.222.0.66 () {58 vars in 1439 bytes} [Mon Sep 19 10:15:23 2022] PUT /identity/v3/projects/94e23e1db0de437b907e5c536f21f970/users/4324a0164f6c49eba68ae60f08a73ff1/roles/5c8b89fae4fa45bd944cbeaf442136e1 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:15:26.110466 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a57ee9a-4495-48c5-8dd3-6c8b0518ba69 None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:15:26.111020 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a57ee9a-4495-48c5-8dd3-6c8b0518ba69 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:15:26.111020 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a57ee9a-4495-48c5-8dd3-6c8b0518ba69 None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:15:26.112950 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 570/1154] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:15:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:15:26.118201 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6b174e-f4e0-4527-a25b-ba5344818f20 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:15:26.118631 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6b174e-f4e0-4527-a25b-ba5344818f20 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:15:26.118757 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6b174e-f4e0-4527-a25b-ba5344818f20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:15:26.136547 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-7b6b174e-f4e0-4527-a25b-ba5344818f20 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:15:26.137734 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-7b6b174e-f4e0-4527-a25b-ba5344818f20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:15:26.202165 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 585/1155] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:15:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 10:15:26.482205 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a57ee9a-4495-48c5-8dd3-6c8b0518ba69 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:15:26.583029 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a57ee9a-4495-48c5-8dd3-6c8b0518ba69 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:15:26.615806 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21684e68-6cd6-4533-bcf6-7e7d17f2624d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:15:26.616454 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21684e68-6cd6-4533-bcf6-7e7d17f2624d None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:15:26.616736 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21684e68-6cd6-4533-bcf6-7e7d17f2624d None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:15:26.617010 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21684e68-6cd6-4533-bcf6-7e7d17f2624d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:15:26.626825 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21684e68-6cd6-4533-bcf6-7e7d17f2624d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 10:15:26.632140 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-21684e68-6cd6-4533-bcf6-7e7d17f2624d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 10:15:26.632140 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:15:26.632140 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:15:26.632140 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:15:26.632140 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:15:26.632140 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:15:26.632140 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:15:26.632140 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:15:26.632140 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:15:26.632140 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:15:26.632140 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:15:26.632140 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:15:26.632140 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 10:15:26.632140 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 10:15:26.632140 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 10:15:26.632140 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 10:15:26.633264 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 10:15:26.633264 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 10:15:26.633264 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 10:15:26.633264 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 10:15:26.633264 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:15:26.633264 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:15:26.633264 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:15:26.633264 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:15:26.633264 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:15:26.633264 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:15:26.633264 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:15:26.633264 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Sep 19 10:15:26.633264 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:15:26.633264 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:15:26.633264 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:15:26.633264 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:15:26.634416 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:15:26.634416 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:15:26.634416 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:15:26.634416 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:15:26.634416 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 10:15:26.634416 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 10:15:26.634416 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 10:15:26.634416 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 10:15:26.634416 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 10:15:26.634416 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 10:15:26.634416 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 10:15:26.634416 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Sep 19 10:15:26.634416 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 571/1156] 10.222.0.66 () {56 vars in 1096 bytes} [Mon Sep 19 10:15:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:15:26.639309 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6b174e-f4e0-4527-a25b-ba5344818f20 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:15:26.647821 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:15:26.737527 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6b174e-f4e0-4527-a25b-ba5344818f20 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:15:26.769265 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b0b064-0453-40bd-b24f-e189d58ddf91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:15:26.769863 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b0b064-0453-40bd-b24f-e189d58ddf91 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:15:26.770139 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b0b064-0453-40bd-b24f-e189d58ddf91 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:15:26.770409 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b0b064-0453-40bd-b24f-e189d58ddf91 None admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:15:26.771058 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b0b064-0453-40bd-b24f-e189d58ddf91 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:15:26.771358 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b0b064-0453-40bd-b24f-e189d58ddf91 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:15:26.772750 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b0b064-0453-40bd-b24f-e189d58ddf91 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:15:26.780423 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 586/1157] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Sep 19 10:15:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:15:26.786863 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21684e68-6cd6-4533-bcf6-7e7d17f2624d None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:15:26.806692 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:15:26.884277 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21684e68-6cd6-4533-bcf6-7e7d17f2624d None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:15:26.917968 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97166a0d-be77-477d-a515-7412194fee09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:15:26.918589 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97166a0d-be77-477d-a515-7412194fee09 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:15:26.918861 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97166a0d-be77-477d-a515-7412194fee09 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:15:26.919402 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97166a0d-be77-477d-a515-7412194fee09 None admin] PATH_INFO: `/v3/users/4324a0164f6c49eba68ae60f08a73ff1` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:15:26.920519 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97166a0d-be77-477d-a515-7412194fee09 None admin] RBAC: Authorizing `identity:get_user(user_id=4324a0164f6c49eba68ae60f08a73ff1)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:15:26.921947 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97166a0d-be77-477d-a515-7412194fee09 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:15:26.923502 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 572/1158] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Sep 19 10:15:26 2022] GET /identity/v3/users/4324a0164f6c49eba68ae60f08a73ff1 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:15:26.929413 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b0b064-0453-40bd-b24f-e189d58ddf91 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:15:26.998320 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:15:27.031369 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b0b064-0453-40bd-b24f-e189d58ddf91 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:15:27.065923 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f23e98-49f6-4228-8d47-63baf87215f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:15:27.066524 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f23e98-49f6-4228-8d47-63baf87215f4 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:15:27.066803 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f23e98-49f6-4228-8d47-63baf87215f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:15:27.067078 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f23e98-49f6-4228-8d47-63baf87215f4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:15:27.132788 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f23e98-49f6-4228-8d47-63baf87215f4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:15:27.134197 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f23e98-49f6-4228-8d47-63baf87215f4 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:15:27.201023 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:15:27.234240 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 587/1159] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Sep 19 10:15:26 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 19 10:15:27.240764 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97166a0d-be77-477d-a515-7412194fee09 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:15:27.323717 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:15:27.338596 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97166a0d-be77-477d-a515-7412194fee09 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:15:27.372304 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c665259-bd37-43d9-a16b-e3cb4d3535ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:15:27.372930 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c665259-bd37-43d9-a16b-e3cb4d3535ff None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:15:27.373213 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c665259-bd37-43d9-a16b-e3cb4d3535ff None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:15:27.373490 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c665259-bd37-43d9-a16b-e3cb4d3535ff None admin] PATH_INFO: `/v3/projects/94e23e1db0de437b907e5c536f21f970` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:15:27.374596 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c665259-bd37-43d9-a16b-e3cb4d3535ff None admin] RBAC: Authorizing `identity:get_project(project_id=94e23e1db0de437b907e5c536f21f970)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:15:27.376032 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c665259-bd37-43d9-a16b-e3cb4d3535ff None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:15:27.377737 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 573/1160] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Sep 19 10:15:27 2022] GET /identity/v3/projects/94e23e1db0de437b907e5c536f21f970 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:15:27.383887 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f23e98-49f6-4228-8d47-63baf87215f4 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:15:27.479985 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f23e98-49f6-4228-8d47-63baf87215f4 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:15:27.512750 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0054605-22fd-4bc9-8ff1-8bfb9f545541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:15:27.513343 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0054605-22fd-4bc9-8ff1-8bfb9f545541 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:15:27.513623 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0054605-22fd-4bc9-8ff1-8bfb9f545541 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:15:27.513896 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0054605-22fd-4bc9-8ff1-8bfb9f545541 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:15:27.514610 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0054605-22fd-4bc9-8ff1-8bfb9f545541 None admin] RBAC: Adding query filter params (role.id=5c8b89fae4fa45bd944cbeaf442136e1, scope.project.id=94e23e1db0de437b907e5c536f21f970, user.id=4324a0164f6c49eba68ae60f08a73ff1) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:15:27.514920 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0054605-22fd-4bc9-8ff1-8bfb9f545541 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:15:27.516371 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0054605-22fd-4bc9-8ff1-8bfb9f545541 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:15:27.522406 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 588/1161] 10.222.0.66 () {56 vars in 1374 bytes} [Mon Sep 19 10:15:27 2022] GET /identity/v3/role_assignments?user.id=4324a0164f6c49eba68ae60f08a73ff1&scope.project.id=94e23e1db0de437b907e5c536f21f970&role.id=5c8b89fae4fa45bd944cbeaf442136e1 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:15:29.732787 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadb0a45-8d26-4f83-91d8-dd8b24ed348b None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:15:29.733336 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadb0a45-8d26-4f83-91d8-dd8b24ed348b None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:15:29.733336 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadb0a45-8d26-4f83-91d8-dd8b24ed348b None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:15:29.734673 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 574/1162] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:15:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:15:29.742219 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a21b41c-bfac-4ac2-ac17-b38774625764 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:15:29.742689 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a21b41c-bfac-4ac2-ac17-b38774625764 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:15:29.742803 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a21b41c-bfac-4ac2-ac17-b38774625764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:15:29.760786 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-3a21b41c-bfac-4ac2-ac17-b38774625764 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:15:29.761990 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-3a21b41c-bfac-4ac2-ac17-b38774625764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:15:29.787764 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:15:29.828844 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 589/1163] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:15:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 10:15:30.093725 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadb0a45-8d26-4f83-91d8-dd8b24ed348b None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:15:30.195751 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadb0a45-8d26-4f83-91d8-dd8b24ed348b None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:15:30.229054 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b204c5-d0c8-4b13-9f25-cfaf89b7ab64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:15:30.229649 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b204c5-d0c8-4b13-9f25-cfaf89b7ab64 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:15:30.229923 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b204c5-d0c8-4b13-9f25-cfaf89b7ab64 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:15:30.230192 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b204c5-d0c8-4b13-9f25-cfaf89b7ab64 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:15:30.253179 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:15:30.295870 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b204c5-d0c8-4b13-9f25-cfaf89b7ab64 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:15:30.297343 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b204c5-d0c8-4b13-9f25-cfaf89b7ab64 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:15:30.396723 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 575/1164] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Sep 19 10:15:30 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 19 10:15:30.405111 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a21b41c-bfac-4ac2-ac17-b38774625764 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:15:30.507303 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a21b41c-bfac-4ac2-ac17-b38774625764 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:15:30.539177 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def549a5-aa19-4906-bd4a-7518da1ef335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:15:30.539800 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def549a5-aa19-4906-bd4a-7518da1ef335 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:15:30.540076 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def549a5-aa19-4906-bd4a-7518da1ef335 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:15:30.540378 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def549a5-aa19-4906-bd4a-7518da1ef335 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:15:30.546996 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def549a5-aa19-4906-bd4a-7518da1ef335 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:15:30.548445 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def549a5-aa19-4906-bd4a-7518da1ef335 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:15:30.560034 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-def549a5-aa19-4906-bd4a-7518da1ef335 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 19 10:15:30.560034 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:15:30.560034 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 19 10:15:30.560034 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 19 10:15:30.560034 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 10:15:30.560034 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 10:15:30.560034 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 10:15:30.560034 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 10:15:30.560034 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Sep 19 10:15:30.560034 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 19 10:15:30.560034 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 10:15:30.560034 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 19 10:15:30.560034 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:15:30.560034 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:15:30.560034 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:15:30.560034 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:15:30.560034 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:15:30.561309 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:15:30.561309 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:15:30.561309 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:15:30.561309 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:15:30.561309 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:15:30.561309 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:15:30.561309 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 10:15:30.561309 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 10:15:30.561309 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 10:15:30.561309 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 10:15:30.561309 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:15:30.561309 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:15:30.561309 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:15:30.561309 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:15:30.561309 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:15:30.561309 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:15:30.562173 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:15:30.562173 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 19 10:15:30.562173 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:15:30.562173 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:15:30.562173 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:15:30.562173 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:15:30.562173 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:15:30.562173 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:15:30.562173 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:15:30.562173 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:15:30.562173 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 19 10:15:30.562173 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 10:15:30.562173 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 19 10:15:30.562173 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 19 10:15:30.562173 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 590/1165] 10.222.0.66 () {56 vars in 1117 bytes} [Mon Sep 19 10:15:30 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:15:30.567243 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b204c5-d0c8-4b13-9f25-cfaf89b7ab64 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:15:30.621294 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:15:30.666630 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b204c5-d0c8-4b13-9f25-cfaf89b7ab64 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:15:30.700112 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fa32d2-3483-4dbd-95a4-0079244fe58e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:15:30.700736 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fa32d2-3483-4dbd-95a4-0079244fe58e None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:15:30.701015 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fa32d2-3483-4dbd-95a4-0079244fe58e None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:15:30.701287 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fa32d2-3483-4dbd-95a4-0079244fe58e None admin] PATH_INFO: `/v3/domains` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:15:30.701923 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fa32d2-3483-4dbd-95a4-0079244fe58e None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:15:30.702222 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fa32d2-3483-4dbd-95a4-0079244fe58e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:15:30.703580 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fa32d2-3483-4dbd-95a4-0079244fe58e None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:15:30.711602 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 576/1166] 10.222.0.66 () {56 vars in 1115 bytes} [Mon Sep 19 10:15:30 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:15:32.858332 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77b5ba6-bdbd-46bb-8ab9-422da7c40c5b None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:15:32.858873 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77b5ba6-bdbd-46bb-8ab9-422da7c40c5b None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:15:32.858873 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77b5ba6-bdbd-46bb-8ab9-422da7c40c5b None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:15:32.860242 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 591/1167] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:15:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:15:32.866084 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b81d21-74bd-4fde-996e-7704fb9957e6 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:15:32.866509 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b81d21-74bd-4fde-996e-7704fb9957e6 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:15:32.866661 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b81d21-74bd-4fde-996e-7704fb9957e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:15:32.885012 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-17b81d21-74bd-4fde-996e-7704fb9957e6 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:15:32.886201 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-17b81d21-74bd-4fde-996e-7704fb9957e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:15:32.952577 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 577/1168] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:15:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 10:15:33.222762 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77b5ba6-bdbd-46bb-8ab9-422da7c40c5b None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:15:33.246742 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:15:33.322038 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77b5ba6-bdbd-46bb-8ab9-422da7c40c5b None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:15:33.354614 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df50ce7-9ab8-44b4-8b22-18598568b0f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:15:33.355215 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df50ce7-9ab8-44b4-8b22-18598568b0f6 None admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:15:33.355498 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df50ce7-9ab8-44b4-8b22-18598568b0f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:15:33.355773 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df50ce7-9ab8-44b4-8b22-18598568b0f6 None admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:15:33.356460 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df50ce7-9ab8-44b4-8b22-18598568b0f6 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:15:33.357819 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df50ce7-9ab8-44b4-8b22-18598568b0f6 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:15:33.377396 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 592/1169] 10.222.0.66 () {60 vars in 1138 bytes} [Mon Sep 19 10:15:33 2022] POST /identity/v3/domains => generated 267 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:15:35.555227 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fc3050-d838-4aea-9ba8-24ab052d50fe None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:15:35.555759 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fc3050-d838-4aea-9ba8-24ab052d50fe None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:15:35.555759 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fc3050-d838-4aea-9ba8-24ab052d50fe None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:15:35.557167 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 578/1170] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:15:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:15:35.562429 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43673163-d2ef-4e07-8a0b-09a4ce16b873 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:15:35.562821 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43673163-d2ef-4e07-8a0b-09a4ce16b873 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:15:35.562970 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43673163-d2ef-4e07-8a0b-09a4ce16b873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:15:35.581670 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-43673163-d2ef-4e07-8a0b-09a4ce16b873 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:15:35.582848 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-43673163-d2ef-4e07-8a0b-09a4ce16b873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:15:35.645459 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 593/1171] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:15:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 10:15:35.913215 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fc3050-d838-4aea-9ba8-24ab052d50fe None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:15:35.961794 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:15:36.011680 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fc3050-d838-4aea-9ba8-24ab052d50fe None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:15:36.045332 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a280f15-7ac9-4d53-ae01-44949c9d7c4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:15:36.045945 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a280f15-7ac9-4d53-ae01-44949c9d7c4a None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:15:36.046227 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a280f15-7ac9-4d53-ae01-44949c9d7c4a None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:15:36.046500 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a280f15-7ac9-4d53-ae01-44949c9d7c4a None admin] PATH_INFO: `/v3/domains/6803e44a6ba54af8affc5c339236cec9` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:15:36.056696 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a280f15-7ac9-4d53-ae01-44949c9d7c4a None admin] RBAC: Authorizing `identity:get_domain(domain_id=6803e44a6ba54af8affc5c339236cec9)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:15:36.058130 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a280f15-7ac9-4d53-ae01-44949c9d7c4a None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:15:36.059698 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 579/1172] 10.222.0.66 () {56 vars in 1183 bytes} [Mon Sep 19 10:15:35 2022] GET /identity/v3/domains/6803e44a6ba54af8affc5c339236cec9 => generated 267 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:15:36.065726 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43673163-d2ef-4e07-8a0b-09a4ce16b873 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:15:36.079452 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:15:36.163823 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43673163-d2ef-4e07-8a0b-09a4ce16b873 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:15:36.197197 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f33e5cd-5a4d-4631-b776-b5d4012f2d55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:15:36.197790 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f33e5cd-5a4d-4631-b776-b5d4012f2d55 None admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:15:36.198072 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f33e5cd-5a4d-4631-b776-b5d4012f2d55 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:15:36.198346 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f33e5cd-5a4d-4631-b776-b5d4012f2d55 None admin] PATH_INFO: `/v3/projects` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:15:36.198979 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f33e5cd-5a4d-4631-b776-b5d4012f2d55 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:15:36.200429 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f33e5cd-5a4d-4631-b776-b5d4012f2d55 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:15:36.227007 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 594/1173] 10.222.0.66 () {60 vars in 1141 bytes} [Mon Sep 19 10:15:36 2022] POST /identity/v3/projects => generated 361 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:15:38.425052 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50ac924-7c23-4f4d-a62d-dc9fcf22d0fa None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:15:38.425587 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50ac924-7c23-4f4d-a62d-dc9fcf22d0fa None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:15:38.425587 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50ac924-7c23-4f4d-a62d-dc9fcf22d0fa None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:15:38.426940 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 580/1174] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:15:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:15:38.432487 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa94e92-a2f1-4d8a-a109-b23459b8b729 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:15:38.432942 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa94e92-a2f1-4d8a-a109-b23459b8b729 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:15:38.433079 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa94e92-a2f1-4d8a-a109-b23459b8b729 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:15:38.450972 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-aaa94e92-a2f1-4d8a-a109-b23459b8b729 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:15:38.452206 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-aaa94e92-a2f1-4d8a-a109-b23459b8b729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:15:38.512058 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:15:38.522261 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 595/1175] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:15:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 10:15:38.792392 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50ac924-7c23-4f4d-a62d-dc9fcf22d0fa None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:15:38.890732 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50ac924-7c23-4f4d-a62d-dc9fcf22d0fa None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:15:38.899989 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:15:38.924863 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbea4dd7-cea7-4d5c-b34f-b2bf8e3740a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:15:38.925486 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbea4dd7-cea7-4d5c-b34f-b2bf8e3740a2 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:15:38.925762 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbea4dd7-cea7-4d5c-b34f-b2bf8e3740a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:15:38.926029 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbea4dd7-cea7-4d5c-b34f-b2bf8e3740a2 None admin] PATH_INFO: `/v3/domains/6803e44a6ba54af8affc5c339236cec9` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:15:38.927119 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbea4dd7-cea7-4d5c-b34f-b2bf8e3740a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=6803e44a6ba54af8affc5c339236cec9)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:15:38.928564 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbea4dd7-cea7-4d5c-b34f-b2bf8e3740a2 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:15:38.930110 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 581/1176] 10.222.0.66 () {56 vars in 1183 bytes} [Mon Sep 19 10:15:38 2022] GET /identity/v3/domains/6803e44a6ba54af8affc5c339236cec9 => generated 267 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:15:38.935885 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa94e92-a2f1-4d8a-a109-b23459b8b729 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:15:39.031593 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa94e92-a2f1-4d8a-a109-b23459b8b729 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:15:39.065886 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f9de6e-3090-4488-9b2e-5027bd360aca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:15:39.066483 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f9de6e-3090-4488-9b2e-5027bd360aca None admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:15:39.066764 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f9de6e-3090-4488-9b2e-5027bd360aca None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:15:39.067036 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f9de6e-3090-4488-9b2e-5027bd360aca None admin] PATH_INFO: `/v3/users` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:15:39.067669 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f9de6e-3090-4488-9b2e-5027bd360aca None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:15:39.069133 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f9de6e-3090-4488-9b2e-5027bd360aca None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:15:39.090197 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 596/1177] 10.222.0.66 () {60 vars in 1132 bytes} [Mon Sep 19 10:15:38 2022] POST /identity/v3/users => generated 311 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:15:41.280558 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62fde5f-201f-4300-a992-e8daed6e3cfc None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:15:41.281125 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62fde5f-201f-4300-a992-e8daed6e3cfc None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:15:41.281125 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62fde5f-201f-4300-a992-e8daed6e3cfc None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:15:41.282417 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 582/1178] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:15:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:15:41.287629 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179d96ac-9890-48a4-806c-d86eccefac6e None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:15:41.288005 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179d96ac-9890-48a4-806c-d86eccefac6e None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:15:41.288202 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179d96ac-9890-48a4-806c-d86eccefac6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:15:41.306854 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-179d96ac-9890-48a4-806c-d86eccefac6e None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:15:41.308041 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-179d96ac-9890-48a4-806c-d86eccefac6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:15:41.353216 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:15:41.373752 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 597/1179] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:15:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 10:15:41.641414 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62fde5f-201f-4300-a992-e8daed6e3cfc None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:15:41.740057 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62fde5f-201f-4300-a992-e8daed6e3cfc None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:15:41.772461 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b02994-0f9d-4392-8d36-7de2f51e44d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:15:41.773075 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b02994-0f9d-4392-8d36-7de2f51e44d5 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:15:41.773350 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b02994-0f9d-4392-8d36-7de2f51e44d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:15:41.773617 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b02994-0f9d-4392-8d36-7de2f51e44d5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:15:41.783212 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b02994-0f9d-4392-8d36-7de2f51e44d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 10:15:41.787927 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-33b02994-0f9d-4392-8d36-7de2f51e44d5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 10:15:41.787927 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:15:41.787927 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:15:41.787927 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:15:41.787927 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:15:41.787927 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:15:41.787927 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:15:41.787927 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:15:41.787927 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:15:41.787927 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:15:41.787927 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:15:41.787927 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:15:41.787927 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 10:15:41.787927 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 10:15:41.787927 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 10:15:41.787927 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 10:15:41.788901 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 10:15:41.788901 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 10:15:41.788901 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 10:15:41.788901 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 10:15:41.788901 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:15:41.788901 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:15:41.788901 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:15:41.788901 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:15:41.788901 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:15:41.788901 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:15:41.788901 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:15:41.788901 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Sep 19 10:15:41.788901 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:15:41.788901 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:15:41.788901 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:15:41.788901 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:15:41.789780 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:15:41.789780 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:15:41.789780 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:15:41.789780 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:15:41.789780 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 10:15:41.789780 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 10:15:41.789780 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 10:15:41.789780 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 10:15:41.789780 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 10:15:41.789780 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 10:15:41.789780 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 10:15:41.789780 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Sep 19 10:15:41.789780 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 583/1180] 10.222.0.66 () {56 vars in 1096 bytes} [Mon Sep 19 10:15:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:15:41.795364 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179d96ac-9890-48a4-806c-d86eccefac6e None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:15:41.890857 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179d96ac-9890-48a4-806c-d86eccefac6e None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:15:41.925169 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023a7498-43aa-44b4-8702-e6772d7d870c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:15:41.925749 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023a7498-43aa-44b4-8702-e6772d7d870c None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:15:41.925980 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023a7498-43aa-44b4-8702-e6772d7d870c None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:15:41.926258 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023a7498-43aa-44b4-8702-e6772d7d870c None admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:15:41.926920 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023a7498-43aa-44b4-8702-e6772d7d870c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:15:41.927224 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023a7498-43aa-44b4-8702-e6772d7d870c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:15:41.928630 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023a7498-43aa-44b4-8702-e6772d7d870c None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:15:41.937270 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 598/1181] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Sep 19 10:15:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:15:41.944360 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b02994-0f9d-4392-8d36-7de2f51e44d5 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:15:41.979422 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:15:42.042691 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b02994-0f9d-4392-8d36-7de2f51e44d5 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:15:42.076562 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3815d3-f993-4bff-80b4-33f91fe213a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:15:42.077184 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3815d3-f993-4bff-80b4-33f91fe213a2 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:15:42.077467 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3815d3-f993-4bff-80b4-33f91fe213a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:15:42.077743 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3815d3-f993-4bff-80b4-33f91fe213a2 None admin] PATH_INFO: `/v3/users/24223c019f6740b59fbc67b2292405ae` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:15:42.090483 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3815d3-f993-4bff-80b4-33f91fe213a2 None admin] RBAC: Authorizing `identity:get_user(user_id=24223c019f6740b59fbc67b2292405ae)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:15:42.091932 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3815d3-f993-4bff-80b4-33f91fe213a2 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:15:42.093557 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 584/1182] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Sep 19 10:15:41 2022] GET /identity/v3/users/24223c019f6740b59fbc67b2292405ae => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:15:42.099312 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023a7498-43aa-44b4-8702-e6772d7d870c None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:15:42.142140 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:15:42.197613 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023a7498-43aa-44b4-8702-e6772d7d870c None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:15:42.229949 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f795fe5-7ed2-4948-a508-f6dd558e16fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:15:42.230563 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f795fe5-7ed2-4948-a508-f6dd558e16fc None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:15:42.230844 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f795fe5-7ed2-4948-a508-f6dd558e16fc None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:15:42.231116 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f795fe5-7ed2-4948-a508-f6dd558e16fc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:15:42.296015 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f795fe5-7ed2-4948-a508-f6dd558e16fc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:15:42.297500 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f795fe5-7ed2-4948-a508-f6dd558e16fc None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:15:42.338025 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:15:42.392744 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 599/1183] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Sep 19 10:15:42 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 19 10:15:42.398752 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3815d3-f993-4bff-80b4-33f91fe213a2 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:15:42.491503 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:15:42.498467 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3815d3-f993-4bff-80b4-33f91fe213a2 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:15:42.531342 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5699d031-9d63-4c7a-a9a2-9f42d0d29ba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:15:42.531970 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5699d031-9d63-4c7a-a9a2-9f42d0d29ba1 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:15:42.532286 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5699d031-9d63-4c7a-a9a2-9f42d0d29ba1 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:15:42.532564 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5699d031-9d63-4c7a-a9a2-9f42d0d29ba1 None admin] PATH_INFO: `/v3/projects/69bd36de53a64206a590f77f0b4f13b7` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:15:42.534224 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5699d031-9d63-4c7a-a9a2-9f42d0d29ba1 None admin] RBAC: Authorizing `identity:get_project(project_id=69bd36de53a64206a590f77f0b4f13b7)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:15:42.535664 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5699d031-9d63-4c7a-a9a2-9f42d0d29ba1 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:15:42.537326 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 585/1184] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Sep 19 10:15:42 2022] GET /identity/v3/projects/69bd36de53a64206a590f77f0b4f13b7 => generated 361 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:15:42.543523 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f795fe5-7ed2-4948-a508-f6dd558e16fc None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:15:42.640154 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f795fe5-7ed2-4948-a508-f6dd558e16fc None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:15:42.677275 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18cbfd6-c07b-417b-a933-30866e61aafb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:15:42.677877 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18cbfd6-c07b-417b-a933-30866e61aafb None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:15:42.678151 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18cbfd6-c07b-417b-a933-30866e61aafb None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:15:42.678416 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18cbfd6-c07b-417b-a933-30866e61aafb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:15:42.679127 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18cbfd6-c07b-417b-a933-30866e61aafb None admin] RBAC: Adding query filter params (role.id=5c8b89fae4fa45bd944cbeaf442136e1, scope.project.id=69bd36de53a64206a590f77f0b4f13b7, user.id=24223c019f6740b59fbc67b2292405ae) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:15:42.679428 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18cbfd6-c07b-417b-a933-30866e61aafb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:15:42.680912 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18cbfd6-c07b-417b-a933-30866e61aafb None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:15:42.687425 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 600/1185] 10.222.0.66 () {56 vars in 1374 bytes} [Mon Sep 19 10:15:42 2022] GET /identity/v3/role_assignments?user.id=24223c019f6740b59fbc67b2292405ae&scope.project.id=69bd36de53a64206a590f77f0b4f13b7&role.id=5c8b89fae4fa45bd944cbeaf442136e1 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:15:44.833574 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348bf842-ff5c-498a-8898-feaa45c0091b None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:15:44.834122 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348bf842-ff5c-498a-8898-feaa45c0091b None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:15:44.834122 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348bf842-ff5c-498a-8898-feaa45c0091b None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:15:44.835430 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 586/1186] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:15:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:15:44.840867 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b84868-dcda-4fcf-9187-1c88819064af None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:15:44.841246 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b84868-dcda-4fcf-9187-1c88819064af None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:15:44.841412 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b84868-dcda-4fcf-9187-1c88819064af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:15:44.854037 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:15:44.859553 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-08b84868-dcda-4fcf-9187-1c88819064af None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:15:44.860791 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-08b84868-dcda-4fcf-9187-1c88819064af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:15:44.926574 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 601/1187] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:15:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 10:15:45.202088 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348bf842-ff5c-498a-8898-feaa45c0091b None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:15:45.304321 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348bf842-ff5c-498a-8898-feaa45c0091b None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:15:45.337320 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84619083-281e-4461-9423-04c5b87a5a58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:15:45.337935 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84619083-281e-4461-9423-04c5b87a5a58 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:15:45.338209 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84619083-281e-4461-9423-04c5b87a5a58 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:15:45.338472 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84619083-281e-4461-9423-04c5b87a5a58 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:15:45.348230 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84619083-281e-4461-9423-04c5b87a5a58 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 10:15:45.352893 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-84619083-281e-4461-9423-04c5b87a5a58 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 10:15:45.352893 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:15:45.352893 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:15:45.352893 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:15:45.352893 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:15:45.352893 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:15:45.352893 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:15:45.352893 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:15:45.352893 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:15:45.352893 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:15:45.352893 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:15:45.352893 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:15:45.352893 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 10:15:45.352893 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 10:15:45.352893 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 10:15:45.352893 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 10:15:45.353976 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 10:15:45.353976 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 10:15:45.353976 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 10:15:45.353976 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 10:15:45.353976 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:15:45.353976 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:15:45.353976 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:15:45.353976 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:15:45.353976 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:15:45.353976 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:15:45.353976 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:15:45.353976 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Sep 19 10:15:45.353976 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:15:45.353976 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:15:45.353976 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:15:45.353976 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:15:45.355028 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:15:45.355028 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:15:45.355028 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:15:45.355028 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:15:45.355028 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 10:15:45.355028 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 10:15:45.355028 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 10:15:45.355028 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 10:15:45.355028 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 10:15:45.355028 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 10:15:45.355028 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 10:15:45.355028 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Sep 19 10:15:45.355028 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 587/1188] 10.222.0.66 () {56 vars in 1096 bytes} [Mon Sep 19 10:15:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:15:45.360113 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b84868-dcda-4fcf-9187-1c88819064af None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:15:45.455029 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b84868-dcda-4fcf-9187-1c88819064af None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:15:45.491736 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32150023-0810-4024-8ab8-e310ebfd950e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:15:45.492364 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32150023-0810-4024-8ab8-e310ebfd950e None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:15:45.492643 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32150023-0810-4024-8ab8-e310ebfd950e None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:15:45.492914 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32150023-0810-4024-8ab8-e310ebfd950e None admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:15:45.493562 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32150023-0810-4024-8ab8-e310ebfd950e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:15:45.493860 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32150023-0810-4024-8ab8-e310ebfd950e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:15:45.495227 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32150023-0810-4024-8ab8-e310ebfd950e None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:15:45.497383 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:15:45.508205 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 602/1189] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Sep 19 10:15:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:15:45.510489 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84619083-281e-4461-9423-04c5b87a5a58 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:15:45.534811 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:15:45.609148 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84619083-281e-4461-9423-04c5b87a5a58 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:15:45.642500 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1713a5e5-ff80-4028-b09c-28aa9378ef2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:15:45.643156 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1713a5e5-ff80-4028-b09c-28aa9378ef2e None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:15:45.643432 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1713a5e5-ff80-4028-b09c-28aa9378ef2e None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:15:45.643705 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1713a5e5-ff80-4028-b09c-28aa9378ef2e None admin] PATH_INFO: `/v3/users/24223c019f6740b59fbc67b2292405ae` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:15:45.644813 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1713a5e5-ff80-4028-b09c-28aa9378ef2e None admin] RBAC: Authorizing `identity:get_user(user_id=24223c019f6740b59fbc67b2292405ae)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:15:45.646243 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1713a5e5-ff80-4028-b09c-28aa9378ef2e None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:15:45.647796 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 588/1190] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Sep 19 10:15:45 2022] GET /identity/v3/users/24223c019f6740b59fbc67b2292405ae => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:15:45.653667 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32150023-0810-4024-8ab8-e310ebfd950e None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:15:45.751335 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32150023-0810-4024-8ab8-e310ebfd950e None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:15:45.784468 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fb4e41-4064-4368-8e85-afa945977615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:15:45.785425 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fb4e41-4064-4368-8e85-afa945977615 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:15:45.785425 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fb4e41-4064-4368-8e85-afa945977615 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:15:45.785649 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fb4e41-4064-4368-8e85-afa945977615 None admin] PATH_INFO: `/v3/projects/69bd36de53a64206a590f77f0b4f13b7` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:15:45.786796 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fb4e41-4064-4368-8e85-afa945977615 None admin] RBAC: Authorizing `identity:get_project(project_id=69bd36de53a64206a590f77f0b4f13b7)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:15:45.788287 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fb4e41-4064-4368-8e85-afa945977615 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:15:45.789948 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 603/1191] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Sep 19 10:15:45 2022] GET /identity/v3/projects/69bd36de53a64206a590f77f0b4f13b7 => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:15:45.796218 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1713a5e5-ff80-4028-b09c-28aa9378ef2e None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:15:45.901735 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:15:45.912886 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1713a5e5-ff80-4028-b09c-28aa9378ef2e None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:15:45.946549 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d912eec-261a-4e46-a763-360b1d052e4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:15:45.947201 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d912eec-261a-4e46-a763-360b1d052e4a None admin] REQUEST_METHOD: `PUT` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:15:45.947484 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d912eec-261a-4e46-a763-360b1d052e4a None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:15:45.947763 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d912eec-261a-4e46-a763-360b1d052e4a None admin] PATH_INFO: `/v3/projects/69bd36de53a64206a590f77f0b4f13b7/users/24223c019f6740b59fbc67b2292405ae/roles/5c8b89fae4fa45bd944cbeaf442136e1` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:15:45.949721 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d912eec-261a-4e46-a763-360b1d052e4a None admin] RBAC: Authorizing `identity:create_grant(project_id=69bd36de53a64206a590f77f0b4f13b7, user_id=24223c019f6740b59fbc67b2292405ae, role_id=5c8b89fae4fa45bd944cbeaf442136e1)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:15:45.951160 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d912eec-261a-4e46-a763-360b1d052e4a None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:15:45.964206 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 589/1192] 10.222.0.66 () {58 vars in 1439 bytes} [Mon Sep 19 10:15:45 2022] PUT /identity/v3/projects/69bd36de53a64206a590f77f0b4f13b7/users/24223c019f6740b59fbc67b2292405ae/roles/5c8b89fae4fa45bd944cbeaf442136e1 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:15:48.117765 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1454cad2-fc6e-4fd8-9846-a064e30c8945 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:15:48.118313 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1454cad2-fc6e-4fd8-9846-a064e30c8945 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:15:48.118313 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1454cad2-fc6e-4fd8-9846-a064e30c8945 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:15:48.119649 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 604/1193] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:15:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:15:48.125122 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eab5bf-0464-4da6-91aa-ab10e4dcdf50 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:15:48.125533 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eab5bf-0464-4da6-91aa-ab10e4dcdf50 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:15:48.125677 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eab5bf-0464-4da6-91aa-ab10e4dcdf50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:15:48.144545 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-a2eab5bf-0464-4da6-91aa-ab10e4dcdf50 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:15:48.145732 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-a2eab5bf-0464-4da6-91aa-ab10e4dcdf50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:15:48.210007 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 590/1194] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:15:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 10:15:48.483285 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1454cad2-fc6e-4fd8-9846-a064e30c8945 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:15:48.549996 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:15:48.585368 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1454cad2-fc6e-4fd8-9846-a064e30c8945 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:15:48.617584 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a15e91-3f99-4caa-bea0-8f6ae7039d87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:15:48.618208 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a15e91-3f99-4caa-bea0-8f6ae7039d87 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:15:48.618485 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a15e91-3f99-4caa-bea0-8f6ae7039d87 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:15:48.618753 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a15e91-3f99-4caa-bea0-8f6ae7039d87 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:15:48.630088 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a15e91-3f99-4caa-bea0-8f6ae7039d87 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 10:15:48.634776 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-05a15e91-3f99-4caa-bea0-8f6ae7039d87 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 10:15:48.634776 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:15:48.634776 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:15:48.634776 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:15:48.634776 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:15:48.634776 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:15:48.634776 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:15:48.634776 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:15:48.634776 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:15:48.634776 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:15:48.634776 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:15:48.634776 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:15:48.634776 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 10:15:48.634776 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 10:15:48.634776 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 10:15:48.634776 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 10:15:48.635890 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 10:15:48.635890 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 10:15:48.635890 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 10:15:48.635890 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 10:15:48.635890 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:15:48.635890 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:15:48.635890 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:15:48.635890 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:15:48.635890 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:15:48.635890 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:15:48.635890 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:15:48.635890 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 19 10:15:48.635890 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:15:48.635890 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:15:48.635890 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:15:48.635890 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:15:48.636787 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:15:48.636787 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:15:48.636787 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:15:48.636787 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:15:48.636787 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 10:15:48.636787 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 10:15:48.636787 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 10:15:48.636787 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 10:15:48.636787 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 10:15:48.636787 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 10:15:48.636787 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 10:15:48.636787 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 19 10:15:48.636787 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 605/1195] 10.222.0.66 () {56 vars in 1096 bytes} [Mon Sep 19 10:15:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:15:48.641966 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eab5bf-0464-4da6-91aa-ab10e4dcdf50 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:15:48.720112 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:15:48.739927 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eab5bf-0464-4da6-91aa-ab10e4dcdf50 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:15:48.772990 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79df6d66-eccb-4211-bf1b-3d8d4e278902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:15:48.773591 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79df6d66-eccb-4211-bf1b-3d8d4e278902 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:15:48.773877 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79df6d66-eccb-4211-bf1b-3d8d4e278902 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:15:48.774149 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79df6d66-eccb-4211-bf1b-3d8d4e278902 None admin] PATH_INFO: `/v3/roles` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:15:48.774805 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79df6d66-eccb-4211-bf1b-3d8d4e278902 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:15:48.775112 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79df6d66-eccb-4211-bf1b-3d8d4e278902 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:15:48.776501 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79df6d66-eccb-4211-bf1b-3d8d4e278902 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:15:48.784430 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 591/1196] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Sep 19 10:15:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:15:48.790895 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a15e91-3f99-4caa-bea0-8f6ae7039d87 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:15:48.896191 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a15e91-3f99-4caa-bea0-8f6ae7039d87 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:15:48.921894 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:15:48.931222 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b008fc3-580b-4365-9bc6-7b7a28ab3431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:15:48.931852 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b008fc3-580b-4365-9bc6-7b7a28ab3431 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:15:48.932132 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b008fc3-580b-4365-9bc6-7b7a28ab3431 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:15:48.932436 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b008fc3-580b-4365-9bc6-7b7a28ab3431 None admin] PATH_INFO: `/v3/users/24223c019f6740b59fbc67b2292405ae` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:15:48.933545 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b008fc3-580b-4365-9bc6-7b7a28ab3431 None admin] RBAC: Authorizing `identity:get_user(user_id=24223c019f6740b59fbc67b2292405ae)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:15:48.935012 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b008fc3-580b-4365-9bc6-7b7a28ab3431 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:15:48.936641 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 606/1197] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Sep 19 10:15:48 2022] GET /identity/v3/users/24223c019f6740b59fbc67b2292405ae => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:15:48.943012 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79df6d66-eccb-4211-bf1b-3d8d4e278902 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:15:49.040010 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79df6d66-eccb-4211-bf1b-3d8d4e278902 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:15:49.072564 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9201057a-fa21-4bb1-a438-4584a85de727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:15:49.073160 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9201057a-fa21-4bb1-a438-4584a85de727 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:15:49.073439 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9201057a-fa21-4bb1-a438-4584a85de727 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:15:49.073712 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9201057a-fa21-4bb1-a438-4584a85de727 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:15:49.085060 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:15:49.140393 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9201057a-fa21-4bb1-a438-4584a85de727 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:15:49.141853 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9201057a-fa21-4bb1-a438-4584a85de727 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:15:49.236048 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 592/1198] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Sep 19 10:15:48 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 19 10:15:49.242552 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b008fc3-580b-4365-9bc6-7b7a28ab3431 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:15:49.340044 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b008fc3-580b-4365-9bc6-7b7a28ab3431 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:15:49.372632 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd08e14-9cfe-4f35-aebc-9a22ef2f3dd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:15:49.373248 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd08e14-9cfe-4f35-aebc-9a22ef2f3dd5 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:15:49.373526 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd08e14-9cfe-4f35-aebc-9a22ef2f3dd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:15:49.373795 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd08e14-9cfe-4f35-aebc-9a22ef2f3dd5 None admin] PATH_INFO: `/v3/projects/69bd36de53a64206a590f77f0b4f13b7` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:15:49.374888 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd08e14-9cfe-4f35-aebc-9a22ef2f3dd5 None admin] RBAC: Authorizing `identity:get_project(project_id=69bd36de53a64206a590f77f0b4f13b7)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:15:49.376333 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd08e14-9cfe-4f35-aebc-9a22ef2f3dd5 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:15:49.378000 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 607/1199] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Sep 19 10:15:49 2022] GET /identity/v3/projects/69bd36de53a64206a590f77f0b4f13b7 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:15:49.384677 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9201057a-fa21-4bb1-a438-4584a85de727 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:15:49.431362 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:15:49.487076 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9201057a-fa21-4bb1-a438-4584a85de727 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:15:49.520081 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f583b194-ae7f-4511-b2bc-ff8b60a34ab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:15:49.520701 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f583b194-ae7f-4511-b2bc-ff8b60a34ab5 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:15:49.520980 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f583b194-ae7f-4511-b2bc-ff8b60a34ab5 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:15:49.521253 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f583b194-ae7f-4511-b2bc-ff8b60a34ab5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:15:49.521966 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f583b194-ae7f-4511-b2bc-ff8b60a34ab5 None admin] RBAC: Adding query filter params (role.id=5c8b89fae4fa45bd944cbeaf442136e1, scope.project.id=69bd36de53a64206a590f77f0b4f13b7, user.id=24223c019f6740b59fbc67b2292405ae) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:15:49.522272 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f583b194-ae7f-4511-b2bc-ff8b60a34ab5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:15:49.523766 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f583b194-ae7f-4511-b2bc-ff8b60a34ab5 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:15:49.529450 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 593/1200] 10.222.0.66 () {56 vars in 1374 bytes} [Mon Sep 19 10:15:49 2022] GET /identity/v3/role_assignments?user.id=24223c019f6740b59fbc67b2292405ae&scope.project.id=69bd36de53a64206a590f77f0b4f13b7&role.id=5c8b89fae4fa45bd944cbeaf442136e1 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:15:59.368557 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=69 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:15:59.526834 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=47 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:16:45.538814 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0a85ee-f8ee-4ae4-a39c-3cd5d5b3256e None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:16:45.538814 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0a85ee-f8ee-4ae4-a39c-3cd5d5b3256e None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:16:45.538814 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0a85ee-f8ee-4ae4-a39c-3cd5d5b3256e None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:16:45.538814 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 608/1201] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:16:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:16:45.545311 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938837a7-4ad6-4fc6-872d-5edf44d6dadf None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:16:45.545858 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938837a7-4ad6-4fc6-872d-5edf44d6dadf None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:16:45.545858 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938837a7-4ad6-4fc6-872d-5edf44d6dadf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:16:45.584192 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-938837a7-4ad6-4fc6-872d-5edf44d6dadf None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:16:45.584192 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-938837a7-4ad6-4fc6-872d-5edf44d6dadf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:16:45.672084 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 594/1202] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:16:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 10:16:45.968954 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0a85ee-f8ee-4ae4-a39c-3cd5d5b3256e None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:16:46.099363 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0a85ee-f8ee-4ae4-a39c-3cd5d5b3256e None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:16:46.139271 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8e6661-d4f6-4e08-ab7c-088f308b4949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:16:46.140032 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8e6661-d4f6-4e08-ab7c-088f308b4949 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:16:46.140918 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8e6661-d4f6-4e08-ab7c-088f308b4949 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:16:46.141237 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8e6661-d4f6-4e08-ab7c-088f308b4949 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:16:46.158094 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8e6661-d4f6-4e08-ab7c-088f308b4949 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:16:46.159714 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8e6661-d4f6-4e08-ab7c-088f308b4949 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:16:46.177211 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-6a8e6661-d4f6-4e08-ab7c-088f308b4949 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 10:16:46.177211 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:16:46.177211 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:16:46.177211 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:16:46.177211 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:16:46.177211 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:16:46.177211 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:16:46.177211 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:16:46.177211 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:16:46.177211 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:16:46.177211 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:16:46.177211 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:16:46.177211 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 10:16:46.177211 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 10:16:46.177211 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 10:16:46.177211 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 10:16:46.178782 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:16:46.178782 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:16:46.178782 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:16:46.178782 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:16:46.178782 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:16:46.178782 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:16:46.178782 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:16:46.178782 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 19 10:16:46.178782 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:16:46.178782 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:16:46.178782 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:16:46.178782 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:16:46.178782 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:16:46.178782 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:16:46.178782 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:16:46.178782 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:16:46.178782 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 10:16:46.179892 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 10:16:46.179892 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 10:16:46.179892 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 19 10:16:46.184525 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 609/1203] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 19 10:16:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 10:16:46.187176 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938837a7-4ad6-4fc6-872d-5edf44d6dadf None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:16:46.334701 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938837a7-4ad6-4fc6-872d-5edf44d6dadf None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:16:46.382638 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:16:46.391083 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce006be-3230-4ea8-af53-a27ad3dcc618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:16:46.391754 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce006be-3230-4ea8-af53-a27ad3dcc618 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:16:46.391993 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce006be-3230-4ea8-af53-a27ad3dcc618 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:16:46.392296 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce006be-3230-4ea8-af53-a27ad3dcc618 None admin] PATH_INFO: `/v3/domains` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:16:46.392950 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce006be-3230-4ea8-af53-a27ad3dcc618 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:16:46.393254 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce006be-3230-4ea8-af53-a27ad3dcc618 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:16:46.394745 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce006be-3230-4ea8-af53-a27ad3dcc618 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:16:46.414354 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 595/1204] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Sep 19 10:16:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:16:46.415697 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8e6661-d4f6-4e08-ab7c-088f308b4949 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:16:46.482778 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:16:46.549128 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8e6661-d4f6-4e08-ab7c-088f308b4949 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:16:46.594076 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9d8d46-4b9d-49da-9d52-1d4a3a37773b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:16:46.595506 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9d8d46-4b9d-49da-9d52-1d4a3a37773b None admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:16:46.595506 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9d8d46-4b9d-49da-9d52-1d4a3a37773b None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:16:46.595506 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9d8d46-4b9d-49da-9d52-1d4a3a37773b None admin] PATH_INFO: `/v3/users` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:16:46.595753 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9d8d46-4b9d-49da-9d52-1d4a3a37773b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:16:46.597274 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9d8d46-4b9d-49da-9d52-1d4a3a37773b None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:16:46.621380 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 610/1205] 10.222.0.66 () {60 vars in 1132 bytes} [Mon Sep 19 10:16:46 2022] POST /identity/v3/users => generated 251 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 10:16:49.214313 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76687c47-1ab4-4516-95cd-1eba26ccec09 None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:16:49.215044 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76687c47-1ab4-4516-95cd-1eba26ccec09 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:16:49.215044 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76687c47-1ab4-4516-95cd-1eba26ccec09 None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:16:49.216402 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 596/1206] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:16:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:16:49.223206 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a1c597-4afb-45e3-9d5a-ef353a8f8649 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:16:49.223689 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a1c597-4afb-45e3-9d5a-ef353a8f8649 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:16:49.223885 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a1c597-4afb-45e3-9d5a-ef353a8f8649 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:16:49.246852 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-03a1c597-4afb-45e3-9d5a-ef353a8f8649 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:16:49.248415 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-03a1c597-4afb-45e3-9d5a-ef353a8f8649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:16:49.333426 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 611/1207] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:16:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 10:16:49.659767 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76687c47-1ab4-4516-95cd-1eba26ccec09 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:16:49.785107 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76687c47-1ab4-4516-95cd-1eba26ccec09 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:16:49.825578 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34e223c-8076-4215-9f1a-bfa3f0d7cc17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:16:49.826224 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34e223c-8076-4215-9f1a-bfa3f0d7cc17 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:16:49.826507 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34e223c-8076-4215-9f1a-bfa3f0d7cc17 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:16:49.826784 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34e223c-8076-4215-9f1a-bfa3f0d7cc17 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:16:49.839592 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34e223c-8076-4215-9f1a-bfa3f0d7cc17 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 10:16:49.846510 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-d34e223c-8076-4215-9f1a-bfa3f0d7cc17 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 10:16:49.846510 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:16:49.846510 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:16:49.846510 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:16:49.846510 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:16:49.846510 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:16:49.846510 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:16:49.846510 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:16:49.846510 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:16:49.846510 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:16:49.846510 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:16:49.846510 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:16:49.846510 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 10:16:49.846510 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 10:16:49.846510 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 10:16:49.846510 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 10:16:49.852348 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 10:16:49.852348 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 10:16:49.852348 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 10:16:49.852348 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 10:16:49.852348 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:16:49.852348 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:16:49.852348 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:16:49.852348 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:16:49.852348 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:16:49.852348 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:16:49.852348 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:16:49.852348 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Sep 19 10:16:49.852348 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:16:49.852348 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:16:49.852348 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:16:49.852348 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:16:49.853489 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:16:49.853489 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:16:49.853489 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:16:49.853489 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:16:49.853489 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 10:16:49.853489 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 10:16:49.853489 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 10:16:49.853489 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 10:16:49.853489 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 10:16:49.853489 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 10:16:49.853489 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 10:16:49.853489 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Sep 19 10:16:49.853489 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 597/1208] 10.222.0.66 () {56 vars in 1102 bytes} [Mon Sep 19 10:16:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:16:49.854433 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a1c597-4afb-45e3-9d5a-ef353a8f8649 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:16:49.916079 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:16:49.998342 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a1c597-4afb-45e3-9d5a-ef353a8f8649 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:16:50.044043 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5b00fd-d17d-4871-886e-e68b3257b77f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:16:50.044977 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5b00fd-d17d-4871-886e-e68b3257b77f None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:16:50.045316 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5b00fd-d17d-4871-886e-e68b3257b77f None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:16:50.045750 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5b00fd-d17d-4871-886e-e68b3257b77f None admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:16:50.046583 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5b00fd-d17d-4871-886e-e68b3257b77f None admin] RBAC: Adding query filter params (name=service) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:16:50.047116 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5b00fd-d17d-4871-886e-e68b3257b77f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:16:50.048611 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5b00fd-d17d-4871-886e-e68b3257b77f None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:16:50.059022 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 612/1209] 10.222.0.66 () {56 vars in 1103 bytes} [Mon Sep 19 10:16:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:16:50.066238 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34e223c-8076-4215-9f1a-bfa3f0d7cc17 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:16:50.138139 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:16:50.209875 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34e223c-8076-4215-9f1a-bfa3f0d7cc17 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:16:50.261713 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8a7214-46d4-4e2f-87e3-071e5be1cd92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:16:50.262543 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8a7214-46d4-4e2f-87e3-071e5be1cd92 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:16:50.262750 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8a7214-46d4-4e2f-87e3-071e5be1cd92 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:16:50.262989 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8a7214-46d4-4e2f-87e3-071e5be1cd92 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:16:50.276326 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8a7214-46d4-4e2f-87e3-071e5be1cd92 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:16:50.278221 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8a7214-46d4-4e2f-87e3-071e5be1cd92 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:16:50.297831 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-8c8a7214-46d4-4e2f-87e3-071e5be1cd92 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 10:16:50.297831 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:16:50.297831 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:16:50.297831 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:16:50.297831 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:16:50.297831 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:16:50.297831 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:16:50.297831 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:16:50.297831 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:16:50.297831 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:16:50.297831 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:16:50.297831 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:16:50.297831 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 10:16:50.297831 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 10:16:50.297831 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 10:16:50.297831 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 10:16:50.298891 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:16:50.298891 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:16:50.298891 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:16:50.298891 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:16:50.298891 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:16:50.298891 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:16:50.298891 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:16:50.298891 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Sep 19 10:16:50.298891 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:16:50.298891 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:16:50.298891 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:16:50.298891 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:16:50.298891 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:16:50.298891 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:16:50.298891 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:16:50.298891 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:16:50.298891 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 10:16:50.299780 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 10:16:50.299780 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 10:16:50.299780 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Sep 19 10:16:50.299780 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 598/1210] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 19 10:16:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:16:50.307952 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5b00fd-d17d-4871-886e-e68b3257b77f None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:16:50.455145 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:16:50.459229 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5b00fd-d17d-4871-886e-e68b3257b77f None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:16:50.503153 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c6a960-3f4c-497b-a23d-33c9eca14818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:16:50.504033 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c6a960-3f4c-497b-a23d-33c9eca14818 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:16:50.504439 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c6a960-3f4c-497b-a23d-33c9eca14818 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:16:50.504814 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c6a960-3f4c-497b-a23d-33c9eca14818 None admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:16:50.505749 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c6a960-3f4c-497b-a23d-33c9eca14818 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:16:50.506424 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c6a960-3f4c-497b-a23d-33c9eca14818 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:16:50.508415 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c6a960-3f4c-497b-a23d-33c9eca14818 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:16:50.523232 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 613/1211] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Sep 19 10:16:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 10:16:50.529682 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8a7214-46d4-4e2f-87e3-071e5be1cd92 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:16:50.659756 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8a7214-46d4-4e2f-87e3-071e5be1cd92 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:16:50.662888 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:16:50.705046 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c0730a-a272-4090-91c3-a2fde6eba568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:16:50.705691 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c0730a-a272-4090-91c3-a2fde6eba568 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:16:50.705974 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c0730a-a272-4090-91c3-a2fde6eba568 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:16:50.706247 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c0730a-a272-4090-91c3-a2fde6eba568 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:16:50.713774 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c0730a-a272-4090-91c3-a2fde6eba568 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:16:50.715226 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c0730a-a272-4090-91c3-a2fde6eba568 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:16:50.728011 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-71c0730a-a272-4090-91c3-a2fde6eba568 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 19 10:16:50.728011 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:16:50.728011 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:16:50.728011 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:16:50.728011 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:16:50.728011 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:16:50.728011 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:16:50.728011 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:16:50.728011 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:16:50.728011 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:16:50.728011 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:16:50.728011 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:16:50.728011 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 10:16:50.728011 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 10:16:50.728011 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 10:16:50.728011 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 10:16:50.729327 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:16:50.729327 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:16:50.729327 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 10:16:50.729327 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 10:16:50.729327 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 10:16:50.729327 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 10:16:50.729327 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:16:50.729327 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:16:50.729327 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:16:50.729327 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:16:50.729327 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:16:50.729327 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Sep 19 10:16:50.729327 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:16:50.729327 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:16:50.729327 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:16:50.729327 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:16:50.729327 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:16:50.729327 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:16:50.730277 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:16:50.730277 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:16:50.730277 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 10:16:50.730277 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 10:16:50.730277 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 10:16:50.730277 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 10:16:50.730277 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 10:16:50.730277 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 10:16:50.730277 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 19 10:16:50.730277 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Sep 19 10:16:50.730277 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 599/1212] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 19 10:16:50 2022] GET /identity/v3/users/placement => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:16:50.736026 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c6a960-3f4c-497b-a23d-33c9eca14818 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:16:50.846022 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c6a960-3f4c-497b-a23d-33c9eca14818 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:16:50.885609 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d67cfd-7267-4e1e-a904-82e047c62b88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:16:50.886398 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d67cfd-7267-4e1e-a904-82e047c62b88 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:16:50.886762 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d67cfd-7267-4e1e-a904-82e047c62b88 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:16:50.887105 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d67cfd-7267-4e1e-a904-82e047c62b88 None admin] PATH_INFO: `/v3/users` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:16:50.887857 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d67cfd-7267-4e1e-a904-82e047c62b88 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:16:50.888179 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d67cfd-7267-4e1e-a904-82e047c62b88 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:16:50.889643 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d67cfd-7267-4e1e-a904-82e047c62b88 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:16:50.908907 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 614/1213] 10.222.0.66 () {56 vars in 1143 bytes} [Mon Sep 19 10:16:50 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:16:50.915044 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c0730a-a272-4090-91c3-a2fde6eba568 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:16:51.047817 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c0730a-a272-4090-91c3-a2fde6eba568 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:16:51.092308 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3224a7c0-5a1e-4515-817b-2a8e38ecba1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:16:51.092953 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3224a7c0-5a1e-4515-817b-2a8e38ecba1e None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:16:51.093283 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3224a7c0-5a1e-4515-817b-2a8e38ecba1e None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:16:51.093564 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3224a7c0-5a1e-4515-817b-2a8e38ecba1e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:16:51.128770 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:16:51.174323 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3224a7c0-5a1e-4515-817b-2a8e38ecba1e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:16:51.176097 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3224a7c0-5a1e-4515-817b-2a8e38ecba1e None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:16:51.296590 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 600/1214] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Sep 19 10:16:50 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 19 10:16:51.297980 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d67cfd-7267-4e1e-a904-82e047c62b88 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:16:51.328883 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:16:51.429729 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d67cfd-7267-4e1e-a904-82e047c62b88 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:16:51.467242 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b04e20c-ef1c-4080-a41d-98469b5d909e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:16:51.467888 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b04e20c-ef1c-4080-a41d-98469b5d909e None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:16:51.468887 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b04e20c-ef1c-4080-a41d-98469b5d909e None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:16:51.469103 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b04e20c-ef1c-4080-a41d-98469b5d909e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:16:51.485475 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b04e20c-ef1c-4080-a41d-98469b5d909e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:16:51.486920 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b04e20c-ef1c-4080-a41d-98469b5d909e None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:16:51.503226 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-0b04e20c-ef1c-4080-a41d-98469b5d909e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 10:16:51.503226 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:16:51.503226 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:16:51.503226 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:16:51.503226 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:16:51.503226 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:16:51.503226 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:16:51.503226 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:16:51.503226 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:16:51.503226 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:16:51.503226 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:16:51.503226 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:16:51.503226 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 10:16:51.503226 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 10:16:51.503226 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 10:16:51.503226 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 10:16:51.509374 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:16:51.509374 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:16:51.509374 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:16:51.509374 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:16:51.509374 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:16:51.509374 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:16:51.509374 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:16:51.509374 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 19 10:16:51.509374 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:16:51.509374 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:16:51.509374 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:16:51.509374 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:16:51.509374 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:16:51.509374 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:16:51.509374 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:16:51.509374 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:16:51.509374 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 10:16:51.510441 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 10:16:51.510441 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 10:16:51.510441 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 19 10:16:51.510441 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 615/1215] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 19 10:16:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:16:51.510689 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3224a7c0-5a1e-4515-817b-2a8e38ecba1e None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:16:51.582951 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:16:51.632281 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3224a7c0-5a1e-4515-817b-2a8e38ecba1e None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:16:51.680620 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b734c94-f0fd-42b6-8556-54faf118d0b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:16:51.682726 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b734c94-f0fd-42b6-8556-54faf118d0b0 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:16:51.682992 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b734c94-f0fd-42b6-8556-54faf118d0b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:16:51.683324 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b734c94-f0fd-42b6-8556-54faf118d0b0 None admin] PATH_INFO: `/v3/domains` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:16:51.683882 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b734c94-f0fd-42b6-8556-54faf118d0b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:16:51.684205 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b734c94-f0fd-42b6-8556-54faf118d0b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:16:51.686013 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b734c94-f0fd-42b6-8556-54faf118d0b0 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:16:51.702879 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 601/1216] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Sep 19 10:16:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 10:16:51.709327 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b04e20c-ef1c-4080-a41d-98469b5d909e None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:16:51.784363 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:16:51.820371 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b04e20c-ef1c-4080-a41d-98469b5d909e None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:16:51.863220 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65f6df0-744d-45dd-bab5-c31a6d7fc235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:16:51.863873 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65f6df0-744d-45dd-bab5-c31a6d7fc235 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:16:51.864195 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65f6df0-744d-45dd-bab5-c31a6d7fc235 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:16:51.864583 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65f6df0-744d-45dd-bab5-c31a6d7fc235 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:16:51.872367 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65f6df0-744d-45dd-bab5-c31a6d7fc235 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:16:51.873857 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65f6df0-744d-45dd-bab5-c31a6d7fc235 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:16:51.888950 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-e65f6df0-744d-45dd-bab5-c31a6d7fc235 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 10:16:51.888950 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:16:51.888950 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:16:51.888950 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:16:51.888950 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:16:51.888950 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:16:51.888950 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:16:51.888950 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:16:51.888950 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:16:51.888950 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:16:51.888950 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:16:51.888950 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:16:51.888950 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 10:16:51.888950 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 10:16:51.888950 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 10:16:51.890211 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 10:16:51.890211 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:16:51.890211 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:16:51.890211 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:16:51.890211 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:16:51.890211 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:16:51.890211 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:16:51.890211 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:16:51.890211 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 19 10:16:51.890211 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:16:51.890211 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:16:51.890211 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:16:51.890211 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:16:51.890211 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:16:51.890211 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:16:51.890211 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:16:51.890211 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:16:51.892284 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 10:16:51.892284 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 10:16:51.892284 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 10:16:51.892284 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 10:16:51.892284 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 10:16:51.892284 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 10:16:51.892284 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 10:16:51.892284 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 19 10:16:51.892284 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 616/1217] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Sep 19 10:16:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:16:51.894322 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b734c94-f0fd-42b6-8556-54faf118d0b0 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:16:52.019031 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b734c94-f0fd-42b6-8556-54faf118d0b0 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:16:52.045387 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:16:52.060391 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d62754-76a8-471d-b365-ca808a690d78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:16:52.061013 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d62754-76a8-471d-b365-ca808a690d78 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:16:52.061301 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d62754-76a8-471d-b365-ca808a690d78 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:16:52.061600 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d62754-76a8-471d-b365-ca808a690d78 None admin] PATH_INFO: `/v3/projects` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:16:52.062374 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d62754-76a8-471d-b365-ca808a690d78 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:16:52.062716 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d62754-76a8-471d-b365-ca808a690d78 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:16:52.064404 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d62754-76a8-471d-b365-ca808a690d78 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:16:52.083774 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 602/1218] 10.222.0.66 () {56 vars in 1148 bytes} [Mon Sep 19 10:16:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:16:52.090231 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65f6df0-744d-45dd-bab5-c31a6d7fc235 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:16:52.220483 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65f6df0-744d-45dd-bab5-c31a6d7fc235 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:16:52.258157 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:16:52.264603 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df879212-42af-4062-9b4e-7e08d79f934b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:16:52.265738 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df879212-42af-4062-9b4e-7e08d79f934b None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:16:52.266022 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df879212-42af-4062-9b4e-7e08d79f934b None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:16:52.266333 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df879212-42af-4062-9b4e-7e08d79f934b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:16:52.267174 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df879212-42af-4062-9b4e-7e08d79f934b None admin] RBAC: Adding query filter params (role.id=75952bc2767d49c1a6e49840d8a8f349, scope.project.id=be6b93ef3359434d9c776343f0aea333, user.id=46b78120cac64f09bd0f4cdc42424163) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:16:52.267481 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df879212-42af-4062-9b4e-7e08d79f934b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:16:52.268948 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df879212-42af-4062-9b4e-7e08d79f934b None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:16:52.275333 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 617/1219] 10.222.0.66 () {56 vars in 1374 bytes} [Mon Sep 19 10:16:52 2022] GET /identity/v3/role_assignments?user.id=46b78120cac64f09bd0f4cdc42424163&scope.project.id=be6b93ef3359434d9c776343f0aea333&role.id=75952bc2767d49c1a6e49840d8a8f349 => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:16:54.632412 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0cca4f-e792-4bd4-a948-f8bef8a587ea None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:16:54.633073 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0cca4f-e792-4bd4-a948-f8bef8a587ea None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:16:54.633073 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0cca4f-e792-4bd4-a948-f8bef8a587ea None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:16:54.634472 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 603/1220] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:16:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:16:54.639748 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b734346-6c47-4c9f-982e-041ab8fcfac4 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:16:54.640284 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b734346-6c47-4c9f-982e-041ab8fcfac4 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:16:54.640284 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b734346-6c47-4c9f-982e-041ab8fcfac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:16:54.660525 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-5b734346-6c47-4c9f-982e-041ab8fcfac4 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:16:54.661743 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-5b734346-6c47-4c9f-982e-041ab8fcfac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:16:54.744753 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 618/1221] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:16:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 10:16:55.042943 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0cca4f-e792-4bd4-a948-f8bef8a587ea None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:16:55.157172 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0cca4f-e792-4bd4-a948-f8bef8a587ea None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:16:55.197064 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd7e0a3-9265-4d58-97b5-c3d91ca6624d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:16:55.197821 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd7e0a3-9265-4d58-97b5-c3d91ca6624d None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:16:55.198126 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd7e0a3-9265-4d58-97b5-c3d91ca6624d None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:16:55.198541 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd7e0a3-9265-4d58-97b5-c3d91ca6624d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:16:55.209686 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd7e0a3-9265-4d58-97b5-c3d91ca6624d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 10:16:55.214655 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-4fd7e0a3-9265-4d58-97b5-c3d91ca6624d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 10:16:55.214655 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:16:55.214655 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:16:55.214655 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:16:55.214655 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:16:55.214655 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:16:55.214655 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:16:55.214655 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:16:55.214655 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:16:55.214655 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:16:55.214655 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:16:55.214655 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:16:55.214655 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 10:16:55.214655 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 10:16:55.214655 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 10:16:55.214655 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 10:16:55.215825 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 10:16:55.215825 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 10:16:55.215825 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 10:16:55.215825 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 10:16:55.215825 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:16:55.215825 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:16:55.215825 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:16:55.215825 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:16:55.215825 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:16:55.215825 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:16:55.215825 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:16:55.215825 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Sep 19 10:16:55.215825 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:16:55.215825 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:16:55.215825 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:16:55.215825 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:16:55.216762 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:16:55.216762 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:16:55.216762 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:16:55.216762 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:16:55.216762 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 10:16:55.216762 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 10:16:55.216762 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 10:16:55.216762 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 10:16:55.216762 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 10:16:55.216762 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 10:16:55.216762 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 10:16:55.216762 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Sep 19 10:16:55.216762 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 604/1222] 10.222.0.66 () {56 vars in 1102 bytes} [Mon Sep 19 10:16:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:16:55.222084 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b734346-6c47-4c9f-982e-041ab8fcfac4 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:16:55.331178 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b734346-6c47-4c9f-982e-041ab8fcfac4 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:16:55.356990 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:16:55.370263 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfc378a-4ad9-4f1a-9208-792a389d5f2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:16:55.370819 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfc378a-4ad9-4f1a-9208-792a389d5f2c None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:16:55.371088 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfc378a-4ad9-4f1a-9208-792a389d5f2c None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:16:55.371362 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfc378a-4ad9-4f1a-9208-792a389d5f2c None admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:16:55.372020 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfc378a-4ad9-4f1a-9208-792a389d5f2c None admin] RBAC: Adding query filter params (name=service) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:16:55.372382 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfc378a-4ad9-4f1a-9208-792a389d5f2c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:16:55.373764 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfc378a-4ad9-4f1a-9208-792a389d5f2c None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:16:55.383113 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 619/1223] 10.222.0.66 () {56 vars in 1103 bytes} [Mon Sep 19 10:16:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:16:55.388637 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd7e0a3-9265-4d58-97b5-c3d91ca6624d None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:16:55.433569 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:16:55.493124 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd7e0a3-9265-4d58-97b5-c3d91ca6624d None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:16:55.532855 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c385938b-28a1-417a-b040-34c79b80cfd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:16:55.533645 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c385938b-28a1-417a-b040-34c79b80cfd6 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:16:55.533914 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c385938b-28a1-417a-b040-34c79b80cfd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:16:55.534193 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c385938b-28a1-417a-b040-34c79b80cfd6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:16:55.545703 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c385938b-28a1-417a-b040-34c79b80cfd6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:16:55.547677 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c385938b-28a1-417a-b040-34c79b80cfd6 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:16:55.563157 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-c385938b-28a1-417a-b040-34c79b80cfd6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 10:16:55.563157 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:16:55.563157 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:16:55.563157 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:16:55.563157 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:16:55.563157 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:16:55.563157 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:16:55.563157 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:16:55.563157 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:16:55.563157 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:16:55.563157 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:16:55.563157 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:16:55.563157 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 10:16:55.563157 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 10:16:55.563157 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 10:16:55.563157 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 10:16:55.564396 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:16:55.564396 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:16:55.564396 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:16:55.564396 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:16:55.564396 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:16:55.564396 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:16:55.564396 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:16:55.564396 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Sep 19 10:16:55.564396 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:16:55.564396 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:16:55.564396 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:16:55.564396 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:16:55.564396 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:16:55.564396 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:16:55.564396 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:16:55.564396 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:16:55.564396 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 10:16:55.565325 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 10:16:55.565325 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 10:16:55.565325 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Sep 19 10:16:55.565325 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 605/1224] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 19 10:16:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 10:16:55.570449 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfc378a-4ad9-4f1a-9208-792a389d5f2c None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:16:55.694926 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfc378a-4ad9-4f1a-9208-792a389d5f2c None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:16:55.736150 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021b2c95-30cb-4d29-870d-8ae9e1c0cad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:16:55.736817 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021b2c95-30cb-4d29-870d-8ae9e1c0cad7 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:16:55.737099 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021b2c95-30cb-4d29-870d-8ae9e1c0cad7 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:16:55.737367 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021b2c95-30cb-4d29-870d-8ae9e1c0cad7 None admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:16:55.738065 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021b2c95-30cb-4d29-870d-8ae9e1c0cad7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:16:55.738340 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021b2c95-30cb-4d29-870d-8ae9e1c0cad7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:16:55.739678 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021b2c95-30cb-4d29-870d-8ae9e1c0cad7 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:16:55.758404 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 620/1225] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Sep 19 10:16:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:16:55.759599 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c385938b-28a1-417a-b040-34c79b80cfd6 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:16:55.874077 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:16:55.882806 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c385938b-28a1-417a-b040-34c79b80cfd6 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:16:55.926644 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837fcc98-1cb8-4d2f-b91f-54b8c6db7ee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:16:55.927328 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837fcc98-1cb8-4d2f-b91f-54b8c6db7ee7 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:16:55.927679 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837fcc98-1cb8-4d2f-b91f-54b8c6db7ee7 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:16:55.927863 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837fcc98-1cb8-4d2f-b91f-54b8c6db7ee7 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:16:55.937679 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837fcc98-1cb8-4d2f-b91f-54b8c6db7ee7 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:16:55.940042 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837fcc98-1cb8-4d2f-b91f-54b8c6db7ee7 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:16:55.954566 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-837fcc98-1cb8-4d2f-b91f-54b8c6db7ee7 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 19 10:16:55.954566 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:16:55.954566 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:16:55.954566 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:16:55.954566 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:16:55.954566 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:16:55.954566 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:16:55.954566 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:16:55.954566 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:16:55.954566 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:16:55.954566 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:16:55.954566 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:16:55.954566 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 10:16:55.954566 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 10:16:55.954566 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 10:16:55.954566 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 10:16:55.955926 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:16:55.955926 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:16:55.955926 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 10:16:55.955926 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 10:16:55.955926 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 10:16:55.955926 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 10:16:55.955926 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:16:55.955926 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:16:55.955926 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:16:55.955926 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:16:55.955926 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:16:55.955926 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Sep 19 10:16:55.955926 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:16:55.955926 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:16:55.955926 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:16:55.955926 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:16:55.955926 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:16:55.955926 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:16:55.956919 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:16:55.956919 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:16:55.956919 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 10:16:55.956919 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 10:16:55.956919 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 10:16:55.956919 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 10:16:55.956919 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 10:16:55.956919 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 10:16:55.956919 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 19 10:16:55.956919 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Sep 19 10:16:55.956919 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 606/1226] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 19 10:16:55 2022] GET /identity/v3/users/placement => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:16:55.961489 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021b2c95-30cb-4d29-870d-8ae9e1c0cad7 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:16:56.014640 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:16:56.067763 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021b2c95-30cb-4d29-870d-8ae9e1c0cad7 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:16:56.103749 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d06ff5c-1037-4c9e-9eea-717acd168a62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:16:56.104387 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d06ff5c-1037-4c9e-9eea-717acd168a62 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:16:56.104671 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d06ff5c-1037-4c9e-9eea-717acd168a62 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:16:56.104942 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d06ff5c-1037-4c9e-9eea-717acd168a62 None admin] PATH_INFO: `/v3/users` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:16:56.105658 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d06ff5c-1037-4c9e-9eea-717acd168a62 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:16:56.105961 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d06ff5c-1037-4c9e-9eea-717acd168a62 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:16:56.107388 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d06ff5c-1037-4c9e-9eea-717acd168a62 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:16:56.128057 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 621/1227] 10.222.0.66 () {56 vars in 1143 bytes} [Mon Sep 19 10:16:55 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:16:56.134497 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837fcc98-1cb8-4d2f-b91f-54b8c6db7ee7 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:16:56.253436 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837fcc98-1cb8-4d2f-b91f-54b8c6db7ee7 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:16:56.287746 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290b9f31-463c-462a-bb1c-491f5f4e7924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:16:56.288429 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290b9f31-463c-462a-bb1c-491f5f4e7924 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:16:56.288685 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290b9f31-463c-462a-bb1c-491f5f4e7924 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:16:56.288957 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290b9f31-463c-462a-bb1c-491f5f4e7924 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:16:56.301462 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290b9f31-463c-462a-bb1c-491f5f4e7924 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:16:56.302891 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290b9f31-463c-462a-bb1c-491f5f4e7924 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:16:56.319557 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-290b9f31-463c-462a-bb1c-491f5f4e7924 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 10:16:56.319557 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:16:56.319557 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:16:56.319557 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:16:56.319557 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:16:56.319557 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:16:56.319557 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:16:56.319557 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:16:56.319557 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:16:56.319557 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:16:56.319557 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:16:56.319557 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:16:56.319557 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 10:16:56.319557 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 10:16:56.319557 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 10:16:56.319557 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 10:16:56.321165 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:16:56.321165 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:16:56.321165 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:16:56.321165 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:16:56.321165 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:16:56.321165 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:16:56.321165 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:16:56.321165 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Sep 19 10:16:56.321165 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:16:56.321165 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:16:56.321165 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:16:56.321165 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:16:56.321165 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:16:56.321165 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:16:56.321165 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:16:56.321165 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:16:56.321165 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 10:16:56.322429 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 10:16:56.322429 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 10:16:56.322429 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Sep 19 10:16:56.322429 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 607/1228] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 19 10:16:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:16:56.327034 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d06ff5c-1037-4c9e-9eea-717acd168a62 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:16:56.446634 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d06ff5c-1037-4c9e-9eea-717acd168a62 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:16:56.448984 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:16:56.483263 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92804dfc-dc38-46b7-86e7-bfd064ec7c39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:16:56.483890 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92804dfc-dc38-46b7-86e7-bfd064ec7c39 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:16:56.484185 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92804dfc-dc38-46b7-86e7-bfd064ec7c39 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:16:56.484454 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92804dfc-dc38-46b7-86e7-bfd064ec7c39 None admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:16:56.485082 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92804dfc-dc38-46b7-86e7-bfd064ec7c39 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:16:56.485377 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92804dfc-dc38-46b7-86e7-bfd064ec7c39 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:16:56.486728 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92804dfc-dc38-46b7-86e7-bfd064ec7c39 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:16:56.498125 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 622/1229] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Sep 19 10:16:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:16:56.504396 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290b9f31-463c-462a-bb1c-491f5f4e7924 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:16:56.514096 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:16:56.614196 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290b9f31-463c-462a-bb1c-491f5f4e7924 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:16:56.653457 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721a086f-65e5-444a-b445-efa42b546dfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:16:56.654297 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721a086f-65e5-444a-b445-efa42b546dfd None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:16:56.654570 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721a086f-65e5-444a-b445-efa42b546dfd None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:16:56.654843 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721a086f-65e5-444a-b445-efa42b546dfd None admin] PATH_INFO: `/v3/projects/service` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:16:56.662116 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721a086f-65e5-444a-b445-efa42b546dfd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:16:56.663745 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721a086f-65e5-444a-b445-efa42b546dfd None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:16:56.678358 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-721a086f-65e5-444a-b445-efa42b546dfd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 10:16:56.678358 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:16:56.678358 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:16:56.678358 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:16:56.678358 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:16:56.678358 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:16:56.678358 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:16:56.678358 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:16:56.678358 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:16:56.678358 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:16:56.678358 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:16:56.678358 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:16:56.678358 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 10:16:56.678358 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 10:16:56.678358 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 10:16:56.679713 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 10:16:56.679713 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:16:56.679713 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:16:56.679713 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:16:56.679713 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:16:56.679713 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:16:56.679713 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:16:56.679713 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:16:56.679713 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Sep 19 10:16:56.679713 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:16:56.679713 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:16:56.679713 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:16:56.679713 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:16:56.679713 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:16:56.679713 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:16:56.679713 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:16:56.679713 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:16:56.681123 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 10:16:56.681123 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 10:16:56.681123 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 10:16:56.681123 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 10:16:56.681123 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 10:16:56.681123 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 10:16:56.681123 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 10:16:56.681123 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Sep 19 10:16:56.681123 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 608/1230] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Sep 19 10:16:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 10:16:56.686036 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92804dfc-dc38-46b7-86e7-bfd064ec7c39 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:16:56.799783 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92804dfc-dc38-46b7-86e7-bfd064ec7c39 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:16:56.843013 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a20f43b-e52d-45c5-8d8e-4b4a5a6accf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:16:56.843691 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a20f43b-e52d-45c5-8d8e-4b4a5a6accf3 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:16:56.843997 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a20f43b-e52d-45c5-8d8e-4b4a5a6accf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:16:56.844306 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a20f43b-e52d-45c5-8d8e-4b4a5a6accf3 None admin] PATH_INFO: `/v3/projects` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:16:56.845054 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a20f43b-e52d-45c5-8d8e-4b4a5a6accf3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:16:56.845409 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a20f43b-e52d-45c5-8d8e-4b4a5a6accf3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:16:56.847017 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a20f43b-e52d-45c5-8d8e-4b4a5a6accf3 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:16:56.860739 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 623/1231] 10.222.0.66 () {56 vars in 1148 bytes} [Mon Sep 19 10:16:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:16:56.867322 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721a086f-65e5-444a-b445-efa42b546dfd None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:16:56.949924 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:16:56.989573 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721a086f-65e5-444a-b445-efa42b546dfd None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:16:57.034653 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b7e38d-b6b6-4e11-9f93-9d405c21639a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:16:57.035616 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b7e38d-b6b6-4e11-9f93-9d405c21639a None admin] REQUEST_METHOD: `PUT` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:16:57.035893 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b7e38d-b6b6-4e11-9f93-9d405c21639a None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:16:57.036236 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b7e38d-b6b6-4e11-9f93-9d405c21639a None admin] PATH_INFO: `/v3/projects/be6b93ef3359434d9c776343f0aea333/users/46b78120cac64f09bd0f4cdc42424163/roles/75952bc2767d49c1a6e49840d8a8f349` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:16:57.052916 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b7e38d-b6b6-4e11-9f93-9d405c21639a None admin] RBAC: Authorizing `identity:create_grant(project_id=be6b93ef3359434d9c776343f0aea333, user_id=46b78120cac64f09bd0f4cdc42424163, role_id=75952bc2767d49c1a6e49840d8a8f349)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:16:57.054307 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b7e38d-b6b6-4e11-9f93-9d405c21639a None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:16:57.070046 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 609/1232] 10.222.0.66 () {58 vars in 1439 bytes} [Mon Sep 19 10:16:56 2022] PUT /identity/v3/projects/be6b93ef3359434d9c776343f0aea333/users/46b78120cac64f09bd0f4cdc42424163/roles/75952bc2767d49c1a6e49840d8a8f349 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 10:16:59.431008 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6633d927-036b-4edd-96b9-86e611bf9fc8 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:16:59.431598 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6633d927-036b-4edd-96b9-86e611bf9fc8 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:16:59.431705 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6633d927-036b-4edd-96b9-86e611bf9fc8 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:16:59.433051 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 624/1233] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:16:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:16:59.438945 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb2f63c-fe73-4d3f-9e42-d9b6736d27ba None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:16:59.439385 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb2f63c-fe73-4d3f-9e42-d9b6736d27ba None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:16:59.439502 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb2f63c-fe73-4d3f-9e42-d9b6736d27ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:16:59.458542 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-8eb2f63c-fe73-4d3f-9e42-d9b6736d27ba None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:16:59.459879 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-8eb2f63c-fe73-4d3f-9e42-d9b6736d27ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:16:59.538223 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 610/1234] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:16:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 10:16:59.859659 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6633d927-036b-4edd-96b9-86e611bf9fc8 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:16:59.892005 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:16:59.982077 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6633d927-036b-4edd-96b9-86e611bf9fc8 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:17:00.019645 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e31b14f-6ef8-4144-8824-2a8066c5807b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:17:00.020306 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e31b14f-6ef8-4144-8824-2a8066c5807b None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:17:00.020671 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e31b14f-6ef8-4144-8824-2a8066c5807b None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:17:00.020912 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e31b14f-6ef8-4144-8824-2a8066c5807b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:17:00.030949 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e31b14f-6ef8-4144-8824-2a8066c5807b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 10:17:00.035716 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-8e31b14f-6ef8-4144-8824-2a8066c5807b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 10:17:00.035716 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:17:00.035716 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:17:00.035716 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:17:00.035716 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:17:00.035716 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:17:00.035716 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:17:00.035716 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:17:00.035716 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:17:00.035716 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:17:00.035716 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:17:00.035716 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:17:00.035716 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 10:17:00.035716 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 10:17:00.035716 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 10:17:00.035716 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 10:17:00.036845 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 10:17:00.036845 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 10:17:00.036845 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 10:17:00.036845 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 10:17:00.036845 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:17:00.036845 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:17:00.036845 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:17:00.036845 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:17:00.036845 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:17:00.036845 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:17:00.036845 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:17:00.036845 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 19 10:17:00.036845 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:17:00.036845 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:17:00.036845 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:17:00.036845 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:17:00.037852 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:17:00.037852 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:17:00.037852 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:17:00.037852 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:17:00.037852 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 10:17:00.037852 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 10:17:00.037852 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 10:17:00.037852 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 10:17:00.037852 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 10:17:00.037852 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 10:17:00.037852 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 10:17:00.037852 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 19 10:17:00.037852 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 625/1235] 10.222.0.66 () {56 vars in 1102 bytes} [Mon Sep 19 10:16:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:17:00.042924 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb2f63c-fe73-4d3f-9e42-d9b6736d27ba None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:17:00.095936 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:17:00.157895 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb2f63c-fe73-4d3f-9e42-d9b6736d27ba None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:17:00.193996 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0e840c-4ae9-4e9e-aa9a-285c8d74d383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:17:00.194608 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0e840c-4ae9-4e9e-aa9a-285c8d74d383 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:17:00.194889 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0e840c-4ae9-4e9e-aa9a-285c8d74d383 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:17:00.195164 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0e840c-4ae9-4e9e-aa9a-285c8d74d383 None admin] PATH_INFO: `/v3/roles` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:17:00.195871 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0e840c-4ae9-4e9e-aa9a-285c8d74d383 None admin] RBAC: Adding query filter params (name=service) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:17:00.196129 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0e840c-4ae9-4e9e-aa9a-285c8d74d383 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:17:00.197529 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0e840c-4ae9-4e9e-aa9a-285c8d74d383 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:17:00.205559 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 611/1236] 10.222.0.66 () {56 vars in 1103 bytes} [Mon Sep 19 10:17:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:17:00.211252 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e31b14f-6ef8-4144-8824-2a8066c5807b None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:17:00.307138 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:17:00.332095 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e31b14f-6ef8-4144-8824-2a8066c5807b None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:17:00.374649 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7258a56-4c67-4f30-93d7-c9f03b6e34eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:17:00.375272 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7258a56-4c67-4f30-93d7-c9f03b6e34eb None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:17:00.375540 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7258a56-4c67-4f30-93d7-c9f03b6e34eb None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:17:00.375826 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7258a56-4c67-4f30-93d7-c9f03b6e34eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:17:00.391875 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7258a56-4c67-4f30-93d7-c9f03b6e34eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:17:00.393492 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7258a56-4c67-4f30-93d7-c9f03b6e34eb None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:17:00.410426 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-a7258a56-4c67-4f30-93d7-c9f03b6e34eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 10:17:00.410426 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:17:00.410426 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:17:00.410426 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:17:00.410426 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:17:00.410426 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:17:00.410426 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:17:00.410426 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:17:00.410426 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:17:00.410426 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:17:00.410426 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:17:00.410426 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:17:00.410426 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 10:17:00.410426 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 10:17:00.410426 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 10:17:00.410426 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 10:17:00.411661 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:17:00.411661 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:17:00.411661 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:17:00.411661 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:17:00.411661 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:17:00.411661 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:17:00.411661 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:17:00.411661 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 19 10:17:00.411661 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:17:00.411661 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:17:00.411661 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:17:00.411661 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:17:00.411661 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:17:00.411661 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:17:00.411661 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:17:00.411661 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:17:00.411661 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 10:17:00.412835 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 10:17:00.412835 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 10:17:00.412835 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 19 10:17:00.412835 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 626/1237] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 19 10:17:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:17:00.417797 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0e840c-4ae9-4e9e-aa9a-285c8d74d383 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:17:00.536689 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0e840c-4ae9-4e9e-aa9a-285c8d74d383 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:17:00.546524 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:17:00.572888 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245de8d9-60f2-4d2b-98b3-f48c4fc2231d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:17:00.573503 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245de8d9-60f2-4d2b-98b3-f48c4fc2231d None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:17:00.573886 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245de8d9-60f2-4d2b-98b3-f48c4fc2231d None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:17:00.574136 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245de8d9-60f2-4d2b-98b3-f48c4fc2231d None admin] PATH_INFO: `/v3/domains` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:17:00.574771 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245de8d9-60f2-4d2b-98b3-f48c4fc2231d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:17:00.575055 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245de8d9-60f2-4d2b-98b3-f48c4fc2231d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:17:00.576456 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245de8d9-60f2-4d2b-98b3-f48c4fc2231d None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:17:00.589487 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 612/1238] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Sep 19 10:17:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:17:00.595313 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7258a56-4c67-4f30-93d7-c9f03b6e34eb None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:17:00.707509 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7258a56-4c67-4f30-93d7-c9f03b6e34eb None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:17:00.749640 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daaa5b4-a83c-4489-a0f7-cd0a9d7020b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:17:00.750479 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daaa5b4-a83c-4489-a0f7-cd0a9d7020b9 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:17:00.750760 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daaa5b4-a83c-4489-a0f7-cd0a9d7020b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:17:00.751034 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daaa5b4-a83c-4489-a0f7-cd0a9d7020b9 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:17:00.754046 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:17:00.759954 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7daaa5b4-a83c-4489-a0f7-cd0a9d7020b9 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:17:00.761436 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7daaa5b4-a83c-4489-a0f7-cd0a9d7020b9 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:17:00.776277 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-7daaa5b4-a83c-4489-a0f7-cd0a9d7020b9 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 19 10:17:00.776277 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:17:00.776277 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:17:00.776277 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:17:00.776277 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:17:00.776277 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:17:00.776277 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:17:00.776277 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:17:00.776277 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:17:00.776277 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:17:00.776277 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:17:00.776277 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:17:00.776277 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 10:17:00.776277 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 10:17:00.776277 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 10:17:00.776277 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 10:17:00.777439 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:17:00.777439 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:17:00.777439 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 10:17:00.777439 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 10:17:00.777439 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 10:17:00.777439 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 10:17:00.777439 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:17:00.777439 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:17:00.777439 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:17:00.777439 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:17:00.777439 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:17:00.777439 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 19 10:17:00.777439 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:17:00.777439 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:17:00.777439 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:17:00.777439 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:17:00.777439 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:17:00.777439 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:17:00.778381 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:17:00.778381 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:17:00.778381 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 10:17:00.778381 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 10:17:00.778381 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 10:17:00.778381 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 10:17:00.778381 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 10:17:00.778381 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 10:17:00.778381 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 19 10:17:00.778381 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 19 10:17:00.778381 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 627/1239] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 19 10:17:00 2022] GET /identity/v3/users/placement => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 10:17:00.784596 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245de8d9-60f2-4d2b-98b3-f48c4fc2231d None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:17:00.897504 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245de8d9-60f2-4d2b-98b3-f48c4fc2231d None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:17:00.937005 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac69ad41-b623-4614-a8fb-e3b5675194c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:17:00.937731 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac69ad41-b623-4614-a8fb-e3b5675194c5 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:17:00.938069 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac69ad41-b623-4614-a8fb-e3b5675194c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:17:00.938389 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac69ad41-b623-4614-a8fb-e3b5675194c5 None admin] PATH_INFO: `/v3/users` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:17:00.939291 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac69ad41-b623-4614-a8fb-e3b5675194c5 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:17:00.939652 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac69ad41-b623-4614-a8fb-e3b5675194c5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:17:00.941333 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac69ad41-b623-4614-a8fb-e3b5675194c5 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:17:00.962406 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 613/1240] 10.222.0.66 () {56 vars in 1143 bytes} [Mon Sep 19 10:17:00 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:17:00.969020 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daaa5b4-a83c-4489-a0f7-cd0a9d7020b9 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:17:01.095235 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daaa5b4-a83c-4489-a0f7-cd0a9d7020b9 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:17:01.135309 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2287ae-bdbe-4c8f-8a89-f53be682b59d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:17:01.135956 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2287ae-bdbe-4c8f-8a89-f53be682b59d None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:17:01.136271 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2287ae-bdbe-4c8f-8a89-f53be682b59d None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:17:01.136544 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2287ae-bdbe-4c8f-8a89-f53be682b59d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:17:01.213679 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:17:01.222738 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2287ae-bdbe-4c8f-8a89-f53be682b59d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:17:01.225008 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2287ae-bdbe-4c8f-8a89-f53be682b59d None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:17:01.348942 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 628/1241] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Sep 19 10:17:00 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 19 10:17:01.354988 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac69ad41-b623-4614-a8fb-e3b5675194c5 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:17:01.389960 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:17:01.471325 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac69ad41-b623-4614-a8fb-e3b5675194c5 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:17:01.508641 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc887fc9-1742-488f-9cac-4012284edba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:17:01.509423 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc887fc9-1742-488f-9cac-4012284edba4 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:17:01.509743 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc887fc9-1742-488f-9cac-4012284edba4 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:17:01.510096 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc887fc9-1742-488f-9cac-4012284edba4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:17:01.522201 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc887fc9-1742-488f-9cac-4012284edba4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:17:01.523645 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc887fc9-1742-488f-9cac-4012284edba4 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:17:01.539836 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-dc887fc9-1742-488f-9cac-4012284edba4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 10:17:01.539836 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:17:01.539836 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:17:01.539836 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:17:01.539836 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:17:01.539836 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:17:01.539836 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:17:01.539836 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:17:01.539836 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:17:01.539836 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:17:01.539836 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:17:01.539836 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:17:01.539836 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 10:17:01.539836 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 10:17:01.539836 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 10:17:01.539836 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 10:17:01.541542 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:17:01.541542 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:17:01.541542 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:17:01.541542 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:17:01.541542 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:17:01.541542 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:17:01.541542 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:17:01.541542 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Sep 19 10:17:01.541542 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:17:01.541542 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:17:01.541542 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:17:01.541542 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:17:01.541542 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:17:01.541542 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:17:01.541542 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:17:01.541542 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:17:01.541542 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 10:17:01.542660 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 10:17:01.542660 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 10:17:01.542660 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Sep 19 10:17:01.542660 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 614/1242] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 19 10:17:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 10:17:01.547347 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2287ae-bdbe-4c8f-8a89-f53be682b59d None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:17:01.657575 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:17:01.665116 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2287ae-bdbe-4c8f-8a89-f53be682b59d None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:17:01.706982 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336d1876-f88a-4eee-821d-f39b32b8adf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:17:01.707599 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336d1876-f88a-4eee-821d-f39b32b8adf2 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:17:01.707880 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336d1876-f88a-4eee-821d-f39b32b8adf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:17:01.708153 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336d1876-f88a-4eee-821d-f39b32b8adf2 None admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:17:01.708822 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336d1876-f88a-4eee-821d-f39b32b8adf2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:17:01.709126 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336d1876-f88a-4eee-821d-f39b32b8adf2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:17:01.710499 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336d1876-f88a-4eee-821d-f39b32b8adf2 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:17:01.724274 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 629/1243] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Sep 19 10:17:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:17:01.729957 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc887fc9-1742-488f-9cac-4012284edba4 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:17:01.822199 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:17:01.848823 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc887fc9-1742-488f-9cac-4012284edba4 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:17:01.894191 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8b1083-d95b-4232-b820-aeef832ac1e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:17:01.895047 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8b1083-d95b-4232-b820-aeef832ac1e4 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:17:01.895332 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8b1083-d95b-4232-b820-aeef832ac1e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:17:01.895643 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8b1083-d95b-4232-b820-aeef832ac1e4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:17:01.903929 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8b1083-d95b-4232-b820-aeef832ac1e4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:17:01.905528 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8b1083-d95b-4232-b820-aeef832ac1e4 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:17:01.921701 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-bb8b1083-d95b-4232-b820-aeef832ac1e4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 10:17:01.921701 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:17:01.921701 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:17:01.921701 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:17:01.921701 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:17:01.921701 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:17:01.921701 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:17:01.921701 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:17:01.921701 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:17:01.921701 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:17:01.921701 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:17:01.921701 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:17:01.921701 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 10:17:01.921701 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 10:17:01.921701 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 10:17:01.922871 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 10:17:01.922871 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:17:01.922871 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:17:01.922871 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:17:01.922871 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:17:01.922871 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:17:01.922871 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:17:01.922871 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:17:01.922871 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Sep 19 10:17:01.922871 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:17:01.922871 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:17:01.922871 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:17:01.922871 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:17:01.922871 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:17:01.922871 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:17:01.922871 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:17:01.922871 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:17:01.924027 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 10:17:01.924027 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 10:17:01.924027 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 10:17:01.924027 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 10:17:01.924027 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 10:17:01.924027 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 10:17:01.924027 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 10:17:01.924027 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Sep 19 10:17:01.924027 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 615/1244] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Sep 19 10:17:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:17:01.928999 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336d1876-f88a-4eee-821d-f39b32b8adf2 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:17:02.050238 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336d1876-f88a-4eee-821d-f39b32b8adf2 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:17:02.088632 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fc9bcf-20d9-4f0e-ae27-f2d1cee4a642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:17:02.089244 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fc9bcf-20d9-4f0e-ae27-f2d1cee4a642 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:17:02.089518 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fc9bcf-20d9-4f0e-ae27-f2d1cee4a642 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:17:02.089792 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fc9bcf-20d9-4f0e-ae27-f2d1cee4a642 None admin] PATH_INFO: `/v3/projects` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:17:02.090515 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fc9bcf-20d9-4f0e-ae27-f2d1cee4a642 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:17:02.090839 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fc9bcf-20d9-4f0e-ae27-f2d1cee4a642 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:17:02.092411 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fc9bcf-20d9-4f0e-ae27-f2d1cee4a642 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:17:02.106436 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 630/1245] 10.222.0.66 () {56 vars in 1148 bytes} [Mon Sep 19 10:17:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:17:02.113363 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8b1083-d95b-4232-b820-aeef832ac1e4 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:17:02.236238 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8b1083-d95b-4232-b820-aeef832ac1e4 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:17:02.275593 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c39c918-93a0-4120-8600-685ff036e1dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:17:02.276284 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c39c918-93a0-4120-8600-685ff036e1dc None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:17:02.276529 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c39c918-93a0-4120-8600-685ff036e1dc None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:17:02.276797 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c39c918-93a0-4120-8600-685ff036e1dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:17:02.277626 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c39c918-93a0-4120-8600-685ff036e1dc None admin] RBAC: Adding query filter params (role.id=75952bc2767d49c1a6e49840d8a8f349, scope.project.id=be6b93ef3359434d9c776343f0aea333, user.id=46b78120cac64f09bd0f4cdc42424163) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:17:02.277956 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c39c918-93a0-4120-8600-685ff036e1dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:17:02.279409 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c39c918-93a0-4120-8600-685ff036e1dc None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:17:02.286038 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 616/1246] 10.222.0.66 () {56 vars in 1374 bytes} [Mon Sep 19 10:17:02 2022] GET /identity/v3/role_assignments?user.id=46b78120cac64f09bd0f4cdc42424163&scope.project.id=be6b93ef3359434d9c776343f0aea333&role.id=75952bc2767d49c1a6e49840d8a8f349 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:17:04.747230 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0972e3c5-03e7-4abe-88fb-1b155e6ea50f None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:17:04.747820 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0972e3c5-03e7-4abe-88fb-1b155e6ea50f None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:17:04.747917 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0972e3c5-03e7-4abe-88fb-1b155e6ea50f None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:17:04.750077 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 631/1247] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:17:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:17:04.755874 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a2b781-eca0-4c32-9eeb-7de2a6987f63 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:17:04.756463 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a2b781-eca0-4c32-9eeb-7de2a6987f63 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:17:04.756463 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a2b781-eca0-4c32-9eeb-7de2a6987f63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:17:04.763318 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:17:04.777158 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-a9a2b781-eca0-4c32-9eeb-7de2a6987f63 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:17:04.778391 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-a9a2b781-eca0-4c32-9eeb-7de2a6987f63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:17:04.855853 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 617/1248] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:17:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 10:17:05.142515 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0972e3c5-03e7-4abe-88fb-1b155e6ea50f None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:17:05.162938 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:17:05.261247 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0972e3c5-03e7-4abe-88fb-1b155e6ea50f None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:17:05.300406 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3f2442-b61d-4f0f-b9d9-2987d6ffb3bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:17:05.301104 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3f2442-b61d-4f0f-b9d9-2987d6ffb3bc None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:17:05.301471 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3f2442-b61d-4f0f-b9d9-2987d6ffb3bc None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:17:05.301761 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3f2442-b61d-4f0f-b9d9-2987d6ffb3bc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:17:05.313052 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3f2442-b61d-4f0f-b9d9-2987d6ffb3bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 10:17:05.318221 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-fe3f2442-b61d-4f0f-b9d9-2987d6ffb3bc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 10:17:05.318221 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:17:05.318221 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:17:05.318221 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:17:05.318221 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:17:05.318221 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:17:05.318221 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:17:05.318221 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:17:05.318221 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:17:05.318221 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:17:05.318221 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:17:05.318221 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:17:05.318221 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 10:17:05.318221 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 10:17:05.318221 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 10:17:05.318221 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 10:17:05.319450 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 10:17:05.319450 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 10:17:05.319450 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 10:17:05.319450 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 10:17:05.319450 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:17:05.319450 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:17:05.319450 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:17:05.319450 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:17:05.319450 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:17:05.319450 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:17:05.319450 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:17:05.319450 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 19 10:17:05.319450 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:17:05.319450 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:17:05.319450 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:17:05.319450 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:17:05.320548 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:17:05.320548 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:17:05.320548 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:17:05.320548 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:17:05.320548 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 10:17:05.320548 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 10:17:05.320548 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 10:17:05.320548 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 10:17:05.320548 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 10:17:05.320548 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 10:17:05.320548 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 10:17:05.320548 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 19 10:17:05.320548 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 632/1249] 10.222.0.66 () {56 vars in 1096 bytes} [Mon Sep 19 10:17:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:17:05.326318 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a2b781-eca0-4c32-9eeb-7de2a6987f63 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:17:05.439039 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a2b781-eca0-4c32-9eeb-7de2a6987f63 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:17:05.474027 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:17:05.481251 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc49fdd-b110-4743-9f25-a7922b877f52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:17:05.482169 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc49fdd-b110-4743-9f25-a7922b877f52 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:17:05.482590 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc49fdd-b110-4743-9f25-a7922b877f52 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:17:05.482957 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc49fdd-b110-4743-9f25-a7922b877f52 None admin] PATH_INFO: `/v3/roles` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:17:05.483936 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc49fdd-b110-4743-9f25-a7922b877f52 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:17:05.484286 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc49fdd-b110-4743-9f25-a7922b877f52 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:17:05.485893 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc49fdd-b110-4743-9f25-a7922b877f52 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:17:05.496599 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 618/1250] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Sep 19 10:17:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:17:05.502954 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3f2442-b61d-4f0f-b9d9-2987d6ffb3bc None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:17:05.592020 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:17:05.616623 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3f2442-b61d-4f0f-b9d9-2987d6ffb3bc None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:17:05.655999 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f203979-68a5-49dc-969f-24786c2c4ea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:17:05.656629 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f203979-68a5-49dc-969f-24786c2c4ea7 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:17:05.656912 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f203979-68a5-49dc-969f-24786c2c4ea7 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:17:05.657187 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f203979-68a5-49dc-969f-24786c2c4ea7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:17:05.667666 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f203979-68a5-49dc-969f-24786c2c4ea7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:17:05.669419 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f203979-68a5-49dc-969f-24786c2c4ea7 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:17:05.685229 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-1f203979-68a5-49dc-969f-24786c2c4ea7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 10:17:05.685229 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:17:05.685229 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:17:05.685229 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:17:05.685229 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:17:05.685229 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:17:05.685229 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:17:05.685229 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:17:05.685229 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:17:05.685229 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:17:05.685229 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:17:05.685229 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:17:05.685229 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 10:17:05.685229 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 10:17:05.685229 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 10:17:05.685229 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 10:17:05.687356 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:17:05.687356 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:17:05.687356 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:17:05.687356 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:17:05.687356 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:17:05.687356 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:17:05.687356 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:17:05.687356 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 19 10:17:05.687356 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:17:05.687356 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:17:05.687356 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:17:05.687356 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:17:05.687356 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:17:05.687356 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:17:05.687356 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:17:05.687356 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:17:05.687356 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 10:17:05.688470 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 10:17:05.688470 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 10:17:05.688470 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 19 10:17:05.688470 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 633/1251] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 19 10:17:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:17:05.692912 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc49fdd-b110-4743-9f25-a7922b877f52 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:17:05.810422 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc49fdd-b110-4743-9f25-a7922b877f52 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:17:05.848088 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f4d0ac-e929-4fa4-9da6-579445786328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:17:05.848727 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f4d0ac-e929-4fa4-9da6-579445786328 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:17:05.849007 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f4d0ac-e929-4fa4-9da6-579445786328 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:17:05.849279 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f4d0ac-e929-4fa4-9da6-579445786328 None admin] PATH_INFO: `/v3/domains` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:17:05.849924 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f4d0ac-e929-4fa4-9da6-579445786328 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:17:05.850228 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f4d0ac-e929-4fa4-9da6-579445786328 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:17:05.851613 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f4d0ac-e929-4fa4-9da6-579445786328 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:17:05.869246 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 619/1252] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Sep 19 10:17:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:17:05.870523 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f203979-68a5-49dc-969f-24786c2c4ea7 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:17:05.977960 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f203979-68a5-49dc-969f-24786c2c4ea7 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:17:06.006591 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:17:06.015607 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d939241-d824-4fd7-b894-2559753d5a4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:17:06.016306 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d939241-d824-4fd7-b894-2559753d5a4e None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:17:06.016591 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d939241-d824-4fd7-b894-2559753d5a4e None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:17:06.016868 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d939241-d824-4fd7-b894-2559753d5a4e None admin] PATH_INFO: `/v3/users/placement` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:17:06.025220 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d939241-d824-4fd7-b894-2559753d5a4e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:17:06.026695 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d939241-d824-4fd7-b894-2559753d5a4e None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:17:06.046976 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-8d939241-d824-4fd7-b894-2559753d5a4e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 19 10:17:06.046976 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:17:06.046976 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:17:06.046976 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:17:06.046976 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:17:06.046976 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:17:06.046976 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:17:06.046976 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:17:06.046976 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:17:06.046976 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:17:06.046976 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:17:06.046976 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:17:06.046976 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 10:17:06.046976 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 10:17:06.046976 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 10:17:06.046976 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 10:17:06.048217 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:17:06.048217 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:17:06.048217 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 10:17:06.048217 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 10:17:06.048217 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 10:17:06.048217 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 10:17:06.048217 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:17:06.048217 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:17:06.048217 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:17:06.048217 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:17:06.048217 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:17:06.048217 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 19 10:17:06.048217 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:17:06.048217 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:17:06.048217 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:17:06.048217 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:17:06.048217 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:17:06.048217 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:17:06.049192 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:17:06.049192 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:17:06.049192 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 10:17:06.049192 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 10:17:06.049192 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 10:17:06.049192 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 10:17:06.049192 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 10:17:06.049192 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 10:17:06.049192 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 19 10:17:06.049192 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 19 10:17:06.049192 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 634/1253] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 19 10:17:05 2022] GET /identity/v3/users/placement => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:17:06.054449 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f4d0ac-e929-4fa4-9da6-579445786328 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:17:06.113775 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:17:06.160029 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f4d0ac-e929-4fa4-9da6-579445786328 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:17:06.196105 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc7fc0d-2e37-4d53-afcd-89b94e0b45c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:17:06.198925 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc7fc0d-2e37-4d53-afcd-89b94e0b45c4 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:17:06.198925 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc7fc0d-2e37-4d53-afcd-89b94e0b45c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:17:06.198925 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc7fc0d-2e37-4d53-afcd-89b94e0b45c4 None admin] PATH_INFO: `/v3/users` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:17:06.198925 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc7fc0d-2e37-4d53-afcd-89b94e0b45c4 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:17:06.198925 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc7fc0d-2e37-4d53-afcd-89b94e0b45c4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:17:06.199768 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc7fc0d-2e37-4d53-afcd-89b94e0b45c4 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:17:06.219934 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 620/1254] 10.222.0.66 () {56 vars in 1143 bytes} [Mon Sep 19 10:17:06 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:17:06.225562 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d939241-d824-4fd7-b894-2559753d5a4e None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:17:06.334483 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d939241-d824-4fd7-b894-2559753d5a4e None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:17:06.376603 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61713715-9d76-4f5d-be8f-4ebf893f85d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:17:06.377214 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61713715-9d76-4f5d-be8f-4ebf893f85d3 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:17:06.377495 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61713715-9d76-4f5d-be8f-4ebf893f85d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:17:06.377769 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61713715-9d76-4f5d-be8f-4ebf893f85d3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:17:06.431182 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:17:06.443253 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61713715-9d76-4f5d-be8f-4ebf893f85d3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:17:06.444747 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61713715-9d76-4f5d-be8f-4ebf893f85d3 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:17:06.538435 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 635/1255] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Sep 19 10:17:06 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 19 10:17:06.544601 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc7fc0d-2e37-4d53-afcd-89b94e0b45c4 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:17:06.641882 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc7fc0d-2e37-4d53-afcd-89b94e0b45c4 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:17:06.654488 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:17:06.676576 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14d96a4-7718-4f5d-be3e-d7c1dde2dc6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:17:06.677205 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14d96a4-7718-4f5d-be3e-d7c1dde2dc6b None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:17:06.677486 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14d96a4-7718-4f5d-be3e-d7c1dde2dc6b None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:17:06.677761 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14d96a4-7718-4f5d-be3e-d7c1dde2dc6b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:17:06.688890 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14d96a4-7718-4f5d-be3e-d7c1dde2dc6b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:17:06.690338 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14d96a4-7718-4f5d-be3e-d7c1dde2dc6b None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:17:06.705184 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-a14d96a4-7718-4f5d-be3e-d7c1dde2dc6b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 10:17:06.705184 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:17:06.705184 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:17:06.705184 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:17:06.705184 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:17:06.705184 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:17:06.705184 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:17:06.705184 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:17:06.705184 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:17:06.705184 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:17:06.705184 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:17:06.705184 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:17:06.705184 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 10:17:06.705184 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 10:17:06.705184 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 10:17:06.705184 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 10:17:06.706321 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:17:06.706321 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:17:06.706321 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:17:06.706321 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:17:06.706321 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:17:06.706321 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:17:06.706321 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:17:06.706321 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Sep 19 10:17:06.706321 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:17:06.706321 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:17:06.706321 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:17:06.706321 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:17:06.706321 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:17:06.706321 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:17:06.706321 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:17:06.706321 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:17:06.706321 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 10:17:06.707287 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 10:17:06.707287 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 10:17:06.707287 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Sep 19 10:17:06.707287 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 621/1256] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 19 10:17:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:17:06.711968 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61713715-9d76-4f5d-be8f-4ebf893f85d3 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:17:06.795527 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:17:06.807530 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61713715-9d76-4f5d-be8f-4ebf893f85d3 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:17:06.840508 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7465c40-bc06-4342-9c91-782f584d0005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:17:06.841109 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7465c40-bc06-4342-9c91-782f584d0005 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:17:06.841387 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7465c40-bc06-4342-9c91-782f584d0005 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:17:06.841657 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7465c40-bc06-4342-9c91-782f584d0005 None admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:17:06.842280 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7465c40-bc06-4342-9c91-782f584d0005 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:17:06.843163 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7465c40-bc06-4342-9c91-782f584d0005 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:17:06.844558 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7465c40-bc06-4342-9c91-782f584d0005 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:17:06.855485 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 636/1257] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Sep 19 10:17:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:17:06.861256 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14d96a4-7718-4f5d-be3e-d7c1dde2dc6b None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:17:06.960648 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14d96a4-7718-4f5d-be3e-d7c1dde2dc6b None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:17:06.998028 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fab188-8d2f-4df8-8fc8-811801761cf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:17:06.998651 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fab188-8d2f-4df8-8fc8-811801761cf7 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:17:06.998963 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fab188-8d2f-4df8-8fc8-811801761cf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:17:06.999243 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fab188-8d2f-4df8-8fc8-811801761cf7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:17:07.005779 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fab188-8d2f-4df8-8fc8-811801761cf7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:17:07.007223 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fab188-8d2f-4df8-8fc8-811801761cf7 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:17:07.018806 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-48fab188-8d2f-4df8-8fc8-811801761cf7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 10:17:07.018806 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:17:07.018806 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:17:07.018806 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:17:07.018806 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:17:07.018806 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:17:07.018806 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:17:07.018806 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:17:07.018806 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:17:07.018806 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:17:07.018806 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:17:07.018806 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:17:07.018806 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 10:17:07.018806 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 10:17:07.018806 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 10:17:07.019851 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 10:17:07.019851 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:17:07.019851 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:17:07.019851 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:17:07.019851 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:17:07.019851 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:17:07.019851 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:17:07.019851 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:17:07.019851 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Sep 19 10:17:07.019851 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:17:07.019851 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:17:07.019851 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:17:07.019851 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:17:07.019851 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:17:07.019851 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:17:07.019851 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:17:07.019851 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:17:07.021014 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 10:17:07.021014 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 10:17:07.021014 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 10:17:07.021014 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 10:17:07.021014 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 10:17:07.021014 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 10:17:07.021014 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 10:17:07.021014 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Sep 19 10:17:07.021014 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 622/1258] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Sep 19 10:17:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:17:07.025951 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7465c40-bc06-4342-9c91-782f584d0005 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:17:07.122193 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7465c40-bc06-4342-9c91-782f584d0005 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:17:07.154722 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc171e7-06a9-474f-bfec-b40416537c7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:17:07.155374 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc171e7-06a9-474f-bfec-b40416537c7b None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:17:07.155651 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc171e7-06a9-474f-bfec-b40416537c7b None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:17:07.155919 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc171e7-06a9-474f-bfec-b40416537c7b None admin] PATH_INFO: `/v3/projects` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:17:07.156623 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc171e7-06a9-474f-bfec-b40416537c7b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:17:07.156923 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc171e7-06a9-474f-bfec-b40416537c7b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:17:07.158330 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc171e7-06a9-474f-bfec-b40416537c7b None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:17:07.170720 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 637/1259] 10.222.0.66 () {56 vars in 1148 bytes} [Mon Sep 19 10:17:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:17:07.176862 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fab188-8d2f-4df8-8fc8-811801761cf7 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:17:07.202539 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:17:07.274874 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fab188-8d2f-4df8-8fc8-811801761cf7 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:17:07.309694 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d4c64f-cbaa-4bcf-9b9c-a2a05133433e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:17:07.310277 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d4c64f-cbaa-4bcf-9b9c-a2a05133433e None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:17:07.310563 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d4c64f-cbaa-4bcf-9b9c-a2a05133433e None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:17:07.310877 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d4c64f-cbaa-4bcf-9b9c-a2a05133433e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:17:07.312047 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d4c64f-cbaa-4bcf-9b9c-a2a05133433e None admin] RBAC: Adding query filter params (role.id=5c8b89fae4fa45bd944cbeaf442136e1, scope.project.id=be6b93ef3359434d9c776343f0aea333, user.id=46b78120cac64f09bd0f4cdc42424163) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:17:07.312391 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d4c64f-cbaa-4bcf-9b9c-a2a05133433e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:17:07.313830 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d4c64f-cbaa-4bcf-9b9c-a2a05133433e None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:17:07.319966 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 623/1260] 10.222.0.66 () {56 vars in 1374 bytes} [Mon Sep 19 10:17:07 2022] GET /identity/v3/role_assignments?user.id=46b78120cac64f09bd0f4cdc42424163&scope.project.id=be6b93ef3359434d9c776343f0aea333&role.id=5c8b89fae4fa45bd944cbeaf442136e1 => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:17:09.471140 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696da0e7-3c55-4f71-8d38-c8fff492ad8a None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:17:09.471663 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696da0e7-3c55-4f71-8d38-c8fff492ad8a None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:17:09.471663 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696da0e7-3c55-4f71-8d38-c8fff492ad8a None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:17:09.473045 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 638/1261] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:17:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:17:09.478391 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44c4bbd-85aa-4c3b-baa4-53e1c88c087b None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:17:09.478793 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44c4bbd-85aa-4c3b-baa4-53e1c88c087b None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:17:09.478940 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44c4bbd-85aa-4c3b-baa4-53e1c88c087b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:17:09.497693 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-c44c4bbd-85aa-4c3b-baa4-53e1c88c087b None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:17:09.499105 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-c44c4bbd-85aa-4c3b-baa4-53e1c88c087b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:17:09.565956 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 624/1262] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:17:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 10:17:09.832158 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696da0e7-3c55-4f71-8d38-c8fff492ad8a None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:17:09.843582 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:17:09.931429 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696da0e7-3c55-4f71-8d38-c8fff492ad8a None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:17:09.963852 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cad6ce-1c7c-4d14-a822-73852f639522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:17:09.964500 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cad6ce-1c7c-4d14-a822-73852f639522 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:17:09.964783 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cad6ce-1c7c-4d14-a822-73852f639522 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:17:09.965058 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cad6ce-1c7c-4d14-a822-73852f639522 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:17:09.975301 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cad6ce-1c7c-4d14-a822-73852f639522 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 10:17:09.980087 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-55cad6ce-1c7c-4d14-a822-73852f639522 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 10:17:09.980087 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:17:09.980087 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:17:09.980087 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:17:09.980087 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:17:09.980087 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:17:09.980087 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:17:09.980087 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:17:09.980087 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:17:09.980087 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:17:09.980087 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:17:09.980087 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:17:09.980087 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 10:17:09.980087 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 10:17:09.980087 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 10:17:09.980087 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 10:17:09.981174 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 10:17:09.981174 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 10:17:09.981174 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 10:17:09.981174 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 10:17:09.981174 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:17:09.981174 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:17:09.981174 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:17:09.981174 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:17:09.981174 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:17:09.981174 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:17:09.981174 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:17:09.981174 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 19 10:17:09.981174 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:17:09.981174 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:17:09.981174 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:17:09.981174 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:17:09.982017 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:17:09.982017 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:17:09.982017 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:17:09.982017 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:17:09.982017 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 10:17:09.982017 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 10:17:09.982017 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 10:17:09.982017 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 10:17:09.982017 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 10:17:09.982017 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 10:17:09.982017 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 10:17:09.982017 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 19 10:17:09.982017 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 639/1263] 10.222.0.66 () {56 vars in 1096 bytes} [Mon Sep 19 10:17:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:17:09.987305 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44c4bbd-85aa-4c3b-baa4-53e1c88c087b None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:17:10.004941 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:17:10.084397 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44c4bbd-85aa-4c3b-baa4-53e1c88c087b None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:17:10.116622 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40efb46b-d7b4-463a-b7ba-62c08499a244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:17:10.117224 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40efb46b-d7b4-463a-b7ba-62c08499a244 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:17:10.117506 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40efb46b-d7b4-463a-b7ba-62c08499a244 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:17:10.117780 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40efb46b-d7b4-463a-b7ba-62c08499a244 None admin] PATH_INFO: `/v3/roles` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:17:10.118430 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40efb46b-d7b4-463a-b7ba-62c08499a244 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:17:10.118792 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40efb46b-d7b4-463a-b7ba-62c08499a244 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:17:10.120107 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40efb46b-d7b4-463a-b7ba-62c08499a244 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:17:10.128502 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 625/1264] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Sep 19 10:17:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:17:10.134366 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cad6ce-1c7c-4d14-a822-73852f639522 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:17:10.200908 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:17:10.233793 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cad6ce-1c7c-4d14-a822-73852f639522 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:17:10.266949 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf80b8c8-f5ec-4c9b-9961-7a06b0c7206d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:17:10.267572 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf80b8c8-f5ec-4c9b-9961-7a06b0c7206d None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:17:10.267851 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf80b8c8-f5ec-4c9b-9961-7a06b0c7206d None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:17:10.268123 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf80b8c8-f5ec-4c9b-9961-7a06b0c7206d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:17:10.277775 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf80b8c8-f5ec-4c9b-9961-7a06b0c7206d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:17:10.279209 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf80b8c8-f5ec-4c9b-9961-7a06b0c7206d None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:17:10.293225 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-cf80b8c8-f5ec-4c9b-9961-7a06b0c7206d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 10:17:10.293225 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:17:10.293225 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:17:10.293225 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:17:10.293225 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:17:10.293225 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:17:10.293225 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:17:10.293225 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:17:10.293225 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:17:10.293225 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:17:10.293225 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:17:10.293225 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:17:10.293225 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 10:17:10.293225 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 10:17:10.293225 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 10:17:10.293225 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 10:17:10.294580 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:17:10.294580 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:17:10.294580 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:17:10.294580 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:17:10.294580 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:17:10.294580 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:17:10.294580 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:17:10.294580 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 19 10:17:10.294580 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:17:10.294580 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:17:10.294580 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:17:10.294580 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:17:10.294580 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:17:10.294580 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:17:10.294580 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:17:10.294580 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:17:10.294580 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 10:17:10.295467 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 10:17:10.295467 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 10:17:10.295467 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 19 10:17:10.295467 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 640/1265] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 19 10:17:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:17:10.300407 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40efb46b-d7b4-463a-b7ba-62c08499a244 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:17:10.400706 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:17:10.427088 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40efb46b-d7b4-463a-b7ba-62c08499a244 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:17:10.460311 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1f77ae-8cdb-439e-9fb7-aa7d0a7a05ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:17:10.460913 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1f77ae-8cdb-439e-9fb7-aa7d0a7a05ce None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:17:10.461197 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1f77ae-8cdb-439e-9fb7-aa7d0a7a05ce None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:17:10.461473 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1f77ae-8cdb-439e-9fb7-aa7d0a7a05ce None admin] PATH_INFO: `/v3/domains` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:17:10.462107 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1f77ae-8cdb-439e-9fb7-aa7d0a7a05ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:17:10.462408 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1f77ae-8cdb-439e-9fb7-aa7d0a7a05ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:17:10.463776 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1f77ae-8cdb-439e-9fb7-aa7d0a7a05ce None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:17:10.475249 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 626/1266] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Sep 19 10:17:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:17:10.480968 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf80b8c8-f5ec-4c9b-9961-7a06b0c7206d None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:17:10.576305 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf80b8c8-f5ec-4c9b-9961-7a06b0c7206d None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:17:10.595709 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:17:10.610221 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6233aa91-7b55-47b9-ba6c-d225019cc890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:17:10.610844 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6233aa91-7b55-47b9-ba6c-d225019cc890 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:17:10.611120 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6233aa91-7b55-47b9-ba6c-d225019cc890 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:17:10.611386 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6233aa91-7b55-47b9-ba6c-d225019cc890 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:17:10.618652 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6233aa91-7b55-47b9-ba6c-d225019cc890 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:17:10.620071 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6233aa91-7b55-47b9-ba6c-d225019cc890 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:17:10.631503 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-6233aa91-7b55-47b9-ba6c-d225019cc890 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 19 10:17:10.631503 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:17:10.631503 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:17:10.631503 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:17:10.631503 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:17:10.631503 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:17:10.631503 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:17:10.631503 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:17:10.631503 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:17:10.631503 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:17:10.631503 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:17:10.631503 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:17:10.631503 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 10:17:10.631503 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 10:17:10.631503 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 10:17:10.631503 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 10:17:10.632448 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:17:10.632448 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:17:10.632448 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 10:17:10.632448 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 10:17:10.632448 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 10:17:10.632448 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 10:17:10.632448 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:17:10.632448 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:17:10.632448 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:17:10.632448 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:17:10.632448 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:17:10.632448 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 19 10:17:10.632448 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:17:10.632448 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:17:10.632448 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:17:10.632448 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:17:10.632448 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:17:10.632448 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:17:10.633397 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:17:10.633397 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:17:10.633397 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 10:17:10.633397 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 10:17:10.633397 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 10:17:10.633397 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 10:17:10.633397 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 10:17:10.633397 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 10:17:10.633397 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 19 10:17:10.633397 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 19 10:17:10.633397 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 641/1267] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 19 10:17:10 2022] GET /identity/v3/users/placement => generated 87 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:17:10.638475 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1f77ae-8cdb-439e-9fb7-aa7d0a7a05ce None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:17:10.747679 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1f77ae-8cdb-439e-9fb7-aa7d0a7a05ce None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:17:10.785083 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf9e38a-0b16-4373-8d64-ee809378dcd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:17:10.785705 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf9e38a-0b16-4373-8d64-ee809378dcd0 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:17:10.785991 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf9e38a-0b16-4373-8d64-ee809378dcd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:17:10.786261 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf9e38a-0b16-4373-8d64-ee809378dcd0 None admin] PATH_INFO: `/v3/users` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:17:10.786997 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf9e38a-0b16-4373-8d64-ee809378dcd0 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:17:10.787328 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf9e38a-0b16-4373-8d64-ee809378dcd0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:17:10.788818 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf9e38a-0b16-4373-8d64-ee809378dcd0 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:17:10.798767 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:17:10.807640 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 627/1268] 10.222.0.66 () {56 vars in 1143 bytes} [Mon Sep 19 10:17:10 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:17:10.813570 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6233aa91-7b55-47b9-ba6c-d225019cc890 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:17:10.911020 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6233aa91-7b55-47b9-ba6c-d225019cc890 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:17:10.943917 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752e50d8-88f2-4cef-b9de-da86d37fe03b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:17:10.944565 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752e50d8-88f2-4cef-b9de-da86d37fe03b None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:17:10.944847 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752e50d8-88f2-4cef-b9de-da86d37fe03b None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:17:10.945117 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752e50d8-88f2-4cef-b9de-da86d37fe03b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:17:10.955261 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752e50d8-88f2-4cef-b9de-da86d37fe03b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:17:10.956754 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752e50d8-88f2-4cef-b9de-da86d37fe03b None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:17:10.970954 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-752e50d8-88f2-4cef-b9de-da86d37fe03b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 10:17:10.970954 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:17:10.970954 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:17:10.970954 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:17:10.970954 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:17:10.970954 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:17:10.970954 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:17:10.970954 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:17:10.970954 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:17:10.970954 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:17:10.970954 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:17:10.970954 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:17:10.970954 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 10:17:10.970954 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 10:17:10.970954 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 10:17:10.970954 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 10:17:10.976267 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:17:10.976267 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:17:10.976267 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:17:10.976267 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:17:10.976267 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:17:10.976267 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:17:10.976267 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:17:10.976267 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 19 10:17:10.976267 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:17:10.976267 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:17:10.976267 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:17:10.976267 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:17:10.976267 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:17:10.976267 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:17:10.976267 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:17:10.976267 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:17:10.976267 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 10:17:10.977500 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 10:17:10.977500 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 10:17:10.977500 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 19 10:17:10.977500 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 642/1269] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 19 10:17:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:17:10.979015 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf9e38a-0b16-4373-8d64-ee809378dcd0 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:17:11.075973 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf9e38a-0b16-4373-8d64-ee809378dcd0 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:17:11.109129 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c72cffd-8c7a-4089-bc3c-2b151003bac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:17:11.109720 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c72cffd-8c7a-4089-bc3c-2b151003bac1 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:17:11.110000 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c72cffd-8c7a-4089-bc3c-2b151003bac1 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:17:11.110273 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c72cffd-8c7a-4089-bc3c-2b151003bac1 None admin] PATH_INFO: `/v3/domains` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:17:11.110908 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c72cffd-8c7a-4089-bc3c-2b151003bac1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:17:11.111212 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c72cffd-8c7a-4089-bc3c-2b151003bac1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:17:11.112619 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c72cffd-8c7a-4089-bc3c-2b151003bac1 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:17:11.123479 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 628/1270] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Sep 19 10:17:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:17:11.129321 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752e50d8-88f2-4cef-b9de-da86d37fe03b None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:17:11.160026 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:17:11.227505 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752e50d8-88f2-4cef-b9de-da86d37fe03b None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:17:11.259648 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5034de-8fdb-4919-b368-5e8296a712a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:17:11.260305 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5034de-8fdb-4919-b368-5e8296a712a9 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:17:11.260587 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5034de-8fdb-4919-b368-5e8296a712a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:17:11.260859 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5034de-8fdb-4919-b368-5e8296a712a9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:17:11.267806 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5034de-8fdb-4919-b368-5e8296a712a9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:17:11.269278 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5034de-8fdb-4919-b368-5e8296a712a9 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:17:11.280799 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-ac5034de-8fdb-4919-b368-5e8296a712a9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 10:17:11.280799 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:17:11.280799 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:17:11.280799 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:17:11.280799 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:17:11.280799 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:17:11.280799 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:17:11.280799 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:17:11.280799 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:17:11.280799 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:17:11.280799 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:17:11.280799 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:17:11.280799 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 10:17:11.280799 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 10:17:11.280799 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 10:17:11.281858 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 10:17:11.281858 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:17:11.281858 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:17:11.281858 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:17:11.281858 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:17:11.281858 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:17:11.281858 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:17:11.281858 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:17:11.281858 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 19 10:17:11.281858 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:17:11.281858 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:17:11.281858 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:17:11.281858 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:17:11.281858 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:17:11.281858 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:17:11.281858 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:17:11.281858 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:17:11.282967 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 10:17:11.282967 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 10:17:11.282967 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 10:17:11.282967 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 10:17:11.282967 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 10:17:11.282967 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 10:17:11.282967 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 10:17:11.282967 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 19 10:17:11.282967 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 643/1271] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Sep 19 10:17:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:17:11.287747 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c72cffd-8c7a-4089-bc3c-2b151003bac1 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:17:11.351760 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:17:11.392731 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c72cffd-8c7a-4089-bc3c-2b151003bac1 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:17:11.427479 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf809ac4-d25a-40b2-9c71-5aeffbff226b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:17:11.428079 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf809ac4-d25a-40b2-9c71-5aeffbff226b None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:17:11.428389 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf809ac4-d25a-40b2-9c71-5aeffbff226b None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:17:11.428668 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf809ac4-d25a-40b2-9c71-5aeffbff226b None admin] PATH_INFO: `/v3/projects` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:17:11.429349 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf809ac4-d25a-40b2-9c71-5aeffbff226b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:17:11.429654 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf809ac4-d25a-40b2-9c71-5aeffbff226b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:17:11.431093 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf809ac4-d25a-40b2-9c71-5aeffbff226b None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:17:11.442763 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 629/1272] 10.222.0.66 () {56 vars in 1148 bytes} [Mon Sep 19 10:17:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:17:11.448745 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5034de-8fdb-4919-b368-5e8296a712a9 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:17:11.538269 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:17:11.547459 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5034de-8fdb-4919-b368-5e8296a712a9 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:17:11.580663 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296e87d0-3a95-4416-8b80-0f3ea1609ee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:17:11.581320 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296e87d0-3a95-4416-8b80-0f3ea1609ee3 None admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:17:11.581603 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296e87d0-3a95-4416-8b80-0f3ea1609ee3 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:17:11.581880 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296e87d0-3a95-4416-8b80-0f3ea1609ee3 None admin] PATH_INFO: `/v3/projects/be6b93ef3359434d9c776343f0aea333/users/46b78120cac64f09bd0f4cdc42424163/roles/5c8b89fae4fa45bd944cbeaf442136e1` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:17:11.583764 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296e87d0-3a95-4416-8b80-0f3ea1609ee3 None admin] RBAC: Authorizing `identity:create_grant(project_id=be6b93ef3359434d9c776343f0aea333, user_id=46b78120cac64f09bd0f4cdc42424163, role_id=5c8b89fae4fa45bd944cbeaf442136e1)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:17:11.585502 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296e87d0-3a95-4416-8b80-0f3ea1609ee3 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:17:11.598238 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 644/1273] 10.222.0.66 () {58 vars in 1439 bytes} [Mon Sep 19 10:17:11 2022] PUT /identity/v3/projects/be6b93ef3359434d9c776343f0aea333/users/46b78120cac64f09bd0f4cdc42424163/roles/5c8b89fae4fa45bd944cbeaf442136e1 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:17:13.751501 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f7dc84-706c-4802-b287-71866b319faa None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:17:13.752058 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f7dc84-706c-4802-b287-71866b319faa None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:17:13.752058 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f7dc84-706c-4802-b287-71866b319faa None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:17:13.753419 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 630/1274] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:17:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:17:13.758552 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f007d6-5c0f-41c0-a4ec-a6a702f8ace3 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:17:13.758933 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f007d6-5c0f-41c0-a4ec-a6a702f8ace3 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:17:13.759098 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f007d6-5c0f-41c0-a4ec-a6a702f8ace3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:17:13.777415 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-a4f007d6-5c0f-41c0-a4ec-a6a702f8ace3 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:17:13.778600 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-a4f007d6-5c0f-41c0-a4ec-a6a702f8ace3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:17:13.843651 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 645/1275] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:17:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 10:17:14.112454 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f7dc84-706c-4802-b287-71866b319faa None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:17:14.212762 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f7dc84-706c-4802-b287-71866b319faa None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:17:14.230750 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:17:14.249432 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc4fdc1-4693-4e60-b012-e77756eacb99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:17:14.250070 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc4fdc1-4693-4e60-b012-e77756eacb99 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:17:14.250351 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc4fdc1-4693-4e60-b012-e77756eacb99 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:17:14.250624 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc4fdc1-4693-4e60-b012-e77756eacb99 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:17:14.260419 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc4fdc1-4693-4e60-b012-e77756eacb99 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 10:17:14.265206 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-7bc4fdc1-4693-4e60-b012-e77756eacb99 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 10:17:14.265206 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:17:14.265206 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:17:14.265206 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:17:14.265206 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:17:14.265206 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:17:14.265206 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:17:14.265206 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:17:14.265206 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:17:14.265206 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:17:14.265206 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:17:14.265206 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:17:14.265206 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 10:17:14.265206 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 10:17:14.265206 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 10:17:14.265206 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 10:17:14.266319 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 10:17:14.266319 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 10:17:14.266319 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 10:17:14.266319 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 10:17:14.266319 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:17:14.266319 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:17:14.266319 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:17:14.266319 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:17:14.266319 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:17:14.266319 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:17:14.266319 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:17:14.266319 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Sep 19 10:17:14.266319 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:17:14.266319 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:17:14.266319 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:17:14.266319 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:17:14.267183 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:17:14.267183 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:17:14.267183 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:17:14.267183 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:17:14.267183 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 10:17:14.267183 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 10:17:14.267183 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 10:17:14.267183 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 10:17:14.267183 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 10:17:14.267183 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 10:17:14.267183 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 10:17:14.267183 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Sep 19 10:17:14.267183 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 631/1276] 10.222.0.66 () {56 vars in 1096 bytes} [Mon Sep 19 10:17:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:17:14.272366 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f007d6-5c0f-41c0-a4ec-a6a702f8ace3 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:17:14.359824 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:17:14.382931 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f007d6-5c0f-41c0-a4ec-a6a702f8ace3 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:17:14.415157 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deff97c-ab1a-438d-80c2-28cf76c5c58b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:17:14.415759 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deff97c-ab1a-438d-80c2-28cf76c5c58b None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:17:14.416041 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deff97c-ab1a-438d-80c2-28cf76c5c58b None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:17:14.416347 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deff97c-ab1a-438d-80c2-28cf76c5c58b None admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:17:14.417000 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6deff97c-ab1a-438d-80c2-28cf76c5c58b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:17:14.417302 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6deff97c-ab1a-438d-80c2-28cf76c5c58b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:17:14.418916 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6deff97c-ab1a-438d-80c2-28cf76c5c58b None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:17:14.427162 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 646/1277] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Sep 19 10:17:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:17:14.433156 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc4fdc1-4693-4e60-b012-e77756eacb99 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:17:14.531672 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc4fdc1-4693-4e60-b012-e77756eacb99 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:17:14.565962 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad312060-2ad8-453e-92cc-0bfb08f7e83d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:17:14.566584 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad312060-2ad8-453e-92cc-0bfb08f7e83d None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:17:14.566865 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad312060-2ad8-453e-92cc-0bfb08f7e83d None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:17:14.567141 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad312060-2ad8-453e-92cc-0bfb08f7e83d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:17:14.576935 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad312060-2ad8-453e-92cc-0bfb08f7e83d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:17:14.578380 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad312060-2ad8-453e-92cc-0bfb08f7e83d None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:17:14.594827 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-ad312060-2ad8-453e-92cc-0bfb08f7e83d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 10:17:14.594827 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:17:14.594827 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:17:14.594827 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:17:14.594827 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:17:14.594827 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:17:14.594827 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:17:14.594827 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:17:14.594827 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:17:14.594827 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:17:14.594827 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:17:14.594827 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:17:14.594827 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 10:17:14.594827 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 10:17:14.594827 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 10:17:14.594827 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 10:17:14.596193 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:17:14.596193 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:17:14.596193 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:17:14.596193 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:17:14.596193 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:17:14.596193 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:17:14.596193 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:17:14.596193 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Sep 19 10:17:14.596193 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:17:14.596193 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:17:14.596193 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:17:14.596193 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:17:14.596193 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:17:14.596193 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:17:14.596193 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:17:14.596193 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:17:14.596193 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 10:17:14.597330 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 10:17:14.597330 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 10:17:14.597330 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Sep 19 10:17:14.597330 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 632/1278] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 19 10:17:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:17:14.603482 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deff97c-ab1a-438d-80c2-28cf76c5c58b None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:17:14.701909 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deff97c-ab1a-438d-80c2-28cf76c5c58b None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:17:14.735138 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad55f90-34c9-4a94-9b22-094c14e14f96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:17:14.735733 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad55f90-34c9-4a94-9b22-094c14e14f96 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:17:14.736015 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad55f90-34c9-4a94-9b22-094c14e14f96 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:17:14.736321 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad55f90-34c9-4a94-9b22-094c14e14f96 None admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:17:14.736956 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad55f90-34c9-4a94-9b22-094c14e14f96 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:17:14.737260 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad55f90-34c9-4a94-9b22-094c14e14f96 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:17:14.738631 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad55f90-34c9-4a94-9b22-094c14e14f96 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:17:14.750084 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 647/1279] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Sep 19 10:17:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:17:14.756079 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad312060-2ad8-453e-92cc-0bfb08f7e83d None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:17:14.786590 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:17:14.854914 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad312060-2ad8-453e-92cc-0bfb08f7e83d None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:17:14.887689 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72959929-f466-46d6-9679-f05d9f60b8c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:17:14.888348 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72959929-f466-46d6-9679-f05d9f60b8c4 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:17:14.888630 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72959929-f466-46d6-9679-f05d9f60b8c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:17:14.888905 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72959929-f466-46d6-9679-f05d9f60b8c4 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:17:14.896431 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72959929-f466-46d6-9679-f05d9f60b8c4 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:17:14.897891 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72959929-f466-46d6-9679-f05d9f60b8c4 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:17:14.909835 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-72959929-f466-46d6-9679-f05d9f60b8c4 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 19 10:17:14.909835 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:17:14.909835 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:17:14.909835 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:17:14.909835 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:17:14.909835 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:17:14.909835 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:17:14.909835 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:17:14.909835 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:17:14.909835 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:17:14.909835 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:17:14.909835 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:17:14.909835 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 10:17:14.909835 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 10:17:14.909835 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 10:17:14.909835 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 10:17:14.910949 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:17:14.910949 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:17:14.910949 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 10:17:14.910949 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 10:17:14.910949 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 10:17:14.910949 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 10:17:14.910949 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:17:14.910949 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:17:14.910949 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:17:14.910949 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:17:14.910949 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:17:14.910949 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Sep 19 10:17:14.910949 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:17:14.910949 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:17:14.910949 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:17:14.910949 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:17:14.910949 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:17:14.910949 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:17:14.911892 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:17:14.911892 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:17:14.911892 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 10:17:14.911892 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 10:17:14.911892 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 10:17:14.911892 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 10:17:14.911892 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 10:17:14.911892 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 10:17:14.911892 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 19 10:17:14.911892 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Sep 19 10:17:14.911892 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 633/1280] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 19 10:17:14 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:17:14.916888 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad55f90-34c9-4a94-9b22-094c14e14f96 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:17:14.921530 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:17:15.013637 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad55f90-34c9-4a94-9b22-094c14e14f96 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:17:15.048973 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422698d2-5d78-4a7c-a14f-a03134a20b1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:17:15.049575 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422698d2-5d78-4a7c-a14f-a03134a20b1b None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:17:15.049854 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422698d2-5d78-4a7c-a14f-a03134a20b1b None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:17:15.050126 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422698d2-5d78-4a7c-a14f-a03134a20b1b None admin] PATH_INFO: `/v3/users` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:17:15.050848 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422698d2-5d78-4a7c-a14f-a03134a20b1b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:17:15.051155 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422698d2-5d78-4a7c-a14f-a03134a20b1b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:17:15.052615 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422698d2-5d78-4a7c-a14f-a03134a20b1b None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:17:15.070066 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 648/1281] 10.222.0.66 () {56 vars in 1143 bytes} [Mon Sep 19 10:17:14 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:17:15.075832 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72959929-f466-46d6-9679-f05d9f60b8c4 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:17:15.161808 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:17:15.172687 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72959929-f466-46d6-9679-f05d9f60b8c4 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:17:15.205829 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069d81fe-7acb-4b82-bcad-e49d9b7ca59b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:17:15.206424 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069d81fe-7acb-4b82-bcad-e49d9b7ca59b None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:17:15.206706 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069d81fe-7acb-4b82-bcad-e49d9b7ca59b None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:17:15.206981 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069d81fe-7acb-4b82-bcad-e49d9b7ca59b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:17:15.272451 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069d81fe-7acb-4b82-bcad-e49d9b7ca59b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:17:15.273833 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069d81fe-7acb-4b82-bcad-e49d9b7ca59b None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:17:15.361092 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:17:15.371314 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 634/1282] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Sep 19 10:17:15 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 19 10:17:15.377173 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422698d2-5d78-4a7c-a14f-a03134a20b1b None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:17:15.436730 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:17:15.474226 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422698d2-5d78-4a7c-a14f-a03134a20b1b None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:17:15.507581 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fef173b-4033-4421-9423-09c93bd9d97e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:17:15.508339 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fef173b-4033-4421-9423-09c93bd9d97e None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:17:15.508521 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fef173b-4033-4421-9423-09c93bd9d97e None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:17:15.508794 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fef173b-4033-4421-9423-09c93bd9d97e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:17:15.518465 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fef173b-4033-4421-9423-09c93bd9d97e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:17:15.519900 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fef173b-4033-4421-9423-09c93bd9d97e None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:17:15.534465 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-8fef173b-4033-4421-9423-09c93bd9d97e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 10:17:15.534465 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:17:15.534465 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:17:15.534465 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:17:15.534465 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:17:15.534465 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:17:15.534465 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:17:15.534465 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:17:15.534465 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:17:15.534465 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:17:15.534465 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:17:15.534465 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:17:15.534465 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 10:17:15.534465 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 10:17:15.534465 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 10:17:15.534465 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 10:17:15.535683 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:17:15.535683 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:17:15.535683 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:17:15.535683 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:17:15.535683 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:17:15.535683 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:17:15.535683 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:17:15.535683 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 19 10:17:15.535683 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:17:15.535683 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:17:15.535683 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:17:15.535683 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:17:15.535683 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:17:15.535683 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:17:15.535683 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:17:15.535683 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:17:15.535683 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 10:17:15.536642 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 10:17:15.536642 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 10:17:15.536642 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 19 10:17:15.536642 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 649/1283] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 19 10:17:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:17:15.541270 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069d81fe-7acb-4b82-bcad-e49d9b7ca59b None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:17:15.637902 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069d81fe-7acb-4b82-bcad-e49d9b7ca59b None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:17:15.672846 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e36c4f8-692b-4cbe-b388-99b211003db9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:17:15.673453 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e36c4f8-692b-4cbe-b388-99b211003db9 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:17:15.673731 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e36c4f8-692b-4cbe-b388-99b211003db9 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:17:15.674002 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e36c4f8-692b-4cbe-b388-99b211003db9 None admin] PATH_INFO: `/v3/domains` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:17:15.674633 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e36c4f8-692b-4cbe-b388-99b211003db9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:17:15.674930 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e36c4f8-692b-4cbe-b388-99b211003db9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:17:15.676447 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e36c4f8-692b-4cbe-b388-99b211003db9 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:17:15.687773 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 635/1284] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Sep 19 10:17:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:17:15.693422 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fef173b-4033-4421-9423-09c93bd9d97e None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:17:15.790565 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fef173b-4033-4421-9423-09c93bd9d97e None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:17:15.803764 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:17:15.825276 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71995a14-e996-459e-b30d-5d442586f362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:17:15.825900 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71995a14-e996-459e-b30d-5d442586f362 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:17:15.826184 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71995a14-e996-459e-b30d-5d442586f362 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:17:15.826460 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71995a14-e996-459e-b30d-5d442586f362 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:17:15.833478 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71995a14-e996-459e-b30d-5d442586f362 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:17:15.834919 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71995a14-e996-459e-b30d-5d442586f362 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:17:15.846440 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-71995a14-e996-459e-b30d-5d442586f362 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 10:17:15.846440 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:17:15.846440 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:17:15.846440 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:17:15.846440 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:17:15.846440 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:17:15.846440 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:17:15.846440 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:17:15.846440 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:17:15.846440 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:17:15.846440 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:17:15.846440 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:17:15.846440 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 10:17:15.846440 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 10:17:15.846440 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 10:17:15.847499 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 10:17:15.847499 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:17:15.847499 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:17:15.847499 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:17:15.847499 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:17:15.847499 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:17:15.847499 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:17:15.847499 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:17:15.847499 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 19 10:17:15.847499 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:17:15.847499 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:17:15.847499 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:17:15.847499 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:17:15.847499 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:17:15.847499 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:17:15.847499 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:17:15.847499 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:17:15.848485 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 10:17:15.848485 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 10:17:15.848485 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 10:17:15.848485 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 10:17:15.848485 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 10:17:15.848485 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 10:17:15.848485 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 10:17:15.848485 dv-cinder-858275-1-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 19 10:17:15.848485 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 650/1285] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Sep 19 10:17:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:17:15.853460 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e36c4f8-692b-4cbe-b388-99b211003db9 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:17:15.903861 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:17:15.954599 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e36c4f8-692b-4cbe-b388-99b211003db9 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:17:15.987169 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9265e8-882e-48ae-a911-be96da0fb22c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:17:15.987772 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9265e8-882e-48ae-a911-be96da0fb22c None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:17:15.988055 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9265e8-882e-48ae-a911-be96da0fb22c None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:17:15.988370 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9265e8-882e-48ae-a911-be96da0fb22c None admin] PATH_INFO: `/v3/projects` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:17:15.989054 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9265e8-882e-48ae-a911-be96da0fb22c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:17:15.989360 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9265e8-882e-48ae-a911-be96da0fb22c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:17:15.990793 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9265e8-882e-48ae-a911-be96da0fb22c None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:17:16.002303 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 636/1286] 10.222.0.66 () {56 vars in 1148 bytes} [Mon Sep 19 10:17:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:17:16.008430 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71995a14-e996-459e-b30d-5d442586f362 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:17:16.105703 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71995a14-e996-459e-b30d-5d442586f362 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:17:16.137357 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b19d96-4d00-4587-9d73-54cbdf430987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:17:16.137942 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b19d96-4d00-4587-9d73-54cbdf430987 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:17:16.138221 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b19d96-4d00-4587-9d73-54cbdf430987 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:17:16.138487 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b19d96-4d00-4587-9d73-54cbdf430987 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:17:16.139777 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b19d96-4d00-4587-9d73-54cbdf430987 None admin] RBAC: Adding query filter params (role.id=5c8b89fae4fa45bd944cbeaf442136e1, scope.project.id=be6b93ef3359434d9c776343f0aea333, user.id=46b78120cac64f09bd0f4cdc42424163) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:17:16.140078 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b19d96-4d00-4587-9d73-54cbdf430987 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:17:16.141518 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b19d96-4d00-4587-9d73-54cbdf430987 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:17:16.147140 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 651/1287] 10.222.0.66 () {56 vars in 1374 bytes} [Mon Sep 19 10:17:16 2022] GET /identity/v3/role_assignments?user.id=46b78120cac64f09bd0f4cdc42424163&scope.project.id=be6b93ef3359434d9c776343f0aea333&role.id=5c8b89fae4fa45bd944cbeaf442136e1 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:17:18.320332 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b206b6-39c1-47f7-af32-005708850a8c None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:17:18.321018 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b206b6-39c1-47f7-af32-005708850a8c None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:17:18.321018 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b206b6-39c1-47f7-af32-005708850a8c None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:17:18.322252 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 637/1288] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:17:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:17:18.327622 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e27184c-680b-4e30-92dc-09f8bd64cc97 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:17:18.328100 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e27184c-680b-4e30-92dc-09f8bd64cc97 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:17:18.328265 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e27184c-680b-4e30-92dc-09f8bd64cc97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:17:18.347674 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-4e27184c-680b-4e30-92dc-09f8bd64cc97 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:17:18.348926 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-4e27184c-680b-4e30-92dc-09f8bd64cc97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:17:18.383221 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:17:18.421767 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 652/1289] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:17:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 10:17:18.693753 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b206b6-39c1-47f7-af32-005708850a8c None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:17:18.795299 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b206b6-39c1-47f7-af32-005708850a8c None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:17:18.805892 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:17:18.829727 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f55089-8eeb-4049-a4c5-f63c95db9320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:17:18.830358 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f55089-8eeb-4049-a4c5-f63c95db9320 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:17:18.830641 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f55089-8eeb-4049-a4c5-f63c95db9320 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:17:18.830914 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f55089-8eeb-4049-a4c5-f63c95db9320 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:17:18.831490 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f55089-8eeb-4049-a4c5-f63c95db9320 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:17:18.832928 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f55089-8eeb-4049-a4c5-f63c95db9320 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:17:18.841498 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-a7f55089-8eeb-4049-a4c5-f63c95db9320 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 19 10:17:18.841498 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:17:18.841498 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 10:17:18.841498 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 10:17:18.841498 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 10:17:18.841498 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 10:17:18.841498 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 10:17:18.841498 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 10:17:18.841498 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 19 10:17:18.841498 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Sep 19 10:17:18.841498 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 10:17:18.841498 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Sep 19 10:17:18.841498 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:17:18.841498 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:17:18.841498 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:17:18.841498 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:17:18.841498 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:17:18.843225 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:17:18.843225 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:17:18.843225 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:17:18.843225 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:17:18.843225 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:17:18.843225 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:17:18.843225 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 10:17:18.843225 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 10:17:18.843225 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 10:17:18.843225 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 10:17:18.843225 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:17:18.843225 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:17:18.843225 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:17:18.843225 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:17:18.843225 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:17:18.843225 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:17:18.844306 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:17:18.844306 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Sep 19 10:17:18.844306 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:17:18.844306 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:17:18.844306 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:17:18.844306 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:17:18.844306 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:17:18.844306 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:17:18.844306 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:17:18.844306 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:17:18.844306 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 10:17:18.844306 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 10:17:18.844306 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 19 10:17:18.844306 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Sep 19 10:17:18.844306 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 638/1290] 10.222.0.66 () {56 vars in 1117 bytes} [Mon Sep 19 10:17:18 2022] GET /identity/v3/services/placement => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:17:18.849299 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e27184c-680b-4e30-92dc-09f8bd64cc97 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:17:18.949619 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e27184c-680b-4e30-92dc-09f8bd64cc97 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:17:18.982434 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6c0b5d-8ae6-4895-8367-5da7576d66c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:17:18.983059 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6c0b5d-8ae6-4895-8367-5da7576d66c1 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:17:18.983338 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6c0b5d-8ae6-4895-8367-5da7576d66c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:17:18.983609 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6c0b5d-8ae6-4895-8367-5da7576d66c1 None admin] PATH_INFO: `/v3/services` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:17:18.984250 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6c0b5d-8ae6-4895-8367-5da7576d66c1 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:17:18.984554 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6c0b5d-8ae6-4895-8367-5da7576d66c1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:17:18.985915 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6c0b5d-8ae6-4895-8367-5da7576d66c1 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:17:18.990550 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 653/1291] 10.222.0.66 () {56 vars in 1116 bytes} [Mon Sep 19 10:17:18 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:17:18.996529 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f55089-8eeb-4049-a4c5-f63c95db9320 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:17:19.094099 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f55089-8eeb-4049-a4c5-f63c95db9320 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:17:19.126348 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0eab9c-4100-4367-9e7c-75c94cc463db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:17:19.126950 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0eab9c-4100-4367-9e7c-75c94cc463db None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:17:19.127231 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0eab9c-4100-4367-9e7c-75c94cc463db None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:17:19.127505 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0eab9c-4100-4367-9e7c-75c94cc463db None admin] PATH_INFO: `/v3/services` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:17:19.128122 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0eab9c-4100-4367-9e7c-75c94cc463db None admin] RBAC: Adding query filter params (type=placement) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:17:19.128459 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0eab9c-4100-4367-9e7c-75c94cc463db None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:17:19.129826 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0eab9c-4100-4367-9e7c-75c94cc463db None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:17:19.134155 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 639/1292] 10.222.0.66 () {56 vars in 1116 bytes} [Mon Sep 19 10:17:18 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:17:21.262595 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42616848-0f53-4ab6-8eb8-6d41e546b462 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:17:21.263203 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42616848-0f53-4ab6-8eb8-6d41e546b462 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:17:21.263203 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42616848-0f53-4ab6-8eb8-6d41e546b462 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:17:21.264547 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 654/1293] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:17:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:17:21.271273 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952b7929-75bb-4211-9c1a-36d3cc4fee45 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:17:21.271742 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952b7929-75bb-4211-9c1a-36d3cc4fee45 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:17:21.271837 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952b7929-75bb-4211-9c1a-36d3cc4fee45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:17:21.294642 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-952b7929-75bb-4211-9c1a-36d3cc4fee45 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:17:21.296496 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-952b7929-75bb-4211-9c1a-36d3cc4fee45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:17:21.329611 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:17:21.372950 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 640/1294] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:17:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 10:17:21.642863 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42616848-0f53-4ab6-8eb8-6d41e546b462 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:17:21.674254 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:17:21.743491 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42616848-0f53-4ab6-8eb8-6d41e546b462 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:17:21.776675 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd75f216-74d2-4207-a959-1b952dd986a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:17:21.777274 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd75f216-74d2-4207-a959-1b952dd986a3 None admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:17:21.777549 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd75f216-74d2-4207-a959-1b952dd986a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:17:21.777816 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd75f216-74d2-4207-a959-1b952dd986a3 None admin] PATH_INFO: `/v3/services` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:17:21.778451 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd75f216-74d2-4207-a959-1b952dd986a3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:17:21.780559 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd75f216-74d2-4207-a959-1b952dd986a3 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:17:21.797360 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 655/1295] 10.222.0.66 () {60 vars in 1141 bytes} [Mon Sep 19 10:17:21 2022] POST /identity/v3/services => generated 246 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:17:23.994085 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8973d1-0a82-487e-b00e-7a96699ac0fc None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:17:23.994580 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8973d1-0a82-487e-b00e-7a96699ac0fc None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:17:23.994580 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8973d1-0a82-487e-b00e-7a96699ac0fc None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:17:23.995951 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 641/1296] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:17:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:17:24.001939 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a93c17e-337b-4c41-8003-ea73679e25aa None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:17:24.002326 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a93c17e-337b-4c41-8003-ea73679e25aa None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:17:24.002478 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a93c17e-337b-4c41-8003-ea73679e25aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:17:24.020302 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-4a93c17e-337b-4c41-8003-ea73679e25aa None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:17:24.021490 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-4a93c17e-337b-4c41-8003-ea73679e25aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:17:24.091178 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 656/1297] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:17:24 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 10:17:24.373650 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8973d1-0a82-487e-b00e-7a96699ac0fc None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:17:24.474147 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8973d1-0a82-487e-b00e-7a96699ac0fc None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:17:24.506715 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533d8d3f-9f64-40a2-9ee7-ff243efa131d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:17:24.507328 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533d8d3f-9f64-40a2-9ee7-ff243efa131d None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:17:24.507607 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533d8d3f-9f64-40a2-9ee7-ff243efa131d None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:17:24.507874 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533d8d3f-9f64-40a2-9ee7-ff243efa131d None admin] PATH_INFO: `/v3/services/placement` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:17:24.508471 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533d8d3f-9f64-40a2-9ee7-ff243efa131d None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:17:24.509825 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533d8d3f-9f64-40a2-9ee7-ff243efa131d None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:17:24.518322 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-533d8d3f-9f64-40a2-9ee7-ff243efa131d None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 19 10:17:24.518322 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:17:24.518322 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 10:17:24.518322 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 10:17:24.518322 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 10:17:24.518322 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 10:17:24.518322 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 10:17:24.518322 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 10:17:24.518322 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 19 10:17:24.518322 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Sep 19 10:17:24.518322 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 10:17:24.518322 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Sep 19 10:17:24.518322 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:17:24.518322 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:17:24.518322 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:17:24.518322 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:17:24.518322 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:17:24.519569 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:17:24.519569 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:17:24.519569 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:17:24.519569 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:17:24.519569 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:17:24.519569 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:17:24.519569 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 10:17:24.519569 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 10:17:24.519569 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 10:17:24.519569 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 10:17:24.519569 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:17:24.519569 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:17:24.519569 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:17:24.519569 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:17:24.519569 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:17:24.519569 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:17:24.520759 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:17:24.520759 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Sep 19 10:17:24.520759 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:17:24.520759 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:17:24.520759 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:17:24.520759 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:17:24.520759 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:17:24.520759 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:17:24.520759 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:17:24.520759 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:17:24.520759 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 10:17:24.520759 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 10:17:24.520759 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 19 10:17:24.520759 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Sep 19 10:17:24.520759 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 642/1298] 10.222.0.66 () {56 vars in 1117 bytes} [Mon Sep 19 10:17:24 2022] GET /identity/v3/services/placement => generated 90 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:17:24.525385 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a93c17e-337b-4c41-8003-ea73679e25aa None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:17:24.546085 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:17:24.625295 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a93c17e-337b-4c41-8003-ea73679e25aa None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:17:24.658003 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d237d42-fbd7-4ddf-873f-82b06bf352cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:17:24.658608 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d237d42-fbd7-4ddf-873f-82b06bf352cd None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:17:24.658891 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d237d42-fbd7-4ddf-873f-82b06bf352cd None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:17:24.659166 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d237d42-fbd7-4ddf-873f-82b06bf352cd None admin] PATH_INFO: `/v3/services` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:17:24.659782 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d237d42-fbd7-4ddf-873f-82b06bf352cd None admin] RBAC: Adding query filter params (name=placement) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:17:24.660082 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d237d42-fbd7-4ddf-873f-82b06bf352cd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:17:24.661480 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d237d42-fbd7-4ddf-873f-82b06bf352cd None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:17:24.666568 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 657/1299] 10.222.0.66 () {56 vars in 1116 bytes} [Mon Sep 19 10:17:24 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:17:24.675322 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533d8d3f-9f64-40a2-9ee7-ff243efa131d None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:17:24.706905 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:17:24.773590 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533d8d3f-9f64-40a2-9ee7-ff243efa131d None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:17:24.807304 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258c366b-7483-4c6c-aa3b-6205eede6c1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:17:24.807906 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258c366b-7483-4c6c-aa3b-6205eede6c1a None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:17:24.808218 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258c366b-7483-4c6c-aa3b-6205eede6c1a None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:17:24.808493 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258c366b-7483-4c6c-aa3b-6205eede6c1a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:17:24.809184 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258c366b-7483-4c6c-aa3b-6205eede6c1a None admin] RBAC: Adding query filter params (interface=public, service_id=76a750d593184732acc9de9b18a7f6c7, region_id=RegionOne) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:17:24.809491 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258c366b-7483-4c6c-aa3b-6205eede6c1a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:17:24.810886 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258c366b-7483-4c6c-aa3b-6205eede6c1a None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:17:24.815722 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 643/1300] 10.222.0.66 () {56 vars in 1251 bytes} [Mon Sep 19 10:17:24 2022] GET /identity/v3/endpoints?service_id=76a750d593184732acc9de9b18a7f6c7&interface=public®ion_id=RegionOne => generated 194 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:17:24.821404 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d237d42-fbd7-4ddf-873f-82b06bf352cd None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:17:24.900783 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:17:24.919903 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d237d42-fbd7-4ddf-873f-82b06bf352cd None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:17:24.952713 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12900ac-be05-47b6-b866-863a2ef14d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:17:24.953310 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12900ac-be05-47b6-b866-863a2ef14d5f None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:17:24.953587 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12900ac-be05-47b6-b866-863a2ef14d5f None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:17:24.953858 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12900ac-be05-47b6-b866-863a2ef14d5f None admin] PATH_INFO: `/v3/services` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:17:24.954448 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12900ac-be05-47b6-b866-863a2ef14d5f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:17:24.955815 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12900ac-be05-47b6-b866-863a2ef14d5f None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:17:24.962444 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 658/1301] 10.222.0.66 () {56 vars in 1087 bytes} [Mon Sep 19 10:17:24 2022] GET /identity/v3/services => generated 2191 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 10:17:27.114933 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0021ca49-d56b-433d-9c00-d5efdfe9ecf1 None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:17:27.115518 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0021ca49-d56b-433d-9c00-d5efdfe9ecf1 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:17:27.115518 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0021ca49-d56b-433d-9c00-d5efdfe9ecf1 None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:17:27.116851 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 644/1302] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:17:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:17:27.122494 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0561fdd0-e1d4-402b-b7a7-86492fba6d30 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:17:27.122934 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0561fdd0-e1d4-402b-b7a7-86492fba6d30 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:17:27.123614 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0561fdd0-e1d4-402b-b7a7-86492fba6d30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:17:27.141388 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-0561fdd0-e1d4-402b-b7a7-86492fba6d30 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:17:27.142576 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-0561fdd0-e1d4-402b-b7a7-86492fba6d30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:17:27.207681 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 659/1303] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:17:27 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 10:17:27.484329 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0021ca49-d56b-433d-9c00-d5efdfe9ecf1 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:17:27.578095 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:17:27.589420 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0021ca49-d56b-433d-9c00-d5efdfe9ecf1 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:17:27.625287 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d84014-fc05-4d4c-89c7-4014400f44a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:17:27.625913 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d84014-fc05-4d4c-89c7-4014400f44a3 None admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:17:27.626193 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d84014-fc05-4d4c-89c7-4014400f44a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:17:27.626466 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d84014-fc05-4d4c-89c7-4014400f44a3 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:17:27.627069 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d84014-fc05-4d4c-89c7-4014400f44a3 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:17:27.628446 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d84014-fc05-4d4c-89c7-4014400f44a3 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:17:27.637184 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application [None req-93d84014-fc05-4d4c-89c7-4014400f44a3 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 19 10:17:27.637184 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:17:27.637184 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 10:17:27.637184 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 10:17:27.637184 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 10:17:27.637184 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 10:17:27.637184 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 10:17:27.637184 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 10:17:27.637184 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 19 10:17:27.637184 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Sep 19 10:17:27.637184 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 10:17:27.637184 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Sep 19 10:17:27.637184 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:17:27.637184 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:17:27.637184 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:17:27.637184 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:17:27.637184 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:17:27.638600 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:17:27.638600 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:17:27.638600 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:17:27.638600 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:17:27.638600 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:17:27.638600 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:17:27.638600 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 10:17:27.638600 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 10:17:27.638600 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 10:17:27.638600 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 10:17:27.638600 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:17:27.638600 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:17:27.638600 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:17:27.638600 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:17:27.638600 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:17:27.638600 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:17:27.639720 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:17:27.639720 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application with Lock( Sep 19 10:17:27.639720 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:17:27.639720 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:17:27.639720 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:17:27.639720 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:17:27.639720 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:17:27.639720 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:17:27.639720 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:17:27.639720 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:17:27.639720 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 10:17:27.639720 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 10:17:27.639720 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 19 10:17:27.639720 dv-cinder-858275-1-smb devstack@keystone.service[81352]: ERROR keystone.server.flask.application Sep 19 10:17:27.639720 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 645/1304] 10.222.0.66 () {56 vars in 1117 bytes} [Mon Sep 19 10:17:27 2022] GET /identity/v3/services/placement => generated 90 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:17:27.644357 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0561fdd0-e1d4-402b-b7a7-86492fba6d30 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:17:27.719001 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:17:27.741326 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0561fdd0-e1d4-402b-b7a7-86492fba6d30 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:17:27.776807 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf925f0-a2e2-4199-bd8a-a81bda18fba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:17:27.777411 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf925f0-a2e2-4199-bd8a-a81bda18fba0 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:17:27.777691 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf925f0-a2e2-4199-bd8a-a81bda18fba0 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:17:27.777960 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf925f0-a2e2-4199-bd8a-a81bda18fba0 None admin] PATH_INFO: `/v3/services` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:17:27.778578 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf925f0-a2e2-4199-bd8a-a81bda18fba0 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:17:27.778878 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf925f0-a2e2-4199-bd8a-a81bda18fba0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:17:27.780872 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf925f0-a2e2-4199-bd8a-a81bda18fba0 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:17:27.785918 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 660/1305] 10.222.0.66 () {56 vars in 1116 bytes} [Mon Sep 19 10:17:27 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:17:27.791930 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d84014-fc05-4d4c-89c7-4014400f44a3 None admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:17:27.892087 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d84014-fc05-4d4c-89c7-4014400f44a3 None admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:17:27.927037 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9489cb49-49cf-48e6-bc66-097d66126bc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:17:27.927636 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9489cb49-49cf-48e6-bc66-097d66126bc5 None admin] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:17:27.927915 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9489cb49-49cf-48e6-bc66-097d66126bc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:17:27.928211 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9489cb49-49cf-48e6-bc66-097d66126bc5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:17:27.928892 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9489cb49-49cf-48e6-bc66-097d66126bc5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:17:27.930287 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9489cb49-49cf-48e6-bc66-097d66126bc5 None admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:17:27.954347 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 646/1306] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 19 10:17:27 2022] POST /identity/v3/endpoints => generated 331 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:17:37.783294 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=30 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:17:37.947677 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:18:32.766072 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2343570b-52e1-4c06-95be-a14152ddb09a None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:18:32.766578 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2343570b-52e1-4c06-95be-a14152ddb09a None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:18:32.766664 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2343570b-52e1-4c06-95be-a14152ddb09a None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:18:32.771878 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 661/1307] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:18:32 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:18:32.773723 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26956517-c82c-43d3-8327-bd797f0d8464 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:18:32.774153 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26956517-c82c-43d3-8327-bd797f0d8464 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:18:32.774456 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26956517-c82c-43d3-8327-bd797f0d8464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:18:32.881541 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-26956517-c82c-43d3-8327-bd797f0d8464 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:18:32.882790 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-26956517-c82c-43d3-8327-bd797f0d8464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:18:33.004696 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 647/1308] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:18:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:18:33.297015 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af0a4fc-cbe1-4088-a830-0de969e80b6b None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:18:33.297304 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af0a4fc-cbe1-4088-a830-0de969e80b6b None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:18:33.297974 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af0a4fc-cbe1-4088-a830-0de969e80b6b None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:18:33.299525 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 662/1309] 10.222.0.66 () {54 vars in 963 bytes} [Mon Sep 19 10:18:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:18:33.306357 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca1e9ff-4786-4139-807d-590ae8ebe117 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:18:33.306677 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca1e9ff-4786-4139-807d-590ae8ebe117 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:18:33.307065 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca1e9ff-4786-4139-807d-590ae8ebe117 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:18:33.394350 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-1ca1e9ff-4786-4139-807d-590ae8ebe117 None None] MFA Rules not processed for user `0c1289b015854c6bb6aee8fed6b807db`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:18:33.395579 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-1ca1e9ff-4786-4139-807d-590ae8ebe117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:18:33.420284 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:18:33.485912 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 648/1310] 10.222.0.66 () {58 vars in 1060 bytes} [Mon Sep 19 10:18:33 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:18:33.495263 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af0a4fc-cbe1-4088-a830-0de969e80b6b None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:18:33.497046 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-3af0a4fc-cbe1-4088-a830-0de969e80b6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:18:33.616303 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af0a4fc-cbe1-4088-a830-0de969e80b6b None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:18:33.701014 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3891b1e6-97b8-444b-a035-1d0eb4cb7f2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c1289b015854c6bb6aee8fed6b807db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:18:33.701640 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3891b1e6-97b8-444b-a035-1d0eb4cb7f2c service neutron] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:18:33.701971 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3891b1e6-97b8-444b-a035-1d0eb4cb7f2c service neutron] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:18:33.702317 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3891b1e6-97b8-444b-a035-1d0eb4cb7f2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:18:33.703834 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-3891b1e6-97b8-444b-a035-1d0eb4cb7f2c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:18:33.762448 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:18:33.843763 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3891b1e6-97b8-444b-a035-1d0eb4cb7f2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:18:33.846082 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3891b1e6-97b8-444b-a035-1d0eb4cb7f2c service neutron] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:18:33.869466 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 663/1311] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:18:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 10:18:36.434480 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381f03fb-ee56-4c9b-aa83-885655e8d1c3 None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:18:36.434993 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381f03fb-ee56-4c9b-aa83-885655e8d1c3 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:18:36.435087 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381f03fb-ee56-4c9b-aa83-885655e8d1c3 None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:18:36.436385 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 649/1312] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:18:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:18:36.441523 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75a6145-d7cd-4141-9525-2f34960dd01d None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:18:36.441921 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75a6145-d7cd-4141-9525-2f34960dd01d None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:18:36.442067 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75a6145-d7cd-4141-9525-2f34960dd01d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:18:36.522946 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-e75a6145-d7cd-4141-9525-2f34960dd01d None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:18:36.524205 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-e75a6145-d7cd-4141-9525-2f34960dd01d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:18:36.622662 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 664/1313] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:18:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:18:36.911727 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381f03fb-ee56-4c9b-aa83-885655e8d1c3 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:18:36.913323 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-381f03fb-ee56-4c9b-aa83-885655e8d1c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:18:37.029284 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381f03fb-ee56-4c9b-aa83-885655e8d1c3 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:18:37.101606 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:18:37.103775 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a442a7ad-40e9-48f8-a03d-b4e23934fee7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c1289b015854c6bb6aee8fed6b807db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:18:37.104512 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a442a7ad-40e9-48f8-a03d-b4e23934fee7 service neutron] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:18:37.104800 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a442a7ad-40e9-48f8-a03d-b4e23934fee7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:18:37.105369 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a442a7ad-40e9-48f8-a03d-b4e23934fee7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:18:37.107376 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-a442a7ad-40e9-48f8-a03d-b4e23934fee7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:18:37.216147 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a442a7ad-40e9-48f8-a03d-b4e23934fee7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:18:37.217544 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a442a7ad-40e9-48f8-a03d-b4e23934fee7 service neutron] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:18:37.235517 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 650/1314] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:18:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:18:39.705937 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474cc7e4-f14a-466c-b94e-61d25e9fa099 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:18:39.706371 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474cc7e4-f14a-466c-b94e-61d25e9fa099 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:18:39.706483 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474cc7e4-f14a-466c-b94e-61d25e9fa099 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:18:39.707803 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 665/1315] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:18:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:18:39.713292 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd7e7e8-7265-4f22-9d9d-c879ae30db9f None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:18:39.713669 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd7e7e8-7265-4f22-9d9d-c879ae30db9f None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:18:39.713850 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd7e7e8-7265-4f22-9d9d-c879ae30db9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:18:39.779297 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-6fd7e7e8-7265-4f22-9d9d-c879ae30db9f None None] MFA Rules not processed for user `7a5ad9296c73487a8b276f2728c73013`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:18:39.780559 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-6fd7e7e8-7265-4f22-9d9d-c879ae30db9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:18:39.833595 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:18:39.880747 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 651/1316] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:18:39 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:18:40.169197 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474cc7e4-f14a-466c-b94e-61d25e9fa099 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:18:40.170769 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-474cc7e4-f14a-466c-b94e-61d25e9fa099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:18:40.180404 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:18:40.274000 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474cc7e4-f14a-466c-b94e-61d25e9fa099 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:18:40.347808 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94b5ee9-2e9e-4844-862e-7689af73fc84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c1289b015854c6bb6aee8fed6b807db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:18:40.348448 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94b5ee9-2e9e-4844-862e-7689af73fc84 service neutron] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:18:40.348723 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94b5ee9-2e9e-4844-862e-7689af73fc84 service neutron] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:18:40.348988 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94b5ee9-2e9e-4844-862e-7689af73fc84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:18:40.350574 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-c94b5ee9-2e9e-4844-862e-7689af73fc84 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:18:40.412051 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:18:40.460066 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94b5ee9-2e9e-4844-862e-7689af73fc84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:18:40.461446 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94b5ee9-2e9e-4844-862e-7689af73fc84 service neutron] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:18:40.480037 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 666/1317] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:18:40 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:18:43.196377 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4ae3ba-700a-47e3-b4ac-a7bba21fd52d None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:18:43.196954 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4ae3ba-700a-47e3-b4ac-a7bba21fd52d None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:18:43.196954 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4ae3ba-700a-47e3-b4ac-a7bba21fd52d None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:18:43.198427 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 652/1318] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:18:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:18:43.204333 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3471c888-bed6-45a5-8cbe-84b3d8cea590 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:18:43.204761 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3471c888-bed6-45a5-8cbe-84b3d8cea590 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:18:43.204882 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3471c888-bed6-45a5-8cbe-84b3d8cea590 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:18:43.276801 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-3471c888-bed6-45a5-8cbe-84b3d8cea590 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:18:43.278046 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-3471c888-bed6-45a5-8cbe-84b3d8cea590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:18:43.376875 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 667/1319] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:18:43 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:18:43.679009 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae28ed6d-8491-48bb-bb9d-0e5edc521598 None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:18:43.679294 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae28ed6d-8491-48bb-bb9d-0e5edc521598 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:18:43.679572 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae28ed6d-8491-48bb-bb9d-0e5edc521598 None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:18:43.680959 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 653/1320] 10.222.0.66 () {54 vars in 963 bytes} [Mon Sep 19 10:18:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:18:43.687591 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eca3012-800d-4077-ba74-b172975f6ffc None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:18:43.687936 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eca3012-800d-4077-ba74-b172975f6ffc None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:18:43.688149 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eca3012-800d-4077-ba74-b172975f6ffc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:18:43.711606 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:18:43.767974 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-1eca3012-800d-4077-ba74-b172975f6ffc None None] MFA Rules not processed for user `0c1289b015854c6bb6aee8fed6b807db`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:18:43.769259 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-1eca3012-800d-4077-ba74-b172975f6ffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:18:43.846230 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 668/1321] 10.222.0.66 () {58 vars in 1060 bytes} [Mon Sep 19 10:18:43 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:18:43.855897 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae28ed6d-8491-48bb-bb9d-0e5edc521598 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:18:43.857370 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-ae28ed6d-8491-48bb-bb9d-0e5edc521598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:18:43.962247 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae28ed6d-8491-48bb-bb9d-0e5edc521598 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:18:44.036590 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb4860e-7d6a-4bbe-a3f7-7a7146085cf0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c1289b015854c6bb6aee8fed6b807db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:18:44.037192 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb4860e-7d6a-4bbe-a3f7-7a7146085cf0 service neutron] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:18:44.037470 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb4860e-7d6a-4bbe-a3f7-7a7146085cf0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:18:44.037740 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb4860e-7d6a-4bbe-a3f7-7a7146085cf0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:18:44.039332 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-1bb4860e-7d6a-4bbe-a3f7-7a7146085cf0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:18:44.047103 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:18:44.151589 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb4860e-7d6a-4bbe-a3f7-7a7146085cf0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:18:44.153082 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb4860e-7d6a-4bbe-a3f7-7a7146085cf0 service neutron] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:18:44.172046 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 654/1322] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:18:43 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:18:47.455226 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821ab622-5ada-489c-9363-c29d70d837c2 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:18:47.455780 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821ab622-5ada-489c-9363-c29d70d837c2 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:18:47.455780 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821ab622-5ada-489c-9363-c29d70d837c2 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:18:47.457268 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 669/1323] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:18:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:18:47.462732 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c81420-4581-4cea-8b58-e9c55b7cd25d None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:18:47.463196 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c81420-4581-4cea-8b58-e9c55b7cd25d None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:18:47.463337 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c81420-4581-4cea-8b58-e9c55b7cd25d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:18:47.540144 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-40c81420-4581-4cea-8b58-e9c55b7cd25d None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:18:47.541536 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-40c81420-4581-4cea-8b58-e9c55b7cd25d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:18:47.607743 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:18:47.649323 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 655/1324] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:18:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:18:47.937583 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821ab622-5ada-489c-9363-c29d70d837c2 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:18:47.939133 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-821ab622-5ada-489c-9363-c29d70d837c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:18:48.046743 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821ab622-5ada-489c-9363-c29d70d837c2 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:18:48.059096 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:18:48.121053 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137e32d6-7d83-45b3-839f-77261dd042f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c1289b015854c6bb6aee8fed6b807db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:18:48.121661 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137e32d6-7d83-45b3-839f-77261dd042f7 service neutron] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:18:48.121938 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137e32d6-7d83-45b3-839f-77261dd042f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:18:48.122207 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137e32d6-7d83-45b3-839f-77261dd042f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:18:48.123797 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-137e32d6-7d83-45b3-839f-77261dd042f7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:18:48.237455 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137e32d6-7d83-45b3-839f-77261dd042f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:18:48.238828 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137e32d6-7d83-45b3-839f-77261dd042f7 service neutron] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:18:48.258187 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 670/1325] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:18:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 10:18:50.513647 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c805e082-dd34-498c-90c9-01b37863af1f None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:18:50.514195 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c805e082-dd34-498c-90c9-01b37863af1f None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:18:50.514389 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c805e082-dd34-498c-90c9-01b37863af1f None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:18:50.516724 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 656/1326] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:18:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:18:50.522273 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63f63dc-9638-4a44-92d3-efb2031881ef None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:18:50.522776 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63f63dc-9638-4a44-92d3-efb2031881ef None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:18:50.522960 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63f63dc-9638-4a44-92d3-efb2031881ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:18:50.575238 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:18:50.600306 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-d63f63dc-9638-4a44-92d3-efb2031881ef None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:18:50.601541 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-d63f63dc-9638-4a44-92d3-efb2031881ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:18:50.709395 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 671/1327] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:18:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:18:50.997636 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c805e082-dd34-498c-90c9-01b37863af1f None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:18:51.001450 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-c805e082-dd34-498c-90c9-01b37863af1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:18:51.109583 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c805e082-dd34-498c-90c9-01b37863af1f None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:18:51.184924 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8de6a7-f68f-49f5-b9d0-6d04a74ca81f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c1289b015854c6bb6aee8fed6b807db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:18:51.185535 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8de6a7-f68f-49f5-b9d0-6d04a74ca81f service neutron] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:18:51.185815 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8de6a7-f68f-49f5-b9d0-6d04a74ca81f service neutron] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:18:51.186087 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8de6a7-f68f-49f5-b9d0-6d04a74ca81f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:18:51.187679 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-5e8de6a7-f68f-49f5-b9d0-6d04a74ca81f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:18:51.205386 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:18:51.303069 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8de6a7-f68f-49f5-b9d0-6d04a74ca81f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:18:51.304830 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8de6a7-f68f-49f5-b9d0-6d04a74ca81f service neutron] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:18:51.326428 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 657/1328] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:18:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:18:53.596660 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ee560c-d212-4bcf-a36c-12da6e4e61c3 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:18:53.597175 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ee560c-d212-4bcf-a36c-12da6e4e61c3 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:18:53.597272 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ee560c-d212-4bcf-a36c-12da6e4e61c3 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:18:53.598596 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 672/1329] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:18:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:18:53.605042 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e9c4ae-6c86-4617-a7af-1a798034a907 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:18:53.605470 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e9c4ae-6c86-4617-a7af-1a798034a907 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:18:53.605652 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e9c4ae-6c86-4617-a7af-1a798034a907 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:18:53.672231 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-62e9c4ae-6c86-4617-a7af-1a798034a907 None None] MFA Rules not processed for user `7a5ad9296c73487a8b276f2728c73013`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:18:53.673477 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-62e9c4ae-6c86-4617-a7af-1a798034a907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:18:53.738548 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:18:53.770057 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 658/1330] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:18:53 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:18:54.059200 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ee560c-d212-4bcf-a36c-12da6e4e61c3 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:18:54.060751 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-c9ee560c-d212-4bcf-a36c-12da6e4e61c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:18:54.164896 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ee560c-d212-4bcf-a36c-12da6e4e61c3 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:18:54.186532 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:18:54.241127 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01472f96-b02f-48aa-9f97-11b88ee69acc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c1289b015854c6bb6aee8fed6b807db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:18:54.241742 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01472f96-b02f-48aa-9f97-11b88ee69acc service neutron] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:18:54.242024 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01472f96-b02f-48aa-9f97-11b88ee69acc service neutron] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:18:54.242295 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01472f96-b02f-48aa-9f97-11b88ee69acc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:18:54.243953 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-01472f96-b02f-48aa-9f97-11b88ee69acc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:18:54.363013 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01472f96-b02f-48aa-9f97-11b88ee69acc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:18:54.364711 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01472f96-b02f-48aa-9f97-11b88ee69acc service neutron] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:18:54.386851 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 673/1331] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:18:54 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:18:56.816344 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e583f55-fa8d-4f31-a2d1-7ef6103be522 None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:18:56.816986 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e583f55-fa8d-4f31-a2d1-7ef6103be522 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:18:56.816986 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e583f55-fa8d-4f31-a2d1-7ef6103be522 None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:18:56.818235 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 659/1332] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:18:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:18:56.823559 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b152ec-f360-4222-a528-92d60bff7a3d None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:18:56.823961 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b152ec-f360-4222-a528-92d60bff7a3d None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:18:56.824101 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b152ec-f360-4222-a528-92d60bff7a3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:18:56.887673 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:18:56.891017 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-94b152ec-f360-4222-a528-92d60bff7a3d None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:18:56.892421 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-94b152ec-f360-4222-a528-92d60bff7a3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:18:56.991582 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 674/1333] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:18:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:18:57.280135 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e583f55-fa8d-4f31-a2d1-7ef6103be522 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:18:57.281715 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-0e583f55-fa8d-4f31-a2d1-7ef6103be522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:18:57.383420 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e583f55-fa8d-4f31-a2d1-7ef6103be522 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:18:57.462898 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad16950b-7001-4e4e-a81e-d00b9aa9404f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c1289b015854c6bb6aee8fed6b807db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:18:57.464017 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad16950b-7001-4e4e-a81e-d00b9aa9404f service neutron] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:18:57.464316 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad16950b-7001-4e4e-a81e-d00b9aa9404f service neutron] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:18:57.464584 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad16950b-7001-4e4e-a81e-d00b9aa9404f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:18:57.466167 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-ad16950b-7001-4e4e-a81e-d00b9aa9404f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:18:57.493927 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:18:57.577214 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad16950b-7001-4e4e-a81e-d00b9aa9404f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:18:57.578670 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad16950b-7001-4e4e-a81e-d00b9aa9404f service neutron] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:18:57.597490 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 660/1334] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:18:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:18:59.809092 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefbac6d-edad-4a60-9ffa-24086e0b2dae None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:18:59.809658 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefbac6d-edad-4a60-9ffa-24086e0b2dae None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:18:59.809658 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefbac6d-edad-4a60-9ffa-24086e0b2dae None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:18:59.810982 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 675/1335] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:18:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:18:59.816451 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501b9af0-672a-4891-9bed-779162f17ad7 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:18:59.816885 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501b9af0-672a-4891-9bed-779162f17ad7 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:18:59.817006 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501b9af0-672a-4891-9bed-779162f17ad7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:18:59.881514 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-501b9af0-672a-4891-9bed-779162f17ad7 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:18:59.882742 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-501b9af0-672a-4891-9bed-779162f17ad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:18:59.957757 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:18:59.980526 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 661/1336] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:18:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:19:00.263051 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefbac6d-edad-4a60-9ffa-24086e0b2dae None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:19:00.264652 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-aefbac6d-edad-4a60-9ffa-24086e0b2dae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:19:00.371069 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefbac6d-edad-4a60-9ffa-24086e0b2dae None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:19:00.398883 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:19:00.444089 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3f1945-4e0d-4a98-8672-dcdec9db0507 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c1289b015854c6bb6aee8fed6b807db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:19:00.444724 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3f1945-4e0d-4a98-8672-dcdec9db0507 service neutron] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:19:00.445003 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3f1945-4e0d-4a98-8672-dcdec9db0507 service neutron] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:19:00.445272 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3f1945-4e0d-4a98-8672-dcdec9db0507 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:19:00.446870 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-ed3f1945-4e0d-4a98-8672-dcdec9db0507 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:19:00.561332 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3f1945-4e0d-4a98-8672-dcdec9db0507 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:19:00.562776 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3f1945-4e0d-4a98-8672-dcdec9db0507 service neutron] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:19:00.581130 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 676/1337] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:19:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:19:03.170140 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6c846a-8732-4797-85ae-43af169e7721 None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:19:03.170675 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6c846a-8732-4797-85ae-43af169e7721 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:19:03.170675 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6c846a-8732-4797-85ae-43af169e7721 None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:19:03.172025 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 662/1338] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:19:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 10:19:03.177226 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d6614e-2a98-4555-ab45-222bf366168d None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:19:03.177660 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d6614e-2a98-4555-ab45-222bf366168d None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:19:03.177785 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d6614e-2a98-4555-ab45-222bf366168d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:19:03.241725 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-00d6614e-2a98-4555-ab45-222bf366168d None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:19:03.242935 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-00d6614e-2a98-4555-ab45-222bf366168d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:19:03.251597 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:19:03.344044 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 677/1339] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:19:03 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:19:03.629049 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6c846a-8732-4797-85ae-43af169e7721 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:19:03.630625 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-db6c846a-8732-4797-85ae-43af169e7721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:19:03.735145 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6c846a-8732-4797-85ae-43af169e7721 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:19:03.810431 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf84360-e7d0-40db-9bb6-84fc08b9647b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c1289b015854c6bb6aee8fed6b807db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:19:03.811053 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf84360-e7d0-40db-9bb6-84fc08b9647b service neutron] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:19:03.811315 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf84360-e7d0-40db-9bb6-84fc08b9647b service neutron] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:19:03.811587 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf84360-e7d0-40db-9bb6-84fc08b9647b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:19:03.813235 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-0bf84360-e7d0-40db-9bb6-84fc08b9647b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:19:03.849504 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:19:03.929318 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf84360-e7d0-40db-9bb6-84fc08b9647b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:19:03.930681 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf84360-e7d0-40db-9bb6-84fc08b9647b service neutron] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:19:03.949305 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 663/1340] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:19:03 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:19:08.088228 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44a2de5-5587-4b8d-92a7-6782e4e06f6b None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:19:08.088752 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44a2de5-5587-4b8d-92a7-6782e4e06f6b None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:19:08.088834 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44a2de5-5587-4b8d-92a7-6782e4e06f6b None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:19:08.090147 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 678/1341] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:19:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:19:08.096010 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179f0bb4-75b5-4374-9e78-cca6bf589ac5 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:19:08.096501 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179f0bb4-75b5-4374-9e78-cca6bf589ac5 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:19:08.096583 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179f0bb4-75b5-4374-9e78-cca6bf589ac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:19:08.165259 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-179f0bb4-75b5-4374-9e78-cca6bf589ac5 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:19:08.167009 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-179f0bb4-75b5-4374-9e78-cca6bf589ac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:19:08.265274 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:19:08.277621 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 664/1342] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:19:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:19:08.571145 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44a2de5-5587-4b8d-92a7-6782e4e06f6b None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:19:08.573342 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-e44a2de5-5587-4b8d-92a7-6782e4e06f6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:19:08.683818 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44a2de5-5587-4b8d-92a7-6782e4e06f6b None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:19:08.725463 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:19:08.763362 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1eadca-9f43-4944-bd10-77eb6db8f1d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c1289b015854c6bb6aee8fed6b807db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:19:08.763967 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1eadca-9f43-4944-bd10-77eb6db8f1d9 service neutron] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:19:08.764274 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1eadca-9f43-4944-bd10-77eb6db8f1d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:19:08.764552 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1eadca-9f43-4944-bd10-77eb6db8f1d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:19:08.766139 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-0d1eadca-9f43-4944-bd10-77eb6db8f1d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:19:08.877273 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1eadca-9f43-4944-bd10-77eb6db8f1d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:19:08.878634 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1eadca-9f43-4944-bd10-77eb6db8f1d9 service neutron] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:19:08.898492 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 679/1343] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:19:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:19:11.668558 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a793ffd7-992c-4788-b531-660c3e7fde26 None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:19:11.669104 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a793ffd7-992c-4788-b531-660c3e7fde26 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:19:11.669707 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a793ffd7-992c-4788-b531-660c3e7fde26 None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:19:11.671307 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 665/1344] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:19:11 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:19:11.676898 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3565329d-4db6-498c-8251-7cf41a033369 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:19:11.677412 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3565329d-4db6-498c-8251-7cf41a033369 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:19:11.677495 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3565329d-4db6-498c-8251-7cf41a033369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:19:11.750809 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-3565329d-4db6-498c-8251-7cf41a033369 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:19:11.752045 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-3565329d-4db6-498c-8251-7cf41a033369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:19:11.775227 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:19:11.865246 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 680/1345] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:19:11 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:19:12.151578 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a793ffd7-992c-4788-b531-660c3e7fde26 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:19:12.153274 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-a793ffd7-992c-4788-b531-660c3e7fde26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:19:12.265074 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a793ffd7-992c-4788-b531-660c3e7fde26 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:19:12.340417 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7439df-6608-43c9-9879-11539a5dcb89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c1289b015854c6bb6aee8fed6b807db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:19:12.341031 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7439df-6608-43c9-9879-11539a5dcb89 service neutron] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:19:12.341307 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7439df-6608-43c9-9879-11539a5dcb89 service neutron] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:19:12.341956 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7439df-6608-43c9-9879-11539a5dcb89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:19:12.343389 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-9e7439df-6608-43c9-9879-11539a5dcb89 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:19:12.388302 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:19:12.456571 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7439df-6608-43c9-9879-11539a5dcb89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:19:12.458710 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7439df-6608-43c9-9879-11539a5dcb89 service neutron] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:19:12.479760 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 666/1346] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:19:12 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:19:16.679465 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b7f456-e00f-4bd7-998e-418d341cedfb None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:19:16.679996 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b7f456-e00f-4bd7-998e-418d341cedfb None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:19:16.679996 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b7f456-e00f-4bd7-998e-418d341cedfb None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:19:16.681439 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 681/1347] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:19:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:19:16.686843 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a4d722-dc59-459b-bde0-d7a45160d2f5 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:19:16.687344 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a4d722-dc59-459b-bde0-d7a45160d2f5 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:19:16.687430 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a4d722-dc59-459b-bde0-d7a45160d2f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:19:16.760529 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-70a4d722-dc59-459b-bde0-d7a45160d2f5 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:19:16.761730 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-70a4d722-dc59-459b-bde0-d7a45160d2f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:19:16.866462 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:19:16.870124 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 667/1348] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:19:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:19:17.153105 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b7f456-e00f-4bd7-998e-418d341cedfb None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:19:17.154638 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-35b7f456-e00f-4bd7-998e-418d341cedfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:19:17.256594 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b7f456-e00f-4bd7-998e-418d341cedfb None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:19:17.304306 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:19:17.332900 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c706f5ea-7d3b-42d2-8847-09de0d8887af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c1289b015854c6bb6aee8fed6b807db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:19:17.333514 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c706f5ea-7d3b-42d2-8847-09de0d8887af service neutron] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:19:17.333815 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c706f5ea-7d3b-42d2-8847-09de0d8887af service neutron] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:19:17.334122 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c706f5ea-7d3b-42d2-8847-09de0d8887af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:19:17.335732 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-c706f5ea-7d3b-42d2-8847-09de0d8887af service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:19:17.443944 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c706f5ea-7d3b-42d2-8847-09de0d8887af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:19:17.445324 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c706f5ea-7d3b-42d2-8847-09de0d8887af service neutron] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:19:17.463501 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 682/1349] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:19:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:19:22.507723 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc849cf-6099-4937-9019-4042fe20db7a None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:19:22.507723 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc849cf-6099-4937-9019-4042fe20db7a None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:19:22.508372 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc849cf-6099-4937-9019-4042fe20db7a None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:19:22.509416 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 668/1350] 10.222.0.66 () {54 vars in 921 bytes} [Mon Sep 19 10:19:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:19:22.530557 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b249f8c7-8243-472d-a3e3-dc41c52c91a3 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:19:22.531091 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b249f8c7-8243-472d-a3e3-dc41c52c91a3 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:19:22.531350 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b249f8c7-8243-472d-a3e3-dc41c52c91a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:19:22.674140 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-b249f8c7-8243-472d-a3e3-dc41c52c91a3 None None] MFA Rules not processed for user `46b78120cac64f09bd0f4cdc42424163`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:19:22.675600 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-b249f8c7-8243-472d-a3e3-dc41c52c91a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:19:22.697910 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:19:22.806844 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 683/1351] 10.222.0.66 () {58 vars in 1018 bytes} [Mon Sep 19 10:19:22 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:19:26.895262 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23c414b-0b8b-46d6-bcb4-128631ef6da3 None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:19:26.895781 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23c414b-0b8b-46d6-bcb4-128631ef6da3 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:19:26.895890 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23c414b-0b8b-46d6-bcb4-128631ef6da3 None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:19:26.897207 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 669/1352] 10.222.0.66 () {54 vars in 921 bytes} [Mon Sep 19 10:19:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:19:26.904028 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9742101-604e-47ca-86c8-7951dc315212 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:19:26.904876 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9742101-604e-47ca-86c8-7951dc315212 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:19:26.905877 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9742101-604e-47ca-86c8-7951dc315212 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:19:26.991468 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-d9742101-604e-47ca-86c8-7951dc315212 None None] MFA Rules not processed for user `46b78120cac64f09bd0f4cdc42424163`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:19:26.992681 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-d9742101-604e-47ca-86c8-7951dc315212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:19:27.075225 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:19:27.114250 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 684/1353] 10.222.0.66 () {58 vars in 1018 bytes} [Mon Sep 19 10:19:26 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:19:28.562414 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5630ff7b-03d7-4741-ac6a-92c3f60b4055 None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:19:28.563317 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5630ff7b-03d7-4741-ac6a-92c3f60b4055 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:19:28.563710 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5630ff7b-03d7-4741-ac6a-92c3f60b4055 None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:19:28.565497 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 670/1354] 10.222.0.66 () {54 vars in 921 bytes} [Mon Sep 19 10:19:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:19:28.571485 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127cff4f-4dc5-411f-ae0f-37350cd8e5df None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:19:28.572016 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127cff4f-4dc5-411f-ae0f-37350cd8e5df None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:19:28.572016 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127cff4f-4dc5-411f-ae0f-37350cd8e5df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:19:28.650659 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-127cff4f-4dc5-411f-ae0f-37350cd8e5df None None] MFA Rules not processed for user `46b78120cac64f09bd0f4cdc42424163`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:19:28.651804 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-127cff4f-4dc5-411f-ae0f-37350cd8e5df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:19:28.761995 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 685/1355] 10.222.0.66 () {58 vars in 1018 bytes} [Mon Sep 19 10:19:28 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:19:32.364968 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9341438d-2698-4a7a-8cf1-f77910247a68 None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:19:32.366156 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9341438d-2698-4a7a-8cf1-f77910247a68 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:19:32.366638 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9341438d-2698-4a7a-8cf1-f77910247a68 None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:19:32.369193 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 671/1356] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:19:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:19:32.375039 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3919bc30-24a8-49e7-bf47-483414e1ca76 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:19:32.375517 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3919bc30-24a8-49e7-bf47-483414e1ca76 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:19:32.375610 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3919bc30-24a8-49e7-bf47-483414e1ca76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:19:32.413894 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:19:32.448904 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-3919bc30-24a8-49e7-bf47-483414e1ca76 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:19:32.450132 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-3919bc30-24a8-49e7-bf47-483414e1ca76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:19:32.552585 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 686/1357] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:19:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:19:32.864483 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e316c76-81ee-44c6-abdc-af09d5ca51be None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:19:32.864828 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e316c76-81ee-44c6-abdc-af09d5ca51be None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:19:32.865186 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e316c76-81ee-44c6-abdc-af09d5ca51be None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:19:32.866620 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 672/1358] 10.222.0.66 () {54 vars in 965 bytes} [Mon Sep 19 10:19:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:19:32.872692 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b94b1a9-aef7-40d4-bf77-22242267814e None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:19:32.872982 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b94b1a9-aef7-40d4-bf77-22242267814e None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:19:32.873272 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b94b1a9-aef7-40d4-bf77-22242267814e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:19:32.975944 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-4b94b1a9-aef7-40d4-bf77-22242267814e None None] MFA Rules not processed for user `15c70bfb085a44e9b84942b480ff22f1`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:19:32.977095 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-4b94b1a9-aef7-40d4-bf77-22242267814e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:19:33.028942 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:19:33.107821 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 687/1359] 10.222.0.66 () {58 vars in 1062 bytes} [Mon Sep 19 10:19:32 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:19:33.115581 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e316c76-81ee-44c6-abdc-af09d5ca51be None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:19:33.117127 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-9e316c76-81ee-44c6-abdc-af09d5ca51be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:19:33.271839 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e316c76-81ee-44c6-abdc-af09d5ca51be None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:19:33.350725 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:19:33.396064 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2772e8ef-d9ce-46b6-a978-3f9b77a1de9f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15c70bfb085a44e9b84942b480ff22f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:19:33.396794 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2772e8ef-d9ce-46b6-a978-3f9b77a1de9f service nova] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:19:33.397100 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2772e8ef-d9ce-46b6-a978-3f9b77a1de9f service nova] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:19:33.397446 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2772e8ef-d9ce-46b6-a978-3f9b77a1de9f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:19:33.399724 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-2772e8ef-d9ce-46b6-a978-3f9b77a1de9f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:19:33.503611 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2772e8ef-d9ce-46b6-a978-3f9b77a1de9f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:19:33.505289 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2772e8ef-d9ce-46b6-a978-3f9b77a1de9f service nova] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:19:33.525560 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 673/1360] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:19:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 10:19:35.924628 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c830f273-e720-47de-b727-8e1be8d92e9c None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:19:35.924628 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c830f273-e720-47de-b727-8e1be8d92e9c None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:19:35.925226 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c830f273-e720-47de-b727-8e1be8d92e9c None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:19:35.926368 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 688/1361] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:19:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:19:35.931689 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d705dd7-dfb9-435e-9d13-864f48f9cda7 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:19:35.932146 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d705dd7-dfb9-435e-9d13-864f48f9cda7 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:19:35.932146 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d705dd7-dfb9-435e-9d13-864f48f9cda7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:19:36.000706 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-8d705dd7-dfb9-435e-9d13-864f48f9cda7 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:19:36.002056 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-8d705dd7-dfb9-435e-9d13-864f48f9cda7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:19:36.042396 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:19:36.104762 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 674/1362] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:19:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 10:19:36.395594 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c830f273-e720-47de-b727-8e1be8d92e9c None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:19:36.397110 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-c830f273-e720-47de-b727-8e1be8d92e9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:19:36.575496 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c830f273-e720-47de-b727-8e1be8d92e9c None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:19:36.589140 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:19:36.732135 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0aaa05-00f6-4833-9288-22e2d3cd8aa0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15c70bfb085a44e9b84942b480ff22f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:19:36.732842 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0aaa05-00f6-4833-9288-22e2d3cd8aa0 service nova] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:19:36.733124 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0aaa05-00f6-4833-9288-22e2d3cd8aa0 service nova] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:19:36.733404 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0aaa05-00f6-4833-9288-22e2d3cd8aa0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:19:36.735026 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-8e0aaa05-00f6-4833-9288-22e2d3cd8aa0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:19:36.830829 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0aaa05-00f6-4833-9288-22e2d3cd8aa0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:19:36.832551 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0aaa05-00f6-4833-9288-22e2d3cd8aa0 service nova] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:19:36.853637 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 689/1363] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:19:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:19:39.408749 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2372394a-f31f-4a7e-b61b-d1ee5a8401d7 None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:19:39.409315 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2372394a-f31f-4a7e-b61b-d1ee5a8401d7 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:19:39.409315 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2372394a-f31f-4a7e-b61b-d1ee5a8401d7 None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:19:39.410797 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 675/1364] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:19:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:19:39.416716 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858bc6a6-81b8-42e5-b750-9f2ac587cdf1 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:19:39.417151 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858bc6a6-81b8-42e5-b750-9f2ac587cdf1 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:19:39.417337 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858bc6a6-81b8-42e5-b750-9f2ac587cdf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:19:39.432988 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:19:39.488656 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-858bc6a6-81b8-42e5-b750-9f2ac587cdf1 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:19:39.489881 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-858bc6a6-81b8-42e5-b750-9f2ac587cdf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:19:39.609585 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 690/1365] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:19:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 10:19:39.913569 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd16470c-3d62-4420-9667-bf8d8620abbf None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:19:39.913872 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd16470c-3d62-4420-9667-bf8d8620abbf None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:19:39.914084 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd16470c-3d62-4420-9667-bf8d8620abbf None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:19:39.915800 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 676/1366] 10.222.0.66 () {54 vars in 965 bytes} [Mon Sep 19 10:19:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:19:39.921885 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447c6bf2-0ec3-46a8-9f31-df8e5d191c2c None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:19:39.922281 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447c6bf2-0ec3-46a8-9f31-df8e5d191c2c None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:19:39.922656 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447c6bf2-0ec3-46a8-9f31-df8e5d191c2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:19:40.002543 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-447c6bf2-0ec3-46a8-9f31-df8e5d191c2c None None] MFA Rules not processed for user `15c70bfb085a44e9b84942b480ff22f1`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:19:40.003846 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-447c6bf2-0ec3-46a8-9f31-df8e5d191c2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:19:40.041010 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:19:40.129019 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 691/1367] 10.222.0.66 () {58 vars in 1062 bytes} [Mon Sep 19 10:19:39 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:19:40.137383 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd16470c-3d62-4420-9667-bf8d8620abbf None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:19:40.138958 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-cd16470c-3d62-4420-9667-bf8d8620abbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:19:40.295359 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd16470c-3d62-4420-9667-bf8d8620abbf None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:19:40.319642 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:19:40.431345 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d811e09-172d-46db-8bbf-266a5d8cabdd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15c70bfb085a44e9b84942b480ff22f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:19:40.432113 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d811e09-172d-46db-8bbf-266a5d8cabdd service nova] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:19:40.432432 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d811e09-172d-46db-8bbf-266a5d8cabdd service nova] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:19:40.432709 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d811e09-172d-46db-8bbf-266a5d8cabdd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:19:40.434465 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-9d811e09-172d-46db-8bbf-266a5d8cabdd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:19:40.537283 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d811e09-172d-46db-8bbf-266a5d8cabdd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:19:40.538919 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d811e09-172d-46db-8bbf-266a5d8cabdd service nova] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:19:40.559525 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 677/1368] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:19:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:19:40.597120 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b0917f-c276-445f-9a08-a45703728dbf None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:19:40.597719 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b0917f-c276-445f-9a08-a45703728dbf None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:19:40.597719 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b0917f-c276-445f-9a08-a45703728dbf None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:19:40.599378 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 692/1369] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:19:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 10:19:40.608950 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39ddaf6-13b5-4773-838d-16ebf2ae34de None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:19:40.609344 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39ddaf6-13b5-4773-838d-16ebf2ae34de None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:19:40.609721 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39ddaf6-13b5-4773-838d-16ebf2ae34de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:19:40.644120 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:19:40.711577 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-b39ddaf6-13b5-4773-838d-16ebf2ae34de None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:19:40.713470 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-b39ddaf6-13b5-4773-838d-16ebf2ae34de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:19:40.838912 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 678/1370] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:19:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:19:41.150755 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee36285-f8fd-45a2-806e-ee27d81fdde2 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:19:41.151041 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee36285-f8fd-45a2-806e-ee27d81fdde2 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:19:41.151325 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee36285-f8fd-45a2-806e-ee27d81fdde2 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:19:41.152922 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 693/1371] 10.222.0.66 () {54 vars in 962 bytes} [Mon Sep 19 10:19:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:19:41.157646 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7b01dd-8ddd-4670-a14a-f8d563dcd2d9 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:19:41.157931 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7b01dd-8ddd-4670-a14a-f8d563dcd2d9 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:19:41.158204 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7b01dd-8ddd-4670-a14a-f8d563dcd2d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:19:41.250447 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-3a7b01dd-8ddd-4670-a14a-f8d563dcd2d9 None None] MFA Rules not processed for user `dfa4d004fd44482cae761c4b3bdfab31`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:19:41.250447 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-3a7b01dd-8ddd-4670-a14a-f8d563dcd2d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:19:41.302715 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:19:41.339209 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 679/1372] 10.222.0.66 () {58 vars in 1059 bytes} [Mon Sep 19 10:19:41 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:19:41.346964 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee36285-f8fd-45a2-806e-ee27d81fdde2 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:19:41.348769 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-dee36285-f8fd-45a2-806e-ee27d81fdde2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:19:41.461127 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee36285-f8fd-45a2-806e-ee27d81fdde2 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:19:41.506623 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:19:41.547681 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546031cd-4a7e-49c3-bb29-25e9d37948ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa4d004fd44482cae761c4b3bdfab31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:19:41.548478 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546031cd-4a7e-49c3-bb29-25e9d37948ce service cinder] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:19:41.548737 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546031cd-4a7e-49c3-bb29-25e9d37948ce service cinder] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:19:41.548958 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546031cd-4a7e-49c3-bb29-25e9d37948ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:19:41.550724 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-546031cd-4a7e-49c3-bb29-25e9d37948ce service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:19:41.699155 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546031cd-4a7e-49c3-bb29-25e9d37948ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:19:41.700764 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546031cd-4a7e-49c3-bb29-25e9d37948ce service cinder] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:19:41.724550 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 694/1373] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:19:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:19:42.853831 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe5579e-95cd-45f6-b23d-32972b75a1ed None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:19:42.854405 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe5579e-95cd-45f6-b23d-32972b75a1ed None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:19:42.854755 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe5579e-95cd-45f6-b23d-32972b75a1ed None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:19:42.856964 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 680/1374] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:19:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:19:42.863973 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb80a51f-6c07-49ea-9c91-c0ab5b9ac2d5 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:19:42.864485 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb80a51f-6c07-49ea-9c91-c0ab5b9ac2d5 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:19:42.864591 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb80a51f-6c07-49ea-9c91-c0ab5b9ac2d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:19:42.941606 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-fb80a51f-6c07-49ea-9c91-c0ab5b9ac2d5 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:19:42.942760 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-fb80a51f-6c07-49ea-9c91-c0ab5b9ac2d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:19:42.964249 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:19:43.045433 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 695/1375] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:19:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:19:43.339043 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe5579e-95cd-45f6-b23d-32972b75a1ed None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:19:43.340668 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-2fe5579e-95cd-45f6-b23d-32972b75a1ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:19:43.507456 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe5579e-95cd-45f6-b23d-32972b75a1ed None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:19:43.567594 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:19:43.636432 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cf4b79-2b1d-4f4f-b5ef-72a983684948 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15c70bfb085a44e9b84942b480ff22f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:19:43.637047 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cf4b79-2b1d-4f4f-b5ef-72a983684948 service nova] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:19:43.637328 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cf4b79-2b1d-4f4f-b5ef-72a983684948 service nova] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:19:43.637600 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cf4b79-2b1d-4f4f-b5ef-72a983684948 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:19:43.639225 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-06cf4b79-2b1d-4f4f-b5ef-72a983684948 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:19:43.747912 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cf4b79-2b1d-4f4f-b5ef-72a983684948 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:19:43.749621 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cf4b79-2b1d-4f4f-b5ef-72a983684948 service nova] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:19:43.770262 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 681/1376] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:19:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:19:46.045251 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09031ae-8b34-470d-931c-baee22f06d5b None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:19:46.045817 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09031ae-8b34-470d-931c-baee22f06d5b None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:19:46.045817 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09031ae-8b34-470d-931c-baee22f06d5b None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:19:46.047282 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 696/1377] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:19:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:19:46.052380 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f0b2ca-10ec-4117-8cd4-8d90d86b5f87 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:19:46.052777 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f0b2ca-10ec-4117-8cd4-8d90d86b5f87 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:19:46.052961 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f0b2ca-10ec-4117-8cd4-8d90d86b5f87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:19:46.127669 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-44f0b2ca-10ec-4117-8cd4-8d90d86b5f87 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:19:46.130092 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-44f0b2ca-10ec-4117-8cd4-8d90d86b5f87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:19:46.140198 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:19:46.240383 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 682/1378] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:19:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:19:46.534946 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09031ae-8b34-470d-931c-baee22f06d5b None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:19:46.536488 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-c09031ae-8b34-470d-931c-baee22f06d5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:19:46.691082 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09031ae-8b34-470d-931c-baee22f06d5b None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:19:46.694865 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:19:46.813820 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906d0ad0-bdeb-4cb7-84e9-dfe9964f8af1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15c70bfb085a44e9b84942b480ff22f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:19:46.814441 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906d0ad0-bdeb-4cb7-84e9-dfe9964f8af1 service nova] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:19:46.814723 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906d0ad0-bdeb-4cb7-84e9-dfe9964f8af1 service nova] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:19:46.814997 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906d0ad0-bdeb-4cb7-84e9-dfe9964f8af1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:19:46.816624 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-906d0ad0-bdeb-4cb7-84e9-dfe9964f8af1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:19:46.916949 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906d0ad0-bdeb-4cb7-84e9-dfe9964f8af1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:19:46.918924 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906d0ad0-bdeb-4cb7-84e9-dfe9964f8af1 service nova] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:19:46.946238 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 697/1379] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:19:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:19:49.181919 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31157111-a312-49c6-89a7-bba844abaebb None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:19:49.182393 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31157111-a312-49c6-89a7-bba844abaebb None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:19:49.182489 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31157111-a312-49c6-89a7-bba844abaebb None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:19:49.183943 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 683/1380] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:19:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:19:49.189134 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6c83cf-6ff9-4ec8-9001-54823485030d None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:19:49.189559 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6c83cf-6ff9-4ec8-9001-54823485030d None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:19:49.189749 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6c83cf-6ff9-4ec8-9001-54823485030d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:19:49.201397 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:19:49.263571 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-7f6c83cf-6ff9-4ec8-9001-54823485030d None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:19:49.264843 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-7f6c83cf-6ff9-4ec8-9001-54823485030d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:19:49.395985 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 698/1381] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:19:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:19:49.692017 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31157111-a312-49c6-89a7-bba844abaebb None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:19:49.693613 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-31157111-a312-49c6-89a7-bba844abaebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:19:49.841828 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:19:49.855681 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31157111-a312-49c6-89a7-bba844abaebb None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:19:49.994631 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d78f6a-1cd6-429e-8466-a258ba665b8c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15c70bfb085a44e9b84942b480ff22f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:19:49.995153 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d78f6a-1cd6-429e-8466-a258ba665b8c service nova] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:19:49.995456 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d78f6a-1cd6-429e-8466-a258ba665b8c service nova] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:19:49.995727 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d78f6a-1cd6-429e-8466-a258ba665b8c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:19:49.997348 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-c1d78f6a-1cd6-429e-8466-a258ba665b8c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:19:50.093257 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d78f6a-1cd6-429e-8466-a258ba665b8c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:19:50.095288 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d78f6a-1cd6-429e-8466-a258ba665b8c service nova] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:19:50.106950 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:19:50.116422 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 684/1382] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:19:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:19:52.334928 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff40e2d-71e9-4bac-ba2f-683af33b6631 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:19:52.335571 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff40e2d-71e9-4bac-ba2f-683af33b6631 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:19:52.335697 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff40e2d-71e9-4bac-ba2f-683af33b6631 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:19:52.338133 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 699/1383] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:19:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:19:52.343915 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e81c949-ea62-4164-8fb6-f3d76f34b79a None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:19:52.344492 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e81c949-ea62-4164-8fb6-f3d76f34b79a None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:19:52.344492 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e81c949-ea62-4164-8fb6-f3d76f34b79a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:19:52.412710 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-1e81c949-ea62-4164-8fb6-f3d76f34b79a None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:19:52.413969 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-1e81c949-ea62-4164-8fb6-f3d76f34b79a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:19:52.525678 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 685/1384] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:19:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:19:52.812853 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff40e2d-71e9-4bac-ba2f-683af33b6631 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:19:52.814386 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-8ff40e2d-71e9-4bac-ba2f-683af33b6631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:19:52.902685 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:19:52.976585 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff40e2d-71e9-4bac-ba2f-683af33b6631 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:19:53.116931 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa949b6-d3c3-4350-be29-4880afaff63b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15c70bfb085a44e9b84942b480ff22f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:19:53.118442 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa949b6-d3c3-4350-be29-4880afaff63b service nova] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:19:53.118783 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa949b6-d3c3-4350-be29-4880afaff63b service nova] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:19:53.119118 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa949b6-d3c3-4350-be29-4880afaff63b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:19:53.121128 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-6aa949b6-d3c3-4350-be29-4880afaff63b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:19:53.183838 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:19:53.231523 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa949b6-d3c3-4350-be29-4880afaff63b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:19:53.233696 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa949b6-d3c3-4350-be29-4880afaff63b service nova] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:19:53.257972 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 700/1385] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:19:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:19:55.846820 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10768e4-080e-4fbf-b319-34d73a5ca58b None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:19:55.847376 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10768e4-080e-4fbf-b319-34d73a5ca58b None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:19:55.847376 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10768e4-080e-4fbf-b319-34d73a5ca58b None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:19:55.848688 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 686/1386] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:19:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:19:55.854810 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dda13e-cf6a-4945-955d-9d5e1ee1008b None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:19:55.855315 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dda13e-cf6a-4945-955d-9d5e1ee1008b None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:19:55.855421 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dda13e-cf6a-4945-955d-9d5e1ee1008b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:19:55.927388 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-21dda13e-cf6a-4945-955d-9d5e1ee1008b None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:19:55.928650 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-21dda13e-cf6a-4945-955d-9d5e1ee1008b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:19:56.025033 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 701/1387] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:19:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:19:56.315410 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10768e4-080e-4fbf-b319-34d73a5ca58b None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:19:56.317044 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-c10768e4-080e-4fbf-b319-34d73a5ca58b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:19:56.395729 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:19:56.465153 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10768e4-080e-4fbf-b319-34d73a5ca58b None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:19:56.578917 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce40e680-df82-4459-8154-a06ea55373ed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15c70bfb085a44e9b84942b480ff22f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:19:56.579438 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce40e680-df82-4459-8154-a06ea55373ed service nova] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:19:56.579947 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce40e680-df82-4459-8154-a06ea55373ed service nova] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:19:56.580055 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce40e680-df82-4459-8154-a06ea55373ed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:19:56.582706 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-ce40e680-df82-4459-8154-a06ea55373ed service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:19:56.630723 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:19:56.690425 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce40e680-df82-4459-8154-a06ea55373ed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:19:56.692470 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce40e680-df82-4459-8154-a06ea55373ed service nova] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:19:56.719233 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 687/1388] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:19:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:19:57.202301 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c539df-ebd3-4739-b242-32b69cffbbae None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:19:57.202896 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c539df-ebd3-4739-b242-32b69cffbbae None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:19:57.202896 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c539df-ebd3-4739-b242-32b69cffbbae None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:19:57.204419 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 702/1389] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:19:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:19:57.209639 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a8390d-901b-46ce-978d-5e969c8224a4 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:19:57.210143 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a8390d-901b-46ce-978d-5e969c8224a4 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:19:57.210394 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a8390d-901b-46ce-978d-5e969c8224a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:19:57.279483 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-64a8390d-901b-46ce-978d-5e969c8224a4 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:19:57.280859 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-64a8390d-901b-46ce-978d-5e969c8224a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:19:57.383283 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 688/1390] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:19:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:19:57.695707 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701f0984-03f4-4f6f-9953-000c9b2d32fe None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:19:57.696143 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701f0984-03f4-4f6f-9953-000c9b2d32fe None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:19:57.696346 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701f0984-03f4-4f6f-9953-000c9b2d32fe None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:19:57.697590 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 703/1391] 10.222.0.66 () {54 vars in 962 bytes} [Mon Sep 19 10:19:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:19:57.702873 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9144054e-91c7-41c9-bd9d-ea2f5f13adee None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:19:57.703164 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9144054e-91c7-41c9-bd9d-ea2f5f13adee None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:19:57.703445 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9144054e-91c7-41c9-bd9d-ea2f5f13adee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:19:57.720592 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:19:57.781215 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-9144054e-91c7-41c9-bd9d-ea2f5f13adee None None] MFA Rules not processed for user `2f95c0d9f2414f3ca2fa2d1546d47f1b`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:19:57.782447 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-9144054e-91c7-41c9-bd9d-ea2f5f13adee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:19:57.858021 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 689/1392] 10.222.0.66 () {58 vars in 1059 bytes} [Mon Sep 19 10:19:57 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:19:57.867928 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701f0984-03f4-4f6f-9953-000c9b2d32fe None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:19:57.869772 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-701f0984-03f4-4f6f-9953-000c9b2d32fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:19:57.904992 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:19:57.978303 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701f0984-03f4-4f6f-9953-000c9b2d32fe None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:19:58.052658 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5315f2-ec2a-4dfb-a091-898dd9a1533d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f95c0d9f2414f3ca2fa2d1546d47f1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:19:58.053255 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5315f2-ec2a-4dfb-a091-898dd9a1533d service glance] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:19:58.053532 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5315f2-ec2a-4dfb-a091-898dd9a1533d service glance] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:19:58.053799 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5315f2-ec2a-4dfb-a091-898dd9a1533d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:19:58.056044 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-3f5315f2-ec2a-4dfb-a091-898dd9a1533d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:19:58.133382 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:19:58.165036 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5315f2-ec2a-4dfb-a091-898dd9a1533d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:19:58.166478 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5315f2-ec2a-4dfb-a091-898dd9a1533d service glance] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:19:58.185420 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 704/1393] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:19:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:19:58.937770 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e938724-c865-4ae4-ba8c-a72df219151f None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:19:58.938302 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e938724-c865-4ae4-ba8c-a72df219151f None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:19:58.938416 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e938724-c865-4ae4-ba8c-a72df219151f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:19:58.948787 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3271bce-bdd9-4291-ae4d-faf648ba101f None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:19:58.949319 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3271bce-bdd9-4291-ae4d-faf648ba101f None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:19:58.949836 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3271bce-bdd9-4291-ae4d-faf648ba101f None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:19:58.951189 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 705/1394] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:19:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 10:19:58.956281 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9930ed0a-6eb6-440c-96b7-6e7a145271e9 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:19:58.956569 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9930ed0a-6eb6-440c-96b7-6e7a145271e9 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:19:58.956844 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9930ed0a-6eb6-440c-96b7-6e7a145271e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:19:59.006796 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-8e938724-c865-4ae4-ba8c-a72df219151f None None] MFA Rules not processed for user `e4d1160b71a84e2fa44a8ca6edf1846e`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:19:59.008101 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-8e938724-c865-4ae4-ba8c-a72df219151f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:19:59.026614 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-9930ed0a-6eb6-440c-96b7-6e7a145271e9 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:19:59.028055 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-9930ed0a-6eb6-440c-96b7-6e7a145271e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:19:59.067728 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:19:59.101936 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 690/1395] 10.222.0.66 () {58 vars in 1009 bytes} [Mon Sep 19 10:19:58 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 10:19:59.129648 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 706/1396] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:19:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 10:19:59.151271 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752c8162-d34d-494f-99db-a502198be39e None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:19:59.151639 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752c8162-d34d-494f-99db-a502198be39e None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:19:59.151986 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752c8162-d34d-494f-99db-a502198be39e None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:19:59.153480 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 691/1397] 10.222.0.66 () {54 vars in 943 bytes} [Mon Sep 19 10:19:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:19:59.160318 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64320e4a-04ef-4781-a0cc-ad88943471d1 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:19:59.160513 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64320e4a-04ef-4781-a0cc-ad88943471d1 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:19:59.160784 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64320e4a-04ef-4781-a0cc-ad88943471d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:19:59.206061 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:19:59.237874 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-64320e4a-04ef-4781-a0cc-ad88943471d1 None None] MFA Rules not processed for user `6677354e36614c9fb3d03413749be5ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:19:59.239082 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-64320e4a-04ef-4781-a0cc-ad88943471d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:19:59.350890 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 707/1398] 10.222.0.66 () {58 vars in 1040 bytes} [Mon Sep 19 10:19:59 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:19:59.361136 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752c8162-d34d-494f-99db-a502198be39e None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:19:59.362685 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-752c8162-d34d-494f-99db-a502198be39e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:19:59.428221 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64320e4a-04ef-4781-a0cc-ad88943471d1 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:19:59.429724 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-64320e4a-04ef-4781-a0cc-ad88943471d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:19:59.504582 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752c8162-d34d-494f-99db-a502198be39e None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:19:59.526771 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:19:59.529190 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64320e4a-04ef-4781-a0cc-ad88943471d1 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:19:59.565388 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:19:59.618957 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1678628-f225-4c0d-b9c1-92b445240a03 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6677354e36614c9fb3d03413749be5ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:19:59.619567 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1678628-f225-4c0d-b9c1-92b445240a03 service swift] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:19:59.619842 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1678628-f225-4c0d-b9c1-92b445240a03 service swift] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:19:59.620111 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1678628-f225-4c0d-b9c1-92b445240a03 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:19:59.621755 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-f1678628-f225-4c0d-b9c1-92b445240a03 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:19:59.649656 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bd7aa4-2c2c-4f0e-a141-b45e8f4b5894 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15c70bfb085a44e9b84942b480ff22f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:19:59.650263 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bd7aa4-2c2c-4f0e-a141-b45e8f4b5894 service nova] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:19:59.650534 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bd7aa4-2c2c-4f0e-a141-b45e8f4b5894 service nova] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:19:59.650796 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bd7aa4-2c2c-4f0e-a141-b45e8f4b5894 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:19:59.652439 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-a5bd7aa4-2c2c-4f0e-a141-b45e8f4b5894 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:19:59.712720 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1678628-f225-4c0d-b9c1-92b445240a03 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:19:59.714489 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1678628-f225-4c0d-b9c1-92b445240a03 service swift] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:19:59.722479 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 692/1399] 10.222.0.66 () {60 vars in 1384 bytes} [Mon Sep 19 10:19:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 19 10:19:59.749505 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bd7aa4-2c2c-4f0e-a141-b45e8f4b5894 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:19:59.751556 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bd7aa4-2c2c-4f0e-a141-b45e8f4b5894 service nova] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:19:59.774435 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 708/1400] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:19:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 10:20:02.025393 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822d6494-c955-4e77-8ade-85d79f93a26d None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:20:02.025921 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822d6494-c955-4e77-8ade-85d79f93a26d None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:20:02.025921 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822d6494-c955-4e77-8ade-85d79f93a26d None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:20:02.027356 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 693/1401] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:20:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:20:02.032701 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e898763-b547-4186-b8d3-c242533fdbd5 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:20:02.033137 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e898763-b547-4186-b8d3-c242533fdbd5 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:20:02.033236 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e898763-b547-4186-b8d3-c242533fdbd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:20:02.040327 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:20:02.115007 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-1e898763-b547-4186-b8d3-c242533fdbd5 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:20:02.116481 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-1e898763-b547-4186-b8d3-c242533fdbd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:20:02.225034 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 709/1402] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:20:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:20:02.579968 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822d6494-c955-4e77-8ade-85d79f93a26d None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:20:02.581516 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-822d6494-c955-4e77-8ade-85d79f93a26d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:20:02.699122 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:20:02.758983 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822d6494-c955-4e77-8ade-85d79f93a26d None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:20:02.894356 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb65899-be56-4987-8886-14e3b8a64fc9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15c70bfb085a44e9b84942b480ff22f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:20:02.894977 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb65899-be56-4987-8886-14e3b8a64fc9 service nova] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:20:02.895260 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb65899-be56-4987-8886-14e3b8a64fc9 service nova] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:20:02.895542 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb65899-be56-4987-8886-14e3b8a64fc9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:20:02.897251 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-fcb65899-be56-4987-8886-14e3b8a64fc9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:20:02.973123 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:20:03.009274 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb65899-be56-4987-8886-14e3b8a64fc9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:20:03.010875 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb65899-be56-4987-8886-14e3b8a64fc9 service nova] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:20:03.029666 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 694/1403] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:20:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:20:05.269043 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b890e5-048e-439b-bdec-c8a728dfa178 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:20:05.270020 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b890e5-048e-439b-bdec-c8a728dfa178 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:20:05.270324 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b890e5-048e-439b-bdec-c8a728dfa178 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:20:05.271713 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 710/1404] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:20:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:20:05.277511 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0695b9-c676-465b-a44c-91f1914184ca None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:20:05.277961 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0695b9-c676-465b-a44c-91f1914184ca None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:20:05.278058 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0695b9-c676-465b-a44c-91f1914184ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:20:05.352309 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-9f0695b9-c676-465b-a44c-91f1914184ca None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:20:05.353560 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-9f0695b9-c676-465b-a44c-91f1914184ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:20:05.462749 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 695/1405] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:20:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:20:05.755634 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b890e5-048e-439b-bdec-c8a728dfa178 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:20:05.757226 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-52b890e5-048e-439b-bdec-c8a728dfa178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:20:05.849107 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:20:05.925396 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b890e5-048e-439b-bdec-c8a728dfa178 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:20:06.058962 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bc2026-4b38-48af-8821-bcac11abf23f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15c70bfb085a44e9b84942b480ff22f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:20:06.059683 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bc2026-4b38-48af-8821-bcac11abf23f service nova] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:20:06.060045 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bc2026-4b38-48af-8821-bcac11abf23f service nova] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:20:06.060405 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bc2026-4b38-48af-8821-bcac11abf23f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:20:06.062054 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-c4bc2026-4b38-48af-8821-bcac11abf23f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:20:06.118320 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:20:06.162784 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bc2026-4b38-48af-8821-bcac11abf23f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:20:06.169010 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bc2026-4b38-48af-8821-bcac11abf23f service nova] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:20:06.189298 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 711/1406] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:20:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:20:08.532655 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f1b693-87e6-4501-b410-6abb5106e5ef None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:20:08.533208 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f1b693-87e6-4501-b410-6abb5106e5ef None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:20:08.533208 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f1b693-87e6-4501-b410-6abb5106e5ef None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:20:08.534596 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 696/1407] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:20:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:20:08.540301 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71169b1c-0917-4045-96c0-899307a77832 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:20:08.540772 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71169b1c-0917-4045-96c0-899307a77832 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:20:08.540858 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71169b1c-0917-4045-96c0-899307a77832 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:20:08.614126 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-71169b1c-0917-4045-96c0-899307a77832 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:20:08.615400 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-71169b1c-0917-4045-96c0-899307a77832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:20:08.719810 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 712/1408] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:20:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:20:09.008146 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f1b693-87e6-4501-b410-6abb5106e5ef None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:20:09.009690 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-e3f1b693-87e6-4501-b410-6abb5106e5ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:20:09.049449 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:20:09.169743 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f1b693-87e6-4501-b410-6abb5106e5ef None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:20:09.291490 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:20:09.298589 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79137faf-3f5e-450e-88b9-92995d4fdeb3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15c70bfb085a44e9b84942b480ff22f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:20:09.299203 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79137faf-3f5e-450e-88b9-92995d4fdeb3 service nova] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:20:09.299482 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79137faf-3f5e-450e-88b9-92995d4fdeb3 service nova] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:20:09.299755 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79137faf-3f5e-450e-88b9-92995d4fdeb3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:20:09.301563 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-79137faf-3f5e-450e-88b9-92995d4fdeb3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:20:09.404095 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79137faf-3f5e-450e-88b9-92995d4fdeb3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:20:09.405808 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79137faf-3f5e-450e-88b9-92995d4fdeb3 service nova] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:20:09.433856 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 697/1409] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:20:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:20:18.717900 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=90 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:20:19.431115 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=47 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:20:23.227307 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217dc9de-c28c-43cb-be7b-03903c434a53 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:20:23.227885 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217dc9de-c28c-43cb-be7b-03903c434a53 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:20:23.227885 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217dc9de-c28c-43cb-be7b-03903c434a53 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:20:23.229240 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 713/1410] 10.222.0.66 () {54 vars in 918 bytes} [Mon Sep 19 10:20:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:20:23.234344 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575ae0f4-856c-4535-9b93-6700adc60263 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:20:23.234769 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575ae0f4-856c-4535-9b93-6700adc60263 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:20:23.234897 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575ae0f4-856c-4535-9b93-6700adc60263 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:20:23.311568 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-575ae0f4-856c-4535-9b93-6700adc60263 None None] MFA Rules not processed for user `46b78120cac64f09bd0f4cdc42424163`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:20:23.312792 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-575ae0f4-856c-4535-9b93-6700adc60263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:20:23.417259 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 698/1411] 10.222.0.66 () {58 vars in 1015 bytes} [Mon Sep 19 10:20:23 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:20:23.432374 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45535df0-6bf1-41bd-9895-7c82ef2a0962 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:20:23.432657 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45535df0-6bf1-41bd-9895-7c82ef2a0962 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:20:23.432930 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45535df0-6bf1-41bd-9895-7c82ef2a0962 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:20:23.434261 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 714/1412] 10.222.0.66 () {54 vars in 918 bytes} [Mon Sep 19 10:20:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:20:23.438977 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e102fc41-08c6-4e53-a416-c35fb5b7691f None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:20:23.439263 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e102fc41-08c6-4e53-a416-c35fb5b7691f None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:20:23.439539 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e102fc41-08c6-4e53-a416-c35fb5b7691f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:20:23.535438 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:20:23.538146 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-e102fc41-08c6-4e53-a416-c35fb5b7691f None None] MFA Rules not processed for user `15c70bfb085a44e9b84942b480ff22f1`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:20:23.540376 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-e102fc41-08c6-4e53-a416-c35fb5b7691f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:20:23.655555 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 699/1413] 10.222.0.66 () {58 vars in 1015 bytes} [Mon Sep 19 10:20:23 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:20:26.251120 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b550de94-90fa-4e9e-97c4-e6acd2ff182a None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:20:26.251654 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b550de94-90fa-4e9e-97c4-e6acd2ff182a None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:20:26.251654 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b550de94-90fa-4e9e-97c4-e6acd2ff182a None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:20:26.253045 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 715/1414] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 19 10:20:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:20:26.259063 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc2ed42-0df2-4080-b2da-496ca4bd2eb6 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:20:26.259446 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc2ed42-0df2-4080-b2da-496ca4bd2eb6 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:20:26.259616 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc2ed42-0df2-4080-b2da-496ca4bd2eb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:20:26.442087 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-3bc2ed42-0df2-4080-b2da-496ca4bd2eb6 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:20:26.443636 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-3bc2ed42-0df2-4080-b2da-496ca4bd2eb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:20:26.498934 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:20:26.542037 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 700/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 19 10:20:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:20:26.829365 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b550de94-90fa-4e9e-97c4-e6acd2ff182a None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:20:26.830924 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-b550de94-90fa-4e9e-97c4-e6acd2ff182a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:20:26.977592 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b550de94-90fa-4e9e-97c4-e6acd2ff182a None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:20:27.056285 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:20:27.095930 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59608931-cd31-4790-8e87-ebf72a636272 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15c70bfb085a44e9b84942b480ff22f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:20:27.096484 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59608931-cd31-4790-8e87-ebf72a636272 service nova] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:20:27.096761 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59608931-cd31-4790-8e87-ebf72a636272 service nova] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:20:27.097028 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59608931-cd31-4790-8e87-ebf72a636272 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:20:27.098605 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-59608931-cd31-4790-8e87-ebf72a636272 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:20:27.187157 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59608931-cd31-4790-8e87-ebf72a636272 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:20:27.188888 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59608931-cd31-4790-8e87-ebf72a636272 service nova] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:20:27.206625 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 716/1416] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:20:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:20:28.340577 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cba4b6-a976-402a-93a0-46423a393218 None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:20:28.341152 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cba4b6-a976-402a-93a0-46423a393218 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:20:28.341152 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cba4b6-a976-402a-93a0-46423a393218 None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:20:28.342504 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 701/1417] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 19 10:20:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:20:28.348948 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab88d3f-ca72-4f8b-aa99-9c499fc05ffc None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:20:28.349416 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab88d3f-ca72-4f8b-aa99-9c499fc05ffc None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:20:28.349521 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab88d3f-ca72-4f8b-aa99-9c499fc05ffc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:20:28.427019 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-eab88d3f-ca72-4f8b-aa99-9c499fc05ffc None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:20:28.428286 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-eab88d3f-ca72-4f8b-aa99-9c499fc05ffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:20:28.456601 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:20:28.527248 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 717/1418] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 19 10:20:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:20:28.678480 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cba4b6-a976-402a-93a0-46423a393218 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:20:28.680624 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-c5cba4b6-a976-402a-93a0-46423a393218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:20:28.826829 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cba4b6-a976-402a-93a0-46423a393218 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:20:28.866020 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:20:28.940777 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec37d75-a011-4623-b575-46ed32d74c2f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15c70bfb085a44e9b84942b480ff22f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:20:28.941298 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec37d75-a011-4623-b575-46ed32d74c2f service nova] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:20:28.941582 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec37d75-a011-4623-b575-46ed32d74c2f service nova] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:20:28.941855 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec37d75-a011-4623-b575-46ed32d74c2f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:20:28.943493 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-8ec37d75-a011-4623-b575-46ed32d74c2f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:20:29.032176 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec37d75-a011-4623-b575-46ed32d74c2f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:20:29.033851 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec37d75-a011-4623-b575-46ed32d74c2f service nova] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:20:29.051530 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 702/1419] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:20:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:20:30.197003 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b535a11e-c925-4bca-9b25-cd5bfefd8293 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:20:30.197571 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b535a11e-c925-4bca-9b25-cd5bfefd8293 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:20:30.197571 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b535a11e-c925-4bca-9b25-cd5bfefd8293 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:20:30.198902 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 718/1420] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 19 10:20:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:20:30.205333 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa00c1b1-e74f-4e26-9761-a20dc0198491 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:20:30.205814 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa00c1b1-e74f-4e26-9761-a20dc0198491 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:20:30.205914 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa00c1b1-e74f-4e26-9761-a20dc0198491 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:20:30.259552 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:20:30.282555 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-aa00c1b1-e74f-4e26-9761-a20dc0198491 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:20:30.283758 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-aa00c1b1-e74f-4e26-9761-a20dc0198491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:20:30.378798 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 703/1421] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 19 10:20:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:20:30.532513 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b535a11e-c925-4bca-9b25-cd5bfefd8293 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:20:30.534040 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-b535a11e-c925-4bca-9b25-cd5bfefd8293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:20:30.679705 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b535a11e-c925-4bca-9b25-cd5bfefd8293 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:20:30.695503 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:20:30.799455 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e810096-e6d9-48d2-b2d7-7729c7936f5e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15c70bfb085a44e9b84942b480ff22f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:20:30.799965 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e810096-e6d9-48d2-b2d7-7729c7936f5e service nova] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:20:30.800282 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e810096-e6d9-48d2-b2d7-7729c7936f5e service nova] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:20:30.800558 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e810096-e6d9-48d2-b2d7-7729c7936f5e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:20:30.802153 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-5e810096-e6d9-48d2-b2d7-7729c7936f5e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:20:30.897382 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e810096-e6d9-48d2-b2d7-7729c7936f5e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:20:30.900327 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e810096-e6d9-48d2-b2d7-7729c7936f5e service nova] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:20:30.919062 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 719/1422] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:20:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:20:32.047174 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54a2361-4ca9-44da-89ee-4e1436c705f5 None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:20:32.047702 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54a2361-4ca9-44da-89ee-4e1436c705f5 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:20:32.047702 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54a2361-4ca9-44da-89ee-4e1436c705f5 None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:20:32.049089 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 704/1423] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 19 10:20:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:20:32.055358 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e479b9-1b19-485f-9638-7d4520c803c3 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:20:32.055816 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e479b9-1b19-485f-9638-7d4520c803c3 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:20:32.055914 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e479b9-1b19-485f-9638-7d4520c803c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:20:32.075440 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:20:32.138908 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-50e479b9-1b19-485f-9638-7d4520c803c3 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:20:32.140142 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-50e479b9-1b19-485f-9638-7d4520c803c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:20:32.236566 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 720/1424] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 19 10:20:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:20:32.388612 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54a2361-4ca9-44da-89ee-4e1436c705f5 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:20:32.390086 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-f54a2361-4ca9-44da-89ee-4e1436c705f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:20:32.498699 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:20:32.535445 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54a2361-4ca9-44da-89ee-4e1436c705f5 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:20:32.652319 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb997598-1d80-4729-877e-745c5f134224 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15c70bfb085a44e9b84942b480ff22f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:20:32.652844 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb997598-1d80-4729-877e-745c5f134224 service nova] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:20:32.653120 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb997598-1d80-4729-877e-745c5f134224 service nova] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:20:32.653388 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb997598-1d80-4729-877e-745c5f134224 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:20:32.655006 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-cb997598-1d80-4729-877e-745c5f134224 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:20:32.734376 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:20:32.748238 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb997598-1d80-4729-877e-745c5f134224 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:20:32.749855 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb997598-1d80-4729-877e-745c5f134224 service nova] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:20:32.767678 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 705/1425] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:20:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:20:33.888903 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4591d76a-9061-4023-9812-f706af91ed56 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:20:33.889510 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4591d76a-9061-4023-9812-f706af91ed56 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:20:33.889510 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4591d76a-9061-4023-9812-f706af91ed56 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:20:33.890828 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 721/1426] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 19 10:20:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:20:33.897864 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14451d8b-1346-43ad-87fc-5ee22663c699 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:20:33.898452 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14451d8b-1346-43ad-87fc-5ee22663c699 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:20:33.898812 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14451d8b-1346-43ad-87fc-5ee22663c699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:20:33.981076 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-14451d8b-1346-43ad-87fc-5ee22663c699 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:20:33.982207 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-14451d8b-1346-43ad-87fc-5ee22663c699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:20:34.078422 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 706/1427] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 19 10:20:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:20:34.239654 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4591d76a-9061-4023-9812-f706af91ed56 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:20:34.241271 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-4591d76a-9061-4023-9812-f706af91ed56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:20:34.325298 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:20:34.387764 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4591d76a-9061-4023-9812-f706af91ed56 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:20:34.503742 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63a3c4a-d836-44cf-8542-e65807873c4b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15c70bfb085a44e9b84942b480ff22f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:20:34.504387 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63a3c4a-d836-44cf-8542-e65807873c4b service nova] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:20:34.504670 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63a3c4a-d836-44cf-8542-e65807873c4b service nova] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:20:34.504945 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63a3c4a-d836-44cf-8542-e65807873c4b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:20:34.506628 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-c63a3c4a-d836-44cf-8542-e65807873c4b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:20:34.559248 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:20:34.607568 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63a3c4a-d836-44cf-8542-e65807873c4b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:20:34.609196 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63a3c4a-d836-44cf-8542-e65807873c4b service nova] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:20:34.628052 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 722/1428] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:20:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:20:35.688266 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5089f42d-13c1-4458-8e97-a0807c7dc140 None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:20:35.688822 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5089f42d-13c1-4458-8e97-a0807c7dc140 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:20:35.688822 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5089f42d-13c1-4458-8e97-a0807c7dc140 None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:20:35.690157 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 707/1429] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 19 10:20:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:20:35.696611 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d8c877-3ced-4a31-a7eb-661a1170d008 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:20:35.697050 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d8c877-3ced-4a31-a7eb-661a1170d008 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:20:35.697184 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d8c877-3ced-4a31-a7eb-661a1170d008 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:20:35.773528 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-84d8c877-3ced-4a31-a7eb-661a1170d008 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:20:35.774785 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-84d8c877-3ced-4a31-a7eb-661a1170d008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:20:35.870632 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 723/1430] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 19 10:20:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:20:36.019791 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5089f42d-13c1-4458-8e97-a0807c7dc140 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:20:36.021248 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-5089f42d-13c1-4458-8e97-a0807c7dc140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:20:36.070865 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:20:36.172404 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5089f42d-13c1-4458-8e97-a0807c7dc140 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:20:36.284992 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8399391d-1a10-440b-8d30-94c69644a5fb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15c70bfb085a44e9b84942b480ff22f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:20:36.285600 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8399391d-1a10-440b-8d30-94c69644a5fb service nova] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:20:36.285880 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8399391d-1a10-440b-8d30-94c69644a5fb service nova] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:20:36.286151 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8399391d-1a10-440b-8d30-94c69644a5fb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:20:36.287749 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-8399391d-1a10-440b-8d30-94c69644a5fb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:20:36.295086 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:20:36.376039 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8399391d-1a10-440b-8d30-94c69644a5fb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:20:36.377673 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8399391d-1a10-440b-8d30-94c69644a5fb service nova] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:20:36.395868 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 708/1431] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:20:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:20:37.468074 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2a88a2-20cb-46bc-bdb3-f04ba2c68f41 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:20:37.468676 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2a88a2-20cb-46bc-bdb3-f04ba2c68f41 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:20:37.468676 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2a88a2-20cb-46bc-bdb3-f04ba2c68f41 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:20:37.470022 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 724/1432] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 19 10:20:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:20:37.476605 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a145281-7776-447b-89db-17b8d4cbbe80 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:20:37.477058 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a145281-7776-447b-89db-17b8d4cbbe80 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:20:37.477175 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a145281-7776-447b-89db-17b8d4cbbe80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:20:37.551714 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-8a145281-7776-447b-89db-17b8d4cbbe80 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:20:37.552957 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-8a145281-7776-447b-89db-17b8d4cbbe80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:20:37.622255 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:20:37.650900 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 709/1433] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 19 10:20:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:20:37.803598 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2a88a2-20cb-46bc-bdb3-f04ba2c68f41 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:20:37.805189 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-bf2a88a2-20cb-46bc-bdb3-f04ba2c68f41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:20:37.823021 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:20:37.951675 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2a88a2-20cb-46bc-bdb3-f04ba2c68f41 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:20:38.040183 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:20:38.066069 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91859e0-e894-48f6-baff-2a6fd7eac30f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15c70bfb085a44e9b84942b480ff22f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:20:38.066594 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91859e0-e894-48f6-baff-2a6fd7eac30f service nova] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:20:38.066875 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91859e0-e894-48f6-baff-2a6fd7eac30f service nova] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:20:38.067138 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91859e0-e894-48f6-baff-2a6fd7eac30f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:20:38.068751 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-c91859e0-e894-48f6-baff-2a6fd7eac30f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:20:38.156123 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91859e0-e894-48f6-baff-2a6fd7eac30f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:20:38.158323 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91859e0-e894-48f6-baff-2a6fd7eac30f service nova] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:20:38.179908 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 725/1434] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:20:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:20:39.271505 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0545a421-9a92-482c-89c8-b05fbd325e93 None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:20:39.272934 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0545a421-9a92-482c-89c8-b05fbd325e93 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:20:39.273224 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0545a421-9a92-482c-89c8-b05fbd325e93 None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:20:39.274607 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 710/1435] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 19 10:20:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:20:39.281005 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eae6b6-7e58-4872-9ad6-5a2a2cc5a5f5 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:20:39.281447 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eae6b6-7e58-4872-9ad6-5a2a2cc5a5f5 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:20:39.281542 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eae6b6-7e58-4872-9ad6-5a2a2cc5a5f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:20:39.358772 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-d4eae6b6-7e58-4872-9ad6-5a2a2cc5a5f5 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:20:39.360012 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-d4eae6b6-7e58-4872-9ad6-5a2a2cc5a5f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:20:39.400775 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:20:39.454854 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 726/1436] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 19 10:20:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:20:39.606412 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0545a421-9a92-482c-89c8-b05fbd325e93 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:20:39.607956 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-0545a421-9a92-482c-89c8-b05fbd325e93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:20:39.754531 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0545a421-9a92-482c-89c8-b05fbd325e93 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:20:39.809585 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:20:39.869439 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd178ba-7184-4fbf-8fcf-71fc75a724f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15c70bfb085a44e9b84942b480ff22f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:20:39.869958 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd178ba-7184-4fbf-8fcf-71fc75a724f0 service nova] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:20:39.870237 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd178ba-7184-4fbf-8fcf-71fc75a724f0 service nova] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:20:39.870509 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd178ba-7184-4fbf-8fcf-71fc75a724f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:20:39.872115 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-cfd178ba-7184-4fbf-8fcf-71fc75a724f0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:20:39.963201 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd178ba-7184-4fbf-8fcf-71fc75a724f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:20:39.964845 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd178ba-7184-4fbf-8fcf-71fc75a724f0 service nova] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:20:39.982317 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 711/1437] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:20:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:20:41.066163 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9ec7ce-f45f-413f-bf7a-a334180e150d None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:20:41.066721 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9ec7ce-f45f-413f-bf7a-a334180e150d None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:20:41.066721 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9ec7ce-f45f-413f-bf7a-a334180e150d None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:20:41.068063 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 727/1438] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 19 10:20:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:20:41.074622 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adc4dfd-da30-4826-86b3-e264b0c3710d None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:20:41.075085 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adc4dfd-da30-4826-86b3-e264b0c3710d None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:20:41.075215 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adc4dfd-da30-4826-86b3-e264b0c3710d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:20:41.151176 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-6adc4dfd-da30-4826-86b3-e264b0c3710d None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:20:41.152550 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-6adc4dfd-da30-4826-86b3-e264b0c3710d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:20:41.154558 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:20:41.248676 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 712/1439] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 19 10:20:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:20:41.402046 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9ec7ce-f45f-413f-bf7a-a334180e150d None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:20:41.403469 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-da9ec7ce-f45f-413f-bf7a-a334180e150d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:20:41.550105 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9ec7ce-f45f-413f-bf7a-a334180e150d None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:20:41.578904 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:20:41.782618 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1521f940-9f3e-4e91-9421-b33569a5a957 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15c70bfb085a44e9b84942b480ff22f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:20:41.783223 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1521f940-9f3e-4e91-9421-b33569a5a957 service nova] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:20:41.783507 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1521f940-9f3e-4e91-9421-b33569a5a957 service nova] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:20:41.783776 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1521f940-9f3e-4e91-9421-b33569a5a957 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:20:41.785403 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-1521f940-9f3e-4e91-9421-b33569a5a957 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:20:41.874228 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1521f940-9f3e-4e91-9421-b33569a5a957 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:20:41.875828 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1521f940-9f3e-4e91-9421-b33569a5a957 service nova] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:20:41.894661 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 728/1440] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:20:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:20:43.992439 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d98bae-4f62-4959-8eff-0c2ac700b69a None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:20:43.992970 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d98bae-4f62-4959-8eff-0c2ac700b69a None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:20:43.992970 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d98bae-4f62-4959-8eff-0c2ac700b69a None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:20:43.994248 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 713/1441] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 19 10:20:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:20:43.999584 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ef59ca-7a63-49b5-809e-633f8dd77306 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:20:44.000020 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ef59ca-7a63-49b5-809e-633f8dd77306 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:20:44.000138 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ef59ca-7a63-49b5-809e-633f8dd77306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:20:44.041049 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:20:44.067078 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-a2ef59ca-7a63-49b5-809e-633f8dd77306 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:20:44.068375 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-a2ef59ca-7a63-49b5-809e-633f8dd77306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:20:44.167072 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 729/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 19 10:20:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:20:44.450372 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d98bae-4f62-4959-8eff-0c2ac700b69a None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:20:44.451923 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-c2d98bae-4f62-4959-8eff-0c2ac700b69a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:20:44.557109 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d98bae-4f62-4959-8eff-0c2ac700b69a None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:20:44.589356 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:20:44.637944 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54316a3d-7381-4e41-97ba-01557d6cd764 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c1289b015854c6bb6aee8fed6b807db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:20:44.638760 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54316a3d-7381-4e41-97ba-01557d6cd764 service neutron] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:20:44.638914 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54316a3d-7381-4e41-97ba-01557d6cd764 service neutron] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:20:44.639084 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54316a3d-7381-4e41-97ba-01557d6cd764 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:20:44.640782 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-54316a3d-7381-4e41-97ba-01557d6cd764 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:20:44.757366 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54316a3d-7381-4e41-97ba-01557d6cd764 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:20:44.758825 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54316a3d-7381-4e41-97ba-01557d6cd764 service neutron] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:20:44.777647 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 714/1443] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:20:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:20:47.092430 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58d1ca3-1389-45a0-933d-bf63794bf23f None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:20:47.093028 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58d1ca3-1389-45a0-933d-bf63794bf23f None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:20:47.093028 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58d1ca3-1389-45a0-933d-bf63794bf23f None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:20:47.094323 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 730/1444] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 19 10:20:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:20:47.099529 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc69c530-90a8-4d33-8873-fd3bbbf34353 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:20:47.099956 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc69c530-90a8-4d33-8873-fd3bbbf34353 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:20:47.100072 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc69c530-90a8-4d33-8873-fd3bbbf34353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:20:47.166909 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-bc69c530-90a8-4d33-8873-fd3bbbf34353 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:20:47.168129 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-bc69c530-90a8-4d33-8873-fd3bbbf34353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:20:47.181214 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:20:47.264697 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 715/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 19 10:20:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:20:47.557860 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58d1ca3-1389-45a0-933d-bf63794bf23f None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:20:47.559413 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-b58d1ca3-1389-45a0-933d-bf63794bf23f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:20:47.665666 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58d1ca3-1389-45a0-933d-bf63794bf23f None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:20:47.679142 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:20:47.739873 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c3fe8d-e174-4a4b-bc95-fde5e9ab3e8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c1289b015854c6bb6aee8fed6b807db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:20:47.740515 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c3fe8d-e174-4a4b-bc95-fde5e9ab3e8e service neutron] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:20:47.741299 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c3fe8d-e174-4a4b-bc95-fde5e9ab3e8e service neutron] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:20:47.741576 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c3fe8d-e174-4a4b-bc95-fde5e9ab3e8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:20:47.743145 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-58c3fe8d-e174-4a4b-bc95-fde5e9ab3e8e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:20:47.848857 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c3fe8d-e174-4a4b-bc95-fde5e9ab3e8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:20:47.850223 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c3fe8d-e174-4a4b-bc95-fde5e9ab3e8e service neutron] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:20:47.868103 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 731/1446] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:20:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:20:50.357773 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a93cc9a-344c-48ba-9850-2b84c3fb15b1 None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:20:50.358340 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a93cc9a-344c-48ba-9850-2b84c3fb15b1 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:20:50.358340 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a93cc9a-344c-48ba-9850-2b84c3fb15b1 None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:20:50.359704 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 716/1447] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 19 10:20:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:20:50.365120 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e695678e-8465-4e63-97a6-367cefc7d0f4 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:20:50.365537 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e695678e-8465-4e63-97a6-367cefc7d0f4 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:20:50.365658 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e695678e-8465-4e63-97a6-367cefc7d0f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:20:50.414129 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:20:50.432823 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-e695678e-8465-4e63-97a6-367cefc7d0f4 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:20:50.434036 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-e695678e-8465-4e63-97a6-367cefc7d0f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:20:50.528981 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 732/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 19 10:20:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:20:50.819783 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a93cc9a-344c-48ba-9850-2b84c3fb15b1 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:20:50.821403 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-8a93cc9a-344c-48ba-9850-2b84c3fb15b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:20:50.924184 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a93cc9a-344c-48ba-9850-2b84c3fb15b1 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:20:50.965513 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:20:51.000625 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717855e1-8c7e-4d20-b975-4076f5fd7429 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c1289b015854c6bb6aee8fed6b807db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:20:51.001237 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717855e1-8c7e-4d20-b975-4076f5fd7429 service neutron] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:20:51.001954 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717855e1-8c7e-4d20-b975-4076f5fd7429 service neutron] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:20:51.002239 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717855e1-8c7e-4d20-b975-4076f5fd7429 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:20:51.003846 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-717855e1-8c7e-4d20-b975-4076f5fd7429 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:20:51.111928 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717855e1-8c7e-4d20-b975-4076f5fd7429 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:20:51.113415 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717855e1-8c7e-4d20-b975-4076f5fd7429 service neutron] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:20:51.131851 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 717/1449] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:20:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:20:53.434055 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd8bd77-9b8d-4422-a584-bfe9cac7677e None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:20:53.434629 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd8bd77-9b8d-4422-a584-bfe9cac7677e None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:20:53.434629 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd8bd77-9b8d-4422-a584-bfe9cac7677e None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:20:53.435934 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 733/1450] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 19 10:20:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:20:53.441299 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b4c792-9308-4862-bb71-76f350653b6a None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:20:53.441695 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b4c792-9308-4862-bb71-76f350653b6a None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:20:53.441840 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b4c792-9308-4862-bb71-76f350653b6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:20:53.507982 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-e0b4c792-9308-4862-bb71-76f350653b6a None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:20:53.509228 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-e0b4c792-9308-4862-bb71-76f350653b6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:20:53.530215 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:20:53.611663 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 718/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 19 10:20:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:20:53.897072 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd8bd77-9b8d-4422-a584-bfe9cac7677e None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:20:53.899140 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-7dd8bd77-9b8d-4422-a584-bfe9cac7677e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:20:54.004971 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd8bd77-9b8d-4422-a584-bfe9cac7677e None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:20:54.026394 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:20:54.079763 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f864aaf-8303-4051-8c61-970ada968578 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c1289b015854c6bb6aee8fed6b807db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:20:54.080396 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f864aaf-8303-4051-8c61-970ada968578 service neutron] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:20:54.080679 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f864aaf-8303-4051-8c61-970ada968578 service neutron] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:20:54.080955 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f864aaf-8303-4051-8c61-970ada968578 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:20:54.082556 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-7f864aaf-8303-4051-8c61-970ada968578 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:20:54.192843 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f864aaf-8303-4051-8c61-970ada968578 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:20:54.194342 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f864aaf-8303-4051-8c61-970ada968578 service neutron] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:20:54.211857 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 734/1452] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:20:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:20:56.541228 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4ff79d-4c49-45d6-9bfb-ff8e702d5386 None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:20:56.541791 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4ff79d-4c49-45d6-9bfb-ff8e702d5386 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:20:56.541791 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4ff79d-4c49-45d6-9bfb-ff8e702d5386 None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:20:56.543157 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 719/1453] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 19 10:20:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:20:56.548755 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f22137-2c66-4061-804c-694949aadf88 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:20:56.549217 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f22137-2c66-4061-804c-694949aadf88 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:20:56.549344 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f22137-2c66-4061-804c-694949aadf88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:20:56.611530 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:20:56.614440 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-c0f22137-2c66-4061-804c-694949aadf88 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:20:56.616772 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-c0f22137-2c66-4061-804c-694949aadf88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:20:56.714098 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 735/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 19 10:20:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:20:57.006883 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4ff79d-4c49-45d6-9bfb-ff8e702d5386 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:20:57.006883 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-ea4ff79d-4c49-45d6-9bfb-ff8e702d5386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:20:57.112903 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4ff79d-4c49-45d6-9bfb-ff8e702d5386 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:20:57.163721 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:20:57.189739 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ada9d7-8b2e-47ac-b452-f01e0b2f9825 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c1289b015854c6bb6aee8fed6b807db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:20:57.190353 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ada9d7-8b2e-47ac-b452-f01e0b2f9825 service neutron] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:20:57.190631 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ada9d7-8b2e-47ac-b452-f01e0b2f9825 service neutron] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:20:57.190908 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ada9d7-8b2e-47ac-b452-f01e0b2f9825 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:20:57.192541 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-c6ada9d7-8b2e-47ac-b452-f01e0b2f9825 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:20:57.300578 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ada9d7-8b2e-47ac-b452-f01e0b2f9825 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:20:57.302023 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ada9d7-8b2e-47ac-b452-f01e0b2f9825 service neutron] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:20:57.319876 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 720/1455] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:20:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:20:59.667169 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdcbdb0-0d99-49e9-b572-5bf276ddc20a None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:20:59.667678 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdcbdb0-0d99-49e9-b572-5bf276ddc20a None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:20:59.667678 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdcbdb0-0d99-49e9-b572-5bf276ddc20a None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:20:59.669286 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 736/1456] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 19 10:20:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:20:59.674906 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3c2076-07f1-47b2-92b5-81e9910ef480 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:20:59.675369 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3c2076-07f1-47b2-92b5-81e9910ef480 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:20:59.675535 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3c2076-07f1-47b2-92b5-81e9910ef480 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:20:59.741416 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-ac3c2076-07f1-47b2-92b5-81e9910ef480 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:20:59.742631 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-ac3c2076-07f1-47b2-92b5-81e9910ef480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:20:59.771237 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:20:59.838680 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 721/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 19 10:20:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:21:00.127537 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdcbdb0-0d99-49e9-b572-5bf276ddc20a None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:21:00.129137 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-acdcbdb0-0d99-49e9-b572-5bf276ddc20a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:21:00.229845 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdcbdb0-0d99-49e9-b572-5bf276ddc20a None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:21:00.257563 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:21:00.303429 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ebde73-aad8-4957-90ef-5a61df6c89e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c1289b015854c6bb6aee8fed6b807db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:21:00.304060 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ebde73-aad8-4957-90ef-5a61df6c89e5 service neutron] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:21:00.304386 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ebde73-aad8-4957-90ef-5a61df6c89e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:21:00.304662 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ebde73-aad8-4957-90ef-5a61df6c89e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:21:00.306264 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-72ebde73-aad8-4957-90ef-5a61df6c89e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:21:00.415947 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ebde73-aad8-4957-90ef-5a61df6c89e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:21:00.417336 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ebde73-aad8-4957-90ef-5a61df6c89e5 service neutron] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:21:00.436243 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 737/1458] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:21:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:21:02.666196 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e8d5c6-85f1-4091-a51a-99f73d909071 None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:21:02.666725 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e8d5c6-85f1-4091-a51a-99f73d909071 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:21:02.666725 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e8d5c6-85f1-4091-a51a-99f73d909071 None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:21:02.668081 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 722/1459] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 19 10:21:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:21:02.674171 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98866949-4177-4cf0-a0ba-c890156e6b22 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:21:02.674618 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98866949-4177-4cf0-a0ba-c890156e6b22 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:21:02.674724 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98866949-4177-4cf0-a0ba-c890156e6b22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:21:02.748609 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-98866949-4177-4cf0-a0ba-c890156e6b22 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:21:02.749829 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-98866949-4177-4cf0-a0ba-c890156e6b22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:21:02.758621 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:21:02.847496 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 738/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 19 10:21:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:21:03.136322 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e8d5c6-85f1-4091-a51a-99f73d909071 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:21:03.137875 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-d6e8d5c6-85f1-4091-a51a-99f73d909071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:21:03.238853 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e8d5c6-85f1-4091-a51a-99f73d909071 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:21:03.294187 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:21:03.312635 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da695b12-515a-490f-af81-b17135255e6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c1289b015854c6bb6aee8fed6b807db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:21:03.313237 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da695b12-515a-490f-af81-b17135255e6c service neutron] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:21:03.313503 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da695b12-515a-490f-af81-b17135255e6c service neutron] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:21:03.313773 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da695b12-515a-490f-af81-b17135255e6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:21:03.315350 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-da695b12-515a-490f-af81-b17135255e6c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:21:03.432072 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da695b12-515a-490f-af81-b17135255e6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:21:03.433539 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da695b12-515a-490f-af81-b17135255e6c service neutron] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:21:03.452579 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 723/1461] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:21:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:21:05.705092 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a03f1f6-b5ef-4d73-a61a-e04b21424ecd None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:21:05.705647 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a03f1f6-b5ef-4d73-a61a-e04b21424ecd None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:21:05.705647 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a03f1f6-b5ef-4d73-a61a-e04b21424ecd None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:21:05.707159 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 739/1462] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 19 10:21:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:21:05.712301 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674901c0-2318-49b4-b119-4cf8fe335f2a None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:21:05.712721 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674901c0-2318-49b4-b119-4cf8fe335f2a None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:21:05.712827 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674901c0-2318-49b4-b119-4cf8fe335f2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:21:05.777255 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-674901c0-2318-49b4-b119-4cf8fe335f2a None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:21:05.778468 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-674901c0-2318-49b4-b119-4cf8fe335f2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:21:05.815999 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:21:05.873181 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 724/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 19 10:21:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:21:06.155567 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a03f1f6-b5ef-4d73-a61a-e04b21424ecd None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:21:06.157130 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-7a03f1f6-b5ef-4d73-a61a-e04b21424ecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:21:06.259728 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a03f1f6-b5ef-4d73-a61a-e04b21424ecd None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:21:06.296831 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:21:06.333395 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdfe850-59ae-4e2e-a095-da2b88fbe92a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c1289b015854c6bb6aee8fed6b807db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:21:06.333998 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdfe850-59ae-4e2e-a095-da2b88fbe92a service neutron] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:21:06.334298 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdfe850-59ae-4e2e-a095-da2b88fbe92a service neutron] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:21:06.334575 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdfe850-59ae-4e2e-a095-da2b88fbe92a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:21:06.336138 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-9bdfe850-59ae-4e2e-a095-da2b88fbe92a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:21:06.443096 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdfe850-59ae-4e2e-a095-da2b88fbe92a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:21:06.444596 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdfe850-59ae-4e2e-a095-da2b88fbe92a service neutron] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:21:06.462511 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 740/1464] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:21:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 10:21:08.650911 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f94639-cbf1-464e-9c02-1586557070ee None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:21:08.651474 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f94639-cbf1-464e-9c02-1586557070ee None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:21:08.651474 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f94639-cbf1-464e-9c02-1586557070ee None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:21:08.652851 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 725/1465] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 19 10:21:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:21:08.658273 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31049f7d-3e3d-44ba-80a3-e840e5079097 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:21:08.658726 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31049f7d-3e3d-44ba-80a3-e840e5079097 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:21:08.658834 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31049f7d-3e3d-44ba-80a3-e840e5079097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:21:08.725717 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-31049f7d-3e3d-44ba-80a3-e840e5079097 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:21:08.726930 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-31049f7d-3e3d-44ba-80a3-e840e5079097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:21:08.744980 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:21:08.823107 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 741/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 19 10:21:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:21:09.115037 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f94639-cbf1-464e-9c02-1586557070ee None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:21:09.117209 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-65f94639-cbf1-464e-9c02-1586557070ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:21:09.219467 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f94639-cbf1-464e-9c02-1586557070ee None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:21:09.293969 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:21:09.301649 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297b12a7-43bd-4cfc-b320-f94f2ece7001 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c1289b015854c6bb6aee8fed6b807db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:21:09.302264 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297b12a7-43bd-4cfc-b320-f94f2ece7001 service neutron] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:21:09.302543 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297b12a7-43bd-4cfc-b320-f94f2ece7001 service neutron] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:21:09.302859 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297b12a7-43bd-4cfc-b320-f94f2ece7001 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:21:09.304619 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-297b12a7-43bd-4cfc-b320-f94f2ece7001 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:21:09.431875 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297b12a7-43bd-4cfc-b320-f94f2ece7001 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:21:09.433297 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297b12a7-43bd-4cfc-b320-f94f2ece7001 service neutron] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:21:09.453119 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 726/1467] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:21:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:21:11.677752 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c9e067-211d-420b-9c47-f42eee6f9bee None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:21:11.678309 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c9e067-211d-420b-9c47-f42eee6f9bee None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:21:11.678309 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c9e067-211d-420b-9c47-f42eee6f9bee None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:21:11.679655 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 742/1468] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 19 10:21:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:21:11.685193 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79316d7e-149f-46f1-8eba-242c017ffa20 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:21:11.686689 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79316d7e-149f-46f1-8eba-242c017ffa20 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:21:11.686689 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79316d7e-149f-46f1-8eba-242c017ffa20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:21:11.753861 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-79316d7e-149f-46f1-8eba-242c017ffa20 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:21:11.755081 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-79316d7e-149f-46f1-8eba-242c017ffa20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:21:11.804119 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:21:11.853686 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 727/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 19 10:21:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:21:12.138737 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c9e067-211d-420b-9c47-f42eee6f9bee None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:21:12.140327 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-82c9e067-211d-420b-9c47-f42eee6f9bee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:21:12.241719 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c9e067-211d-420b-9c47-f42eee6f9bee None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:21:12.292140 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:21:12.319527 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8491431b-a25f-41f4-9801-25d2ef9d914a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c1289b015854c6bb6aee8fed6b807db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:21:12.320133 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8491431b-a25f-41f4-9801-25d2ef9d914a service neutron] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:21:12.320534 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8491431b-a25f-41f4-9801-25d2ef9d914a service neutron] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:21:12.320807 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8491431b-a25f-41f4-9801-25d2ef9d914a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:21:12.322729 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-8491431b-a25f-41f4-9801-25d2ef9d914a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:21:12.430715 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8491431b-a25f-41f4-9801-25d2ef9d914a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:21:12.432094 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8491431b-a25f-41f4-9801-25d2ef9d914a service neutron] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:21:12.451101 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 743/1470] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:21:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:21:21.852146 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=22 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:21:22.448810 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=66 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:21:32.529877 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54706b04-54b3-4b37-8abf-66a8b845cc8f None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:21:32.530456 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54706b04-54b3-4b37-8abf-66a8b845cc8f None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:21:32.530456 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54706b04-54b3-4b37-8abf-66a8b845cc8f None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:21:32.531777 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 728/1471] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:21:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:21:32.537632 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28d8ee3-9eb7-4105-b5a5-79a05bca5d9d None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:21:32.538186 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28d8ee3-9eb7-4105-b5a5-79a05bca5d9d None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:21:32.538186 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28d8ee3-9eb7-4105-b5a5-79a05bca5d9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:21:32.605472 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-e28d8ee3-9eb7-4105-b5a5-79a05bca5d9d None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:21:32.606692 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-e28d8ee3-9eb7-4105-b5a5-79a05bca5d9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:21:32.703761 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 744/1472] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:21:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:21:33.000712 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37a1421-5a3d-4349-9435-0198b6076468 None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:21:33.000999 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37a1421-5a3d-4349-9435-0198b6076468 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:21:33.001277 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37a1421-5a3d-4349-9435-0198b6076468 None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:21:33.002619 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 729/1473] 10.222.0.66 () {54 vars in 962 bytes} [Mon Sep 19 10:21:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:21:33.008040 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37251a03-c4ec-47f1-806f-7790eb64bbb9 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:21:33.008356 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37251a03-c4ec-47f1-806f-7790eb64bbb9 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:21:33.008628 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37251a03-c4ec-47f1-806f-7790eb64bbb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:21:33.084533 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-37251a03-c4ec-47f1-806f-7790eb64bbb9 None None] MFA Rules not processed for user `2f95c0d9f2414f3ca2fa2d1546d47f1b`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:21:33.085729 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-37251a03-c4ec-47f1-806f-7790eb64bbb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:21:33.105846 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:21:33.161287 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 745/1474] 10.222.0.66 () {58 vars in 1059 bytes} [Mon Sep 19 10:21:33 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:21:33.169407 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37a1421-5a3d-4349-9435-0198b6076468 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:21:33.170937 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-b37a1421-5a3d-4349-9435-0198b6076468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:21:33.272270 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37a1421-5a3d-4349-9435-0198b6076468 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:21:33.346121 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f91213b-b502-461a-bbf6-d65344d20096 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f95c0d9f2414f3ca2fa2d1546d47f1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:21:33.346726 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f91213b-b502-461a-bbf6-d65344d20096 service glance] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:21:33.347009 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f91213b-b502-461a-bbf6-d65344d20096 service glance] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:21:33.347286 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f91213b-b502-461a-bbf6-d65344d20096 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:21:33.348925 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-8f91213b-b502-461a-bbf6-d65344d20096 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:21:33.402725 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:21:33.459416 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f91213b-b502-461a-bbf6-d65344d20096 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:21:33.461015 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f91213b-b502-461a-bbf6-d65344d20096 service glance] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:21:33.479634 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 730/1475] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:21:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:21:35.754678 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6899fcaa-c4e4-478b-9b56-76df06a531c6 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:21:35.755287 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6899fcaa-c4e4-478b-9b56-76df06a531c6 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:21:35.755287 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6899fcaa-c4e4-478b-9b56-76df06a531c6 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:21:35.756654 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 746/1476] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:21:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:21:35.762020 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc735118-0b51-4075-8efb-620e39195a7c None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:21:35.762474 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc735118-0b51-4075-8efb-620e39195a7c None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:21:35.762604 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc735118-0b51-4075-8efb-620e39195a7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:21:35.828076 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-fc735118-0b51-4075-8efb-620e39195a7c None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:21:35.829316 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-fc735118-0b51-4075-8efb-620e39195a7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:21:35.926431 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 731/1477] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:21:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:21:36.203101 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6899fcaa-c4e4-478b-9b56-76df06a531c6 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:21:36.204728 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-6899fcaa-c4e4-478b-9b56-76df06a531c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:21:36.335985 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6899fcaa-c4e4-478b-9b56-76df06a531c6 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:21:36.386273 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:21:36.430065 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504e1f9d-c0c3-463f-9e4b-edabb1b52dde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:21:36.430700 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504e1f9d-c0c3-463f-9e4b-edabb1b52dde admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:21:36.430973 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504e1f9d-c0c3-463f-9e4b-edabb1b52dde admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:21:36.431240 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504e1f9d-c0c3-463f-9e4b-edabb1b52dde admin admin] PATH_INFO: `/v3/projects` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:21:36.431871 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504e1f9d-c0c3-463f-9e4b-edabb1b52dde admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:21:36.433644 dv-cinder-858275-1-smb devstack@keystone.service[81351]: WARNING py.warnings [None req-504e1f9d-c0c3-463f-9e4b-edabb1b52dde admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 19 10:21:36.433644 dv-cinder-858275-1-smb devstack@keystone.service[81351]: warnings.warn(msg) Sep 19 10:21:36.433644 dv-cinder-858275-1-smb devstack@keystone.service[81351]: Sep 19 10:21:36.434767 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504e1f9d-c0c3-463f-9e4b-edabb1b52dde admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:21:36.454084 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 747/1478] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 19 10:21:36 2022] GET /identity/v3/projects => generated 2553 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 10:21:38.640078 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1df8be-99c0-43fd-ae05-e9f67b68793c None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:21:38.640685 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1df8be-99c0-43fd-ae05-e9f67b68793c None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:21:38.640685 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1df8be-99c0-43fd-ae05-e9f67b68793c None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:21:38.642011 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 732/1479] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:21:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:21:38.648250 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836f230c-a47d-4b32-88b0-f9d9ba86534b None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:21:38.648825 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836f230c-a47d-4b32-88b0-f9d9ba86534b None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:21:38.648825 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836f230c-a47d-4b32-88b0-f9d9ba86534b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:21:38.715982 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-836f230c-a47d-4b32-88b0-f9d9ba86534b None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:21:38.717182 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-836f230c-a47d-4b32-88b0-f9d9ba86534b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:21:38.817334 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 748/1480] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:21:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:21:39.115016 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1df8be-99c0-43fd-ae05-e9f67b68793c None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:21:39.116581 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-fb1df8be-99c0-43fd-ae05-e9f67b68793c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:21:39.126762 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:21:39.261853 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1df8be-99c0-43fd-ae05-e9f67b68793c None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:21:39.341899 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:21:39.375916 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25415b3c-aac4-441e-8233-1b0eebeac078 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15c70bfb085a44e9b84942b480ff22f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:21:39.376550 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25415b3c-aac4-441e-8233-1b0eebeac078 service nova] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:21:39.376836 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25415b3c-aac4-441e-8233-1b0eebeac078 service nova] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:21:39.377108 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25415b3c-aac4-441e-8233-1b0eebeac078 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:21:39.378706 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-25415b3c-aac4-441e-8233-1b0eebeac078 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:21:39.470572 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25415b3c-aac4-441e-8233-1b0eebeac078 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:21:39.472251 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25415b3c-aac4-441e-8233-1b0eebeac078 service nova] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:21:39.490835 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 733/1481] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:21:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 10:21:41.902495 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc9027c-a092-460a-902c-cad6796bfdc4 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:21:41.903070 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc9027c-a092-460a-902c-cad6796bfdc4 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:21:41.903070 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc9027c-a092-460a-902c-cad6796bfdc4 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:21:41.904429 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 749/1482] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:21:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:21:41.909954 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038c4161-d8ba-4d3f-8a55-8534afb51340 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:21:41.910385 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038c4161-d8ba-4d3f-8a55-8534afb51340 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:21:41.910569 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038c4161-d8ba-4d3f-8a55-8534afb51340 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:21:41.980151 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-038c4161-d8ba-4d3f-8a55-8534afb51340 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:21:41.981316 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-038c4161-d8ba-4d3f-8a55-8534afb51340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:21:42.028879 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:21:42.079211 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 734/1483] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:21:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 10:21:42.377542 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc9027c-a092-460a-902c-cad6796bfdc4 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:21:42.379155 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-6fc9027c-a092-460a-902c-cad6796bfdc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:21:42.402693 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:21:42.485046 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc9027c-a092-460a-902c-cad6796bfdc4 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:21:42.559327 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52652572-6f0b-49f6-a9ae-aef01b54cf65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c1289b015854c6bb6aee8fed6b807db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:21:42.559934 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52652572-6f0b-49f6-a9ae-aef01b54cf65 service neutron] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:21:42.560241 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52652572-6f0b-49f6-a9ae-aef01b54cf65 service neutron] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:21:42.560515 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52652572-6f0b-49f6-a9ae-aef01b54cf65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:21:42.562124 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-52652572-6f0b-49f6-a9ae-aef01b54cf65 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:21:42.640267 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:21:42.676701 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52652572-6f0b-49f6-a9ae-aef01b54cf65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:21:42.678160 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52652572-6f0b-49f6-a9ae-aef01b54cf65 service neutron] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:21:42.700190 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 750/1484] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:21:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:21:44.945137 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcbfe6d-45e5-4eb5-97d6-6e631611561c None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:21:44.945705 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcbfe6d-45e5-4eb5-97d6-6e631611561c None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:21:44.945815 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcbfe6d-45e5-4eb5-97d6-6e631611561c None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:21:44.947114 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 735/1485] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:21:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:21:44.952678 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c704d0c-34ae-4947-ac00-44bc98129105 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:21:44.953071 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c704d0c-34ae-4947-ac00-44bc98129105 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:21:44.953233 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c704d0c-34ae-4947-ac00-44bc98129105 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:21:45.019188 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-2c704d0c-34ae-4947-ac00-44bc98129105 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:21:45.020448 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-2c704d0c-34ae-4947-ac00-44bc98129105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:21:45.115671 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 751/1486] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:21:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:21:45.406038 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcbfe6d-45e5-4eb5-97d6-6e631611561c None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:21:45.407627 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-1bcbfe6d-45e5-4eb5-97d6-6e631611561c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:21:45.510345 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcbfe6d-45e5-4eb5-97d6-6e631611561c None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:21:45.580807 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:21:45.582283 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e50e6d9-8e78-4538-8b2f-b81d93a668a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c1289b015854c6bb6aee8fed6b807db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:21:45.582935 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e50e6d9-8e78-4538-8b2f-b81d93a668a2 service neutron] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:21:45.583699 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e50e6d9-8e78-4538-8b2f-b81d93a668a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:21:45.584203 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e50e6d9-8e78-4538-8b2f-b81d93a668a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:21:45.586136 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-7e50e6d9-8e78-4538-8b2f-b81d93a668a2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:21:45.703066 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e50e6d9-8e78-4538-8b2f-b81d93a668a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:21:45.704669 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e50e6d9-8e78-4538-8b2f-b81d93a668a2 service neutron] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:21:45.723030 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 736/1487] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:21:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:21:48.033048 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ba4d8b-9043-40b5-8b37-3ebfe01cba68 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:21:48.033617 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ba4d8b-9043-40b5-8b37-3ebfe01cba68 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:21:48.033617 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ba4d8b-9043-40b5-8b37-3ebfe01cba68 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:21:48.034929 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 752/1488] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:21:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:21:48.040773 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6816f00-8e38-4f9a-8b85-ec75350e244c None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:21:48.041215 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6816f00-8e38-4f9a-8b85-ec75350e244c None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:21:48.041345 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6816f00-8e38-4f9a-8b85-ec75350e244c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:21:48.107681 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-b6816f00-8e38-4f9a-8b85-ec75350e244c None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:21:48.108928 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-b6816f00-8e38-4f9a-8b85-ec75350e244c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:21:48.163361 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:21:48.207336 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 737/1489] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:21:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:21:48.502589 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ba4d8b-9043-40b5-8b37-3ebfe01cba68 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:21:48.504132 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-58ba4d8b-9043-40b5-8b37-3ebfe01cba68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:21:48.542413 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:21:48.610243 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ba4d8b-9043-40b5-8b37-3ebfe01cba68 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:21:48.683250 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e586140-4b58-4648-a7cd-05065123eac4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c1289b015854c6bb6aee8fed6b807db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:21:48.683862 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e586140-4b58-4648-a7cd-05065123eac4 service neutron] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:21:48.684144 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e586140-4b58-4648-a7cd-05065123eac4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:21:48.684461 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e586140-4b58-4648-a7cd-05065123eac4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:21:48.686068 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-1e586140-4b58-4648-a7cd-05065123eac4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:21:48.767718 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:21:48.797388 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e586140-4b58-4648-a7cd-05065123eac4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:21:48.798842 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e586140-4b58-4648-a7cd-05065123eac4 service neutron] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:21:48.818046 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 753/1490] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:21:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:21:51.195164 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ce04e4-26a5-4f7c-8573-f0dfd4d2be1a None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:21:51.195707 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ce04e4-26a5-4f7c-8573-f0dfd4d2be1a None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:21:51.195828 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ce04e4-26a5-4f7c-8573-f0dfd4d2be1a None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:21:51.197174 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 738/1491] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 19 10:21:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:21:51.202485 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa35d6ed-638d-4196-b461-48a728ccfdfb None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:21:51.202910 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa35d6ed-638d-4196-b461-48a728ccfdfb None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:21:51.203031 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa35d6ed-638d-4196-b461-48a728ccfdfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:21:51.268186 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-fa35d6ed-638d-4196-b461-48a728ccfdfb None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:21:51.269416 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-fa35d6ed-638d-4196-b461-48a728ccfdfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:21:51.365996 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 754/1492] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 19 10:21:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 10:21:51.656044 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ce04e4-26a5-4f7c-8573-f0dfd4d2be1a None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:21:51.657666 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-a3ce04e4-26a5-4f7c-8573-f0dfd4d2be1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:21:51.766982 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ce04e4-26a5-4f7c-8573-f0dfd4d2be1a None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:21:51.841294 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8405126-e73a-46ac-8ac9-31e04a04e9b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c1289b015854c6bb6aee8fed6b807db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:21:51.841909 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8405126-e73a-46ac-8ac9-31e04a04e9b0 service neutron] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:21:51.842188 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8405126-e73a-46ac-8ac9-31e04a04e9b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:21:51.842486 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8405126-e73a-46ac-8ac9-31e04a04e9b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:21:51.844080 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-f8405126-e73a-46ac-8ac9-31e04a04e9b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:21:51.852502 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:21:51.958324 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8405126-e73a-46ac-8ac9-31e04a04e9b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:21:51.960298 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8405126-e73a-46ac-8ac9-31e04a04e9b0 service neutron] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:21:51.978879 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 739/1493] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:21:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:22:01.364442 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=82 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:22:01.976436 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=50 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:23:05.110879 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0104333b-8d79-421f-80ce-a34f6597b8cd None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:23:05.111480 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0104333b-8d79-421f-80ce-a34f6597b8cd None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:23:05.111480 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0104333b-8d79-421f-80ce-a34f6597b8cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:23:05.186960 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-0104333b-8d79-421f-80ce-a34f6597b8cd None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:23:05.188274 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-0104333b-8d79-421f-80ce-a34f6597b8cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:23:05.283427 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 755/1494] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:23:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:23:05.291454 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5fe3e2-c9c8-4991-9e9f-96a8f9b66a93 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:23:05.291972 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5fe3e2-c9c8-4991-9e9f-96a8f9b66a93 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:23:05.292081 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5fe3e2-c9c8-4991-9e9f-96a8f9b66a93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:23:05.368813 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-fa5fe3e2-c9c8-4991-9e9f-96a8f9b66a93 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:23:05.369960 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-fa5fe3e2-c9c8-4991-9e9f-96a8f9b66a93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:23:05.467620 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 740/1495] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:23:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:23:05.472392 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0104333b-8d79-421f-80ce-a34f6597b8cd None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:23:05.473633 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-0104333b-8d79-421f-80ce-a34f6597b8cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:23:05.484895 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0104333b-8d79-421f-80ce-a34f6597b8cd None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:23:05.544534 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:23:05.579095 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b40dec-c197-49c2-b0e0-f7c81830e305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:23:05.579690 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b40dec-c197-49c2-b0e0-f7c81830e305 admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:23:05.580040 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b40dec-c197-49c2-b0e0-f7c81830e305 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:23:05.580265 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b40dec-c197-49c2-b0e0-f7c81830e305 admin admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:23:05.580889 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b40dec-c197-49c2-b0e0-f7c81830e305 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:23:05.581179 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b40dec-c197-49c2-b0e0-f7c81830e305 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:23:05.582260 dv-cinder-858275-1-smb devstack@keystone.service[81351]: WARNING py.warnings [None req-f4b40dec-c197-49c2-b0e0-f7c81830e305 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 19 10:23:05.582260 dv-cinder-858275-1-smb devstack@keystone.service[81351]: warnings.warn(msg) Sep 19 10:23:05.582260 dv-cinder-858275-1-smb devstack@keystone.service[81351]: Sep 19 10:23:05.583137 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b40dec-c197-49c2-b0e0-f7c81830e305 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:23:05.593945 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 756/1496] 10.222.0.66 () {58 vars in 1153 bytes} [Mon Sep 19 10:23:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 10:23:05.602378 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5fe3e2-c9c8-4991-9e9f-96a8f9b66a93 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:23:05.611521 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5fe3e2-c9c8-4991-9e9f-96a8f9b66a93 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:23:05.675540 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:23:05.710896 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220f51ba-715f-4aeb-b42d-695d26fc2fa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:23:05.711502 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220f51ba-715f-4aeb-b42d-695d26fc2fa6 admin admin] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:23:05.711774 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220f51ba-715f-4aeb-b42d-695d26fc2fa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:23:05.712041 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220f51ba-715f-4aeb-b42d-695d26fc2fa6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:23:05.712693 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220f51ba-715f-4aeb-b42d-695d26fc2fa6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:23:05.714418 dv-cinder-858275-1-smb devstack@keystone.service[81352]: WARNING py.warnings [None req-220f51ba-715f-4aeb-b42d-695d26fc2fa6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 19 10:23:05.714418 dv-cinder-858275-1-smb devstack@keystone.service[81352]: warnings.warn(msg) Sep 19 10:23:05.714418 dv-cinder-858275-1-smb devstack@keystone.service[81352]: Sep 19 10:23:05.715603 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220f51ba-715f-4aeb-b42d-695d26fc2fa6 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:23:05.772217 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 741/1497] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 19 10:23:05 2022] POST /identity/v3/projects => generated 379 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:23:05.776455 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b40dec-c197-49c2-b0e0-f7c81830e305 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:23:05.778010 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-f4b40dec-c197-49c2-b0e0-f7c81830e305 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:23:05.812570 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b40dec-c197-49c2-b0e0-f7c81830e305 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:23:05.905151 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d6353c-b05e-450a-bb54-05515f303e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:23:05.905767 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d6353c-b05e-450a-bb54-05515f303e47 admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:23:05.906048 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d6353c-b05e-450a-bb54-05515f303e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:23:05.906324 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d6353c-b05e-450a-bb54-05515f303e47 admin admin] PATH_INFO: `/v3/users` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:23:05.906948 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d6353c-b05e-450a-bb54-05515f303e47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:23:05.907964 dv-cinder-858275-1-smb devstack@keystone.service[81351]: WARNING py.warnings [None req-e7d6353c-b05e-450a-bb54-05515f303e47 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 19 10:23:05.907964 dv-cinder-858275-1-smb devstack@keystone.service[81351]: warnings.warn(msg) Sep 19 10:23:05.907964 dv-cinder-858275-1-smb devstack@keystone.service[81351]: Sep 19 10:23:05.909212 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d6353c-b05e-450a-bb54-05515f303e47 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:23:05.952070 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 757/1498] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 19 10:23:05 2022] POST /identity/v3/users => generated 290 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:23:05.956227 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220f51ba-715f-4aeb-b42d-695d26fc2fa6 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:23:05.957779 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-220f51ba-715f-4aeb-b42d-695d26fc2fa6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:23:06.020702 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220f51ba-715f-4aeb-b42d-695d26fc2fa6 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:23:06.104350 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:23:06.116180 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e67d33-7d6e-4e0a-a1ed-096f686297fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:23:06.116811 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e67d33-7d6e-4e0a-a1ed-096f686297fc admin admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:23:06.117091 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e67d33-7d6e-4e0a-a1ed-096f686297fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:23:06.117370 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e67d33-7d6e-4e0a-a1ed-096f686297fc admin admin] PATH_INFO: `/v3/roles` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:23:06.118007 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e67d33-7d6e-4e0a-a1ed-096f686297fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:23:06.119031 dv-cinder-858275-1-smb devstack@keystone.service[81352]: WARNING py.warnings [None req-e9e67d33-7d6e-4e0a-a1ed-096f686297fc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 19 10:23:06.119031 dv-cinder-858275-1-smb devstack@keystone.service[81352]: warnings.warn(msg) Sep 19 10:23:06.119031 dv-cinder-858275-1-smb devstack@keystone.service[81352]: Sep 19 10:23:06.119921 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e67d33-7d6e-4e0a-a1ed-096f686297fc admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:23:06.132220 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 742/1499] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:23:05 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 10:23:06.136224 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d6353c-b05e-450a-bb54-05515f303e47 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:23:06.137765 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-e7d6353c-b05e-450a-bb54-05515f303e47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:23:06.150170 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d6353c-b05e-450a-bb54-05515f303e47 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:23:06.176750 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:23:06.251050 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f551620b-ad26-434b-aca2-627d3436d74e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:23:06.251563 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f551620b-ad26-434b-aca2-627d3436d74e admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:23:06.251841 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f551620b-ad26-434b-aca2-627d3436d74e admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:23:06.252108 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f551620b-ad26-434b-aca2-627d3436d74e admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:23:06.252774 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f551620b-ad26-434b-aca2-627d3436d74e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:23:06.253807 dv-cinder-858275-1-smb devstack@keystone.service[81351]: WARNING py.warnings [None req-f551620b-ad26-434b-aca2-627d3436d74e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 19 10:23:06.253807 dv-cinder-858275-1-smb devstack@keystone.service[81351]: warnings.warn(msg) Sep 19 10:23:06.253807 dv-cinder-858275-1-smb devstack@keystone.service[81351]: Sep 19 10:23:06.254710 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f551620b-ad26-434b-aca2-627d3436d74e admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:23:06.266715 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 758/1500] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:23:06 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 10:23:06.271637 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e67d33-7d6e-4e0a-a1ed-096f686297fc admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:23:06.273239 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-e9e67d33-7d6e-4e0a-a1ed-096f686297fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:23:06.307943 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e67d33-7d6e-4e0a-a1ed-096f686297fc admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:23:06.400855 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aff2e1e-41d5-4cd8-9b3f-1cd9b1120b5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:23:06.401524 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aff2e1e-41d5-4cd8-9b3f-1cd9b1120b5e admin admin] REQUEST_METHOD: `PUT` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:23:06.401798 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aff2e1e-41d5-4cd8-9b3f-1cd9b1120b5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:23:06.402075 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aff2e1e-41d5-4cd8-9b3f-1cd9b1120b5e admin admin] PATH_INFO: `/v3/projects/586562c8a928409db83435a7cbe86873/users/9e44cecab73e4428a82b84baad740eab/roles/cd5b42ed3b754b58817a62bbe74651b4` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:23:06.430114 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aff2e1e-41d5-4cd8-9b3f-1cd9b1120b5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=586562c8a928409db83435a7cbe86873, user_id=9e44cecab73e4428a82b84baad740eab, role_id=cd5b42ed3b754b58817a62bbe74651b4)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:23:06.431160 dv-cinder-858275-1-smb devstack@keystone.service[81352]: WARNING py.warnings [None req-8aff2e1e-41d5-4cd8-9b3f-1cd9b1120b5e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 19 10:23:06.431160 dv-cinder-858275-1-smb devstack@keystone.service[81352]: warnings.warn(msg) Sep 19 10:23:06.431160 dv-cinder-858275-1-smb devstack@keystone.service[81352]: Sep 19 10:23:06.433135 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aff2e1e-41d5-4cd8-9b3f-1cd9b1120b5e admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:23:06.458673 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 743/1501] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 19 10:23:06 2022] PUT /identity/v3/projects/586562c8a928409db83435a7cbe86873/users/9e44cecab73e4428a82b84baad740eab/roles/cd5b42ed3b754b58817a62bbe74651b4 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:23:06.470698 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4864170-0937-4093-8153-f77be2ec8312 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:23:06.470981 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4864170-0937-4093-8153-f77be2ec8312 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:23:06.471254 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4864170-0937-4093-8153-f77be2ec8312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:23:06.528685 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-b4864170-0937-4093-8153-f77be2ec8312 None None] MFA Rules not processed for user `9e44cecab73e4428a82b84baad740eab`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:23:06.530006 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-b4864170-0937-4093-8153-f77be2ec8312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:23:06.606306 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 759/1502] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:23:06 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:23:06.619406 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d48a86-8d0b-4c3f-9652-1ab9fea570b0 None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:23:06.619700 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d48a86-8d0b-4c3f-9652-1ab9fea570b0 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:23:06.619980 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d48a86-8d0b-4c3f-9652-1ab9fea570b0 None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:23:06.621377 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 744/1503] 10.222.0.66 () {54 vars in 962 bytes} [Mon Sep 19 10:23:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 10:23:06.626192 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40339281-71b8-4fcf-b4a1-2b4b8748a714 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:23:06.626480 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40339281-71b8-4fcf-b4a1-2b4b8748a714 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:23:06.626758 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40339281-71b8-4fcf-b4a1-2b4b8748a714 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:23:06.658455 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:23:06.705884 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-40339281-71b8-4fcf-b4a1-2b4b8748a714 None None] MFA Rules not processed for user `dfa4d004fd44482cae761c4b3bdfab31`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:23:06.707698 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-40339281-71b8-4fcf-b4a1-2b4b8748a714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:23:06.781970 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 760/1504] 10.222.0.66 () {58 vars in 1059 bytes} [Mon Sep 19 10:23:06 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:23:06.794056 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d48a86-8d0b-4c3f-9652-1ab9fea570b0 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:23:06.796851 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-e8d48a86-8d0b-4c3f-9652-1ab9fea570b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:23:06.848858 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:23:06.904890 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d48a86-8d0b-4c3f-9652-1ab9fea570b0 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:23:06.978446 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c978f00-640c-4c24-869e-a157eb861419 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa4d004fd44482cae761c4b3bdfab31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:23:06.979049 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c978f00-640c-4c24-869e-a157eb861419 service cinder] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:23:06.979326 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c978f00-640c-4c24-869e-a157eb861419 service cinder] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:23:06.979601 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c978f00-640c-4c24-869e-a157eb861419 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:23:06.981265 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-4c978f00-640c-4c24-869e-a157eb861419 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:23:07.097099 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c978f00-640c-4c24-869e-a157eb861419 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:23:07.099011 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c978f00-640c-4c24-869e-a157eb861419 service cinder] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:23:07.102818 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:23:07.118948 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 745/1505] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:23:06 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:23:07.163896 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9785ba18-3547-45f2-8a25-7dbd05144456 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:23:07.164357 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9785ba18-3547-45f2-8a25-7dbd05144456 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:23:07.164461 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9785ba18-3547-45f2-8a25-7dbd05144456 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:23:07.165717 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 761/1506] 10.222.0.66 () {52 vars in 830 bytes} [Mon Sep 19 10:23:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:23:07.169298 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c978f00-640c-4c24-869e-a157eb861419 service cinder] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:23:07.170801 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-4c978f00-640c-4c24-869e-a157eb861419 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:23:07.269740 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c978f00-640c-4c24-869e-a157eb861419 service cinder] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:23:07.363183 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24176e6e-0d7d-4355-a92b-bd52cf56406c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:23:07.364365 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24176e6e-0d7d-4355-a92b-bd52cf56406c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:23:07.364556 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24176e6e-0d7d-4355-a92b-bd52cf56406c admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:23:07.364824 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24176e6e-0d7d-4355-a92b-bd52cf56406c admin admin] PATH_INFO: `/v3/users/9e44cecab73e4428a82b84baad740eab` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:23:07.377490 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24176e6e-0d7d-4355-a92b-bd52cf56406c admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e44cecab73e4428a82b84baad740eab)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:23:07.378507 dv-cinder-858275-1-smb devstack@keystone.service[81352]: WARNING py.warnings [None req-24176e6e-0d7d-4355-a92b-bd52cf56406c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 19 10:23:07.378507 dv-cinder-858275-1-smb devstack@keystone.service[81352]: warnings.warn(msg) Sep 19 10:23:07.378507 dv-cinder-858275-1-smb devstack@keystone.service[81352]: Sep 19 10:23:07.379755 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24176e6e-0d7d-4355-a92b-bd52cf56406c admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:23:07.389409 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:23:07.446914 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-24176e6e-0d7d-4355-a92b-bd52cf56406c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e44cecab73e4428a82b84baad740eab'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:23:07.457598 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-24176e6e-0d7d-4355-a92b-bd52cf56406c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e44cecab73e4428a82b84baad740eab'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:23:07.458611 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-24176e6e-0d7d-4355-a92b-bd52cf56406c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e44cecab73e4428a82b84baad740eab'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:23:07.459199 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-24176e6e-0d7d-4355-a92b-bd52cf56406c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e44cecab73e4428a82b84baad740eab'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:23:07.475157 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-24176e6e-0d7d-4355-a92b-bd52cf56406c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e44cecab73e4428a82b84baad740eab'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:23:07.503894 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 746/1507] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 19 10:23:07 2022] DELETE /identity/v3/users/9e44cecab73e4428a82b84baad740eab => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:23:07.508417 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c04bd54-b904-44d4-b4b8-fc13e4ac0609 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:23:07.508708 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c04bd54-b904-44d4-b4b8-fc13e4ac0609 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:23:07.508992 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c04bd54-b904-44d4-b4b8-fc13e4ac0609 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:23:07.567651 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-9c04bd54-b904-44d4-b4b8-fc13e4ac0609 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:23:07.568906 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-9c04bd54-b904-44d4-b4b8-fc13e4ac0609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:23:07.645060 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:23:07.657660 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 762/1508] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:23:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:23:07.667954 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24176e6e-0d7d-4355-a92b-bd52cf56406c admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:23:07.669222 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-24176e6e-0d7d-4355-a92b-bd52cf56406c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:23:07.771081 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24176e6e-0d7d-4355-a92b-bd52cf56406c admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:23:07.827873 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:23:07.849597 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db27bc6-edfe-4f63-99e2-3d475e042b90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c1289b015854c6bb6aee8fed6b807db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:23:07.850212 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db27bc6-edfe-4f63-99e2-3d475e042b90 service neutron] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:23:07.850489 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db27bc6-edfe-4f63-99e2-3d475e042b90 service neutron] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:23:07.850757 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db27bc6-edfe-4f63-99e2-3d475e042b90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:23:07.852399 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-9db27bc6-edfe-4f63-99e2-3d475e042b90 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:23:07.964626 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db27bc6-edfe-4f63-99e2-3d475e042b90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:23:07.965987 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db27bc6-edfe-4f63-99e2-3d475e042b90 service neutron] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:23:07.984251 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 747/1509] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:23:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:23:08.307876 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c04bd54-b904-44d4-b4b8-fc13e4ac0609 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:23:08.309177 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-9c04bd54-b904-44d4-b4b8-fc13e4ac0609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:23:08.321101 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c04bd54-b904-44d4-b4b8-fc13e4ac0609 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:23:08.419970 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573ff972-bb8a-46e9-aff0-92964df9e249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:23:08.420896 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573ff972-bb8a-46e9-aff0-92964df9e249 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:23:08.421104 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573ff972-bb8a-46e9-aff0-92964df9e249 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:23:08.421364 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573ff972-bb8a-46e9-aff0-92964df9e249 admin admin] PATH_INFO: `/v3/projects/586562c8a928409db83435a7cbe86873` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:23:08.432360 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573ff972-bb8a-46e9-aff0-92964df9e249 admin admin] RBAC: Authorizing `identity:delete_project(project_id=586562c8a928409db83435a7cbe86873)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:23:08.433417 dv-cinder-858275-1-smb devstack@keystone.service[81351]: WARNING py.warnings [None req-573ff972-bb8a-46e9-aff0-92964df9e249 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 19 10:23:08.433417 dv-cinder-858275-1-smb devstack@keystone.service[81351]: warnings.warn(msg) Sep 19 10:23:08.433417 dv-cinder-858275-1-smb devstack@keystone.service[81351]: Sep 19 10:23:08.434658 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573ff972-bb8a-46e9-aff0-92964df9e249 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:23:08.492724 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-573ff972-bb8a-46e9-aff0-92964df9e249 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '586562c8a928409db83435a7cbe86873', 'request_id': 'req-573ff972-bb8a-46e9-aff0-92964df9e249'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:23:08.508772 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-573ff972-bb8a-46e9-aff0-92964df9e249 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '586562c8a928409db83435a7cbe86873', 'request_id': 'req-573ff972-bb8a-46e9-aff0-92964df9e249'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:23:08.518168 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-573ff972-bb8a-46e9-aff0-92964df9e249 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '586562c8a928409db83435a7cbe86873', 'request_id': 'req-573ff972-bb8a-46e9-aff0-92964df9e249'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:23:08.543241 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-573ff972-bb8a-46e9-aff0-92964df9e249 admin admin] The token cache is being invalidate because project 586562c8a928409db83435a7cbe86873 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 10:23:08.543529 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-573ff972-bb8a-46e9-aff0-92964df9e249 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:23:08.544064 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-573ff972-bb8a-46e9-aff0-92964df9e249 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:23:08.545740 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 763/1510] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 19 10:23:08 2022] DELETE /identity/v3/projects/586562c8a928409db83435a7cbe86873 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:23:17.982037 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=62 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:23:18.540959 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:24:50.907197 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bf0307-6ea7-4d9c-a368-f4499bafaf9e None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:24:50.907744 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bf0307-6ea7-4d9c-a368-f4499bafaf9e None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:24:50.907744 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bf0307-6ea7-4d9c-a368-f4499bafaf9e None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:24:50.909575 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 748/1511] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 19 10:24:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:24:50.914458 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8180b3aa-6e97-4daa-9687-59cdeee44ab9 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:24:50.914878 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8180b3aa-6e97-4daa-9687-59cdeee44ab9 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:24:50.915034 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8180b3aa-6e97-4daa-9687-59cdeee44ab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:24:50.996480 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-8180b3aa-6e97-4daa-9687-59cdeee44ab9 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:24:50.997701 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-8180b3aa-6e97-4daa-9687-59cdeee44ab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:24:51.100179 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 764/1512] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 19 10:24:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:24:51.253880 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bf0307-6ea7-4d9c-a368-f4499bafaf9e None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:24:51.256024 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-99bf0307-6ea7-4d9c-a368-f4499bafaf9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:24:51.372136 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bf0307-6ea7-4d9c-a368-f4499bafaf9e None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:24:51.377820 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2210aa-a3d8-4ceb-8c25-9fb316be7514 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15c70bfb085a44e9b84942b480ff22f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:24:51.378422 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2210aa-a3d8-4ceb-8c25-9fb316be7514 service nova] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:24:51.378703 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2210aa-a3d8-4ceb-8c25-9fb316be7514 service nova] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:24:51.378978 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2210aa-a3d8-4ceb-8c25-9fb316be7514 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:24:51.387867 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2210aa-a3d8-4ceb-8c25-9fb316be7514 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:24:51.389514 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2210aa-a3d8-4ceb-8c25-9fb316be7514 service nova] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:24:51.399773 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 749/1513] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:24:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:24:52.491477 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4969d2-1f5d-4bdb-b77f-0cfb69d1a335 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:24:52.492018 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4969d2-1f5d-4bdb-b77f-0cfb69d1a335 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:24:52.492018 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4969d2-1f5d-4bdb-b77f-0cfb69d1a335 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:24:52.493442 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 765/1514] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 19 10:24:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:24:52.499604 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329335c5-1a6a-4e51-9f8b-eec4419e3931 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:24:52.500086 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329335c5-1a6a-4e51-9f8b-eec4419e3931 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:24:52.500215 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329335c5-1a6a-4e51-9f8b-eec4419e3931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:24:52.520680 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-329335c5-1a6a-4e51-9f8b-eec4419e3931 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:24:52.521910 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-329335c5-1a6a-4e51-9f8b-eec4419e3931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:24:52.529829 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 750/1515] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 19 10:24:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:24:52.681948 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4969d2-1f5d-4bdb-b77f-0cfb69d1a335 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:24:52.696743 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4969d2-1f5d-4bdb-b77f-0cfb69d1a335 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:24:52.702171 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4a9af4-e665-44e4-a1ff-d7a11582e634 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15c70bfb085a44e9b84942b480ff22f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:24:52.702770 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4a9af4-e665-44e4-a1ff-d7a11582e634 service nova] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:24:52.703047 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4a9af4-e665-44e4-a1ff-d7a11582e634 service nova] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:24:52.703319 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4a9af4-e665-44e4-a1ff-d7a11582e634 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:24:52.712629 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4a9af4-e665-44e4-a1ff-d7a11582e634 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:24:52.714314 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4a9af4-e665-44e4-a1ff-d7a11582e634 service nova] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:24:52.724029 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 766/1516] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:24:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:24:55.358631 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c0d1b9-5e88-4736-948f-94a776e11e84 None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:24:55.359259 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c0d1b9-5e88-4736-948f-94a776e11e84 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:24:55.359259 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c0d1b9-5e88-4736-948f-94a776e11e84 None None] PATH_INFO: `/v3` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:24:55.360545 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 751/1517] 10.222.0.55 () {54 vars in 925 bytes} [Mon Sep 19 10:24:55 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:24:55.367674 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bded0127-c56c-40f9-8321-b246acf80957 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:24:55.368124 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bded0127-c56c-40f9-8321-b246acf80957 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:24:55.368259 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bded0127-c56c-40f9-8321-b246acf80957 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:24:55.429723 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-bded0127-c56c-40f9-8321-b246acf80957 None None] MFA Rules not processed for user `46b78120cac64f09bd0f4cdc42424163`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:24:55.430964 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-bded0127-c56c-40f9-8321-b246acf80957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:24:55.449408 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:24:55.508227 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 767/1518] 10.222.0.55 () {58 vars in 1015 bytes} [Mon Sep 19 10:24:55 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:25:02.515180 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=56 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:25:04.207191 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5bb873-7502-4c33-a301-f67404f59487 None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:25:04.207940 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5bb873-7502-4c33-a301-f67404f59487 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:25:04.207940 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5bb873-7502-4c33-a301-f67404f59487 None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:25:04.209108 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 752/1519] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 19 10:25:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:25:04.215568 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed84db86-e3d4-495b-8882-354e0892b52b None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:25:04.216085 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed84db86-e3d4-495b-8882-354e0892b52b None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:25:04.216358 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed84db86-e3d4-495b-8882-354e0892b52b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:25:04.235418 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-ed84db86-e3d4-495b-8882-354e0892b52b None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:25:04.237157 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-ed84db86-e3d4-495b-8882-354e0892b52b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:25:04.244966 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 768/1520] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 19 10:25:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:25:04.399655 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5bb873-7502-4c33-a301-f67404f59487 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:25:04.414513 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5bb873-7502-4c33-a301-f67404f59487 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:25:04.420001 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5678f85-5aee-4807-bf46-26b15a29ae3a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15c70bfb085a44e9b84942b480ff22f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:25:04.420885 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5678f85-5aee-4807-bf46-26b15a29ae3a service nova] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:25:04.421163 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5678f85-5aee-4807-bf46-26b15a29ae3a service nova] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:25:04.421437 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5678f85-5aee-4807-bf46-26b15a29ae3a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:25:04.430146 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5678f85-5aee-4807-bf46-26b15a29ae3a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:25:04.431751 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5678f85-5aee-4807-bf46-26b15a29ae3a service nova] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:25:04.441016 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 753/1521] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:25:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:25:05.526983 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ee087a-5aea-44bc-8e9b-8ef28a76cfab None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:25:05.527531 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ee087a-5aea-44bc-8e9b-8ef28a76cfab None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:25:05.527704 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ee087a-5aea-44bc-8e9b-8ef28a76cfab None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:25:05.529450 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 769/1522] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 19 10:25:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 10:25:05.536812 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68d81cd-e369-4878-bc3f-2b022650f51e None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:25:05.537335 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68d81cd-e369-4878-bc3f-2b022650f51e None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:25:05.537335 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68d81cd-e369-4878-bc3f-2b022650f51e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:25:05.556746 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-c68d81cd-e369-4878-bc3f-2b022650f51e None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:25:05.557944 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-c68d81cd-e369-4878-bc3f-2b022650f51e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:25:05.565725 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 754/1523] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 19 10:25:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:25:05.719315 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ee087a-5aea-44bc-8e9b-8ef28a76cfab None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:25:05.734607 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ee087a-5aea-44bc-8e9b-8ef28a76cfab None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:25:05.740264 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea5230f-91b6-40e8-9e27-a3baa0960560 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15c70bfb085a44e9b84942b480ff22f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:25:05.740865 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea5230f-91b6-40e8-9e27-a3baa0960560 service nova] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:25:05.741189 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea5230f-91b6-40e8-9e27-a3baa0960560 service nova] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:25:05.741455 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea5230f-91b6-40e8-9e27-a3baa0960560 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:25:05.749550 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea5230f-91b6-40e8-9e27-a3baa0960560 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:25:05.751128 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea5230f-91b6-40e8-9e27-a3baa0960560 service nova] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:25:05.760368 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 770/1524] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:25:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:25:07.033271 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b01bfdb-4bdb-4947-9553-f08a83b03323 None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:25:07.033889 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b01bfdb-4bdb-4947-9553-f08a83b03323 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:25:07.033889 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b01bfdb-4bdb-4947-9553-f08a83b03323 None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:25:07.035800 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 755/1525] 10.222.0.66 () {54 vars in 961 bytes} [Mon Sep 19 10:25:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:25:07.041796 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95efe42c-d97e-4381-b77f-041477011067 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:25:07.042512 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95efe42c-d97e-4381-b77f-041477011067 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:25:07.042512 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95efe42c-d97e-4381-b77f-041477011067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:25:07.062590 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-95efe42c-d97e-4381-b77f-041477011067 None None] MFA Rules not processed for user `46b78120cac64f09bd0f4cdc42424163`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:25:07.063814 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-95efe42c-d97e-4381-b77f-041477011067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:25:07.073099 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 771/1526] 10.222.0.66 () {58 vars in 1058 bytes} [Mon Sep 19 10:25:07 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:25:07.081525 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b01bfdb-4bdb-4947-9553-f08a83b03323 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:25:07.097592 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b01bfdb-4bdb-4947-9553-f08a83b03323 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:25:07.103027 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7ceae8-b510-40e0-95ca-24f0bd0ff43a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46b78120cac64f09bd0f4cdc42424163', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:25:07.103634 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7ceae8-b510-40e0-95ca-24f0bd0ff43a service placement] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:25:07.103918 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7ceae8-b510-40e0-95ca-24f0bd0ff43a service placement] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:25:07.104317 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7ceae8-b510-40e0-95ca-24f0bd0ff43a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:25:07.113186 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7ceae8-b510-40e0-95ca-24f0bd0ff43a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:25:07.114602 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7ceae8-b510-40e0-95ca-24f0bd0ff43a service placement] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:25:07.125965 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 756/1527] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:25:07 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:25:17.057519 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=35 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:25:17.121449 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=15 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:25:17.238947 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa92c9b6-ba74-47ce-a7eb-9ba230b1c330 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:25:17.239232 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa92c9b6-ba74-47ce-a7eb-9ba230b1c330 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:25:17.239515 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa92c9b6-ba74-47ce-a7eb-9ba230b1c330 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:25:17.240955 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 772/1528] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 19 10:25:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:25:17.247341 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6809b1e7-0a3d-4b7f-b7ef-ea1033e8c1d9 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:25:17.247664 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6809b1e7-0a3d-4b7f-b7ef-ea1033e8c1d9 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:25:17.247945 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6809b1e7-0a3d-4b7f-b7ef-ea1033e8c1d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:25:17.267149 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-6809b1e7-0a3d-4b7f-b7ef-ea1033e8c1d9 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:25:17.268394 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-6809b1e7-0a3d-4b7f-b7ef-ea1033e8c1d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:25:17.276139 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 757/1529] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 19 10:25:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:25:17.430783 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa92c9b6-ba74-47ce-a7eb-9ba230b1c330 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:25:17.445304 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa92c9b6-ba74-47ce-a7eb-9ba230b1c330 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:25:17.450761 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae8a124-c6fa-4516-84e5-d713b9ab58c3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15c70bfb085a44e9b84942b480ff22f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:25:17.451354 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae8a124-c6fa-4516-84e5-d713b9ab58c3 service nova] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:25:17.451636 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae8a124-c6fa-4516-84e5-d713b9ab58c3 service nova] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:25:17.451913 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae8a124-c6fa-4516-84e5-d713b9ab58c3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:25:17.460590 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae8a124-c6fa-4516-84e5-d713b9ab58c3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:25:17.462163 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae8a124-c6fa-4516-84e5-d713b9ab58c3 service nova] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:25:17.472236 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 773/1530] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:25:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:25:18.574645 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a293863-19dc-4e29-9b8f-f1b3430ed08f None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:25:18.575091 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a293863-19dc-4e29-9b8f-f1b3430ed08f None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:25:18.575195 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a293863-19dc-4e29-9b8f-f1b3430ed08f None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:25:18.576573 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 758/1531] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 19 10:25:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:25:18.582870 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647cff55-c179-42a9-b0df-6bd8465402e5 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:25:18.583300 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647cff55-c179-42a9-b0df-6bd8465402e5 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:25:18.583392 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647cff55-c179-42a9-b0df-6bd8465402e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:25:18.604489 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-647cff55-c179-42a9-b0df-6bd8465402e5 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:25:18.605691 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-647cff55-c179-42a9-b0df-6bd8465402e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:25:18.614078 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 774/1532] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 19 10:25:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:25:18.769079 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a293863-19dc-4e29-9b8f-f1b3430ed08f None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:25:18.783790 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a293863-19dc-4e29-9b8f-f1b3430ed08f None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:25:18.789255 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def59a43-1558-40bc-aefa-1ce51ea37cf5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15c70bfb085a44e9b84942b480ff22f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:25:18.789855 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def59a43-1558-40bc-aefa-1ce51ea37cf5 service nova] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:25:18.790137 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def59a43-1558-40bc-aefa-1ce51ea37cf5 service nova] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:25:18.790411 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def59a43-1558-40bc-aefa-1ce51ea37cf5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:25:18.799317 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def59a43-1558-40bc-aefa-1ce51ea37cf5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:25:18.800948 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def59a43-1558-40bc-aefa-1ce51ea37cf5 service nova] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:25:18.810338 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 759/1533] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:25:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:25:23.059396 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89cc955-7578-4f16-9ac3-3c6cc4b2c88e None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:25:23.059954 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89cc955-7578-4f16-9ac3-3c6cc4b2c88e None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:25:23.059954 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89cc955-7578-4f16-9ac3-3c6cc4b2c88e None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:25:23.061371 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 775/1534] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 19 10:25:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:25:23.067485 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2556367c-06c9-4132-9e20-4a0ca91f9df0 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:25:23.067908 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2556367c-06c9-4132-9e20-4a0ca91f9df0 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:25:23.068105 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2556367c-06c9-4132-9e20-4a0ca91f9df0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:25:23.087221 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-2556367c-06c9-4132-9e20-4a0ca91f9df0 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:25:23.088448 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-2556367c-06c9-4132-9e20-4a0ca91f9df0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:25:23.096764 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 760/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 19 10:25:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:25:23.385205 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89cc955-7578-4f16-9ac3-3c6cc4b2c88e None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:25:23.386896 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-e89cc955-7578-4f16-9ac3-3c6cc4b2c88e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:25:23.463800 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89cc955-7578-4f16-9ac3-3c6cc4b2c88e None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:25:23.467306 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c73400a-6ce3-4b9d-8a7f-dfffe04499cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c1289b015854c6bb6aee8fed6b807db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:25:23.467911 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c73400a-6ce3-4b9d-8a7f-dfffe04499cb service neutron] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:25:23.468206 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c73400a-6ce3-4b9d-8a7f-dfffe04499cb service neutron] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:25:23.468480 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c73400a-6ce3-4b9d-8a7f-dfffe04499cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:25:23.477714 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c73400a-6ce3-4b9d-8a7f-dfffe04499cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:25:23.479140 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c73400a-6ce3-4b9d-8a7f-dfffe04499cb service neutron] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:25:23.488351 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 776/1536] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:25:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:25:25.658141 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7350656-3ea3-48c5-8528-8b16f78536c4 None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:25:25.658713 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7350656-3ea3-48c5-8528-8b16f78536c4 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:25:25.658713 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7350656-3ea3-48c5-8528-8b16f78536c4 None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:25:25.660030 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 761/1537] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 19 10:25:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:25:25.665473 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0e8150-f3dd-4b12-84a4-662cf0ced0e6 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:25:25.666007 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0e8150-f3dd-4b12-84a4-662cf0ced0e6 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:25:25.666007 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0e8150-f3dd-4b12-84a4-662cf0ced0e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:25:25.689144 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-2a0e8150-f3dd-4b12-84a4-662cf0ced0e6 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:25:25.691014 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-2a0e8150-f3dd-4b12-84a4-662cf0ced0e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:25:25.700748 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 777/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 19 10:25:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:25:25.989763 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7350656-3ea3-48c5-8528-8b16f78536c4 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:25:26.000558 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7350656-3ea3-48c5-8528-8b16f78536c4 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:25:26.004036 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eb5c4c-a286-4dbc-bd0b-18024580dd5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c1289b015854c6bb6aee8fed6b807db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:25:26.004795 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eb5c4c-a286-4dbc-bd0b-18024580dd5b service neutron] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:25:26.005206 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eb5c4c-a286-4dbc-bd0b-18024580dd5b service neutron] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:25:26.005612 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eb5c4c-a286-4dbc-bd0b-18024580dd5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:25:26.018741 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29eb5c4c-a286-4dbc-bd0b-18024580dd5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:25:26.021021 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29eb5c4c-a286-4dbc-bd0b-18024580dd5b service neutron] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:25:26.035912 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 762/1539] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:25:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:25:29.782493 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124244cf-5ed8-4b2a-891a-04a0ce53c7b7 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:25:29.783051 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124244cf-5ed8-4b2a-891a-04a0ce53c7b7 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:25:29.783051 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124244cf-5ed8-4b2a-891a-04a0ce53c7b7 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:25:29.784460 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 778/1540] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 19 10:25:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:25:29.790114 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3b9b29-2bb5-459d-9388-d6a1ccf4e106 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:25:29.790566 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3b9b29-2bb5-459d-9388-d6a1ccf4e106 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:25:29.790678 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3b9b29-2bb5-459d-9388-d6a1ccf4e106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:25:29.810649 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-1f3b9b29-2bb5-459d-9388-d6a1ccf4e106 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:25:29.811884 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-1f3b9b29-2bb5-459d-9388-d6a1ccf4e106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:25:29.820358 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 763/1541] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 19 10:25:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:25:30.123901 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124244cf-5ed8-4b2a-891a-04a0ce53c7b7 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:25:30.125689 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-124244cf-5ed8-4b2a-891a-04a0ce53c7b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:25:30.203314 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124244cf-5ed8-4b2a-891a-04a0ce53c7b7 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:25:30.207401 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba68eda-716b-41f7-9226-56ab33df14ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa4d004fd44482cae761c4b3bdfab31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:25:30.207999 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba68eda-716b-41f7-9226-56ab33df14ab service cinder] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:25:30.208314 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba68eda-716b-41f7-9226-56ab33df14ab service cinder] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:25:30.208588 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba68eda-716b-41f7-9226-56ab33df14ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:25:30.217363 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba68eda-716b-41f7-9226-56ab33df14ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:25:30.218786 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba68eda-716b-41f7-9226-56ab33df14ab service cinder] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:25:30.228658 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 779/1542] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:25:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:25:32.383316 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184442c0-868f-49e6-a48c-8b8fbcadac20 None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:25:32.383894 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184442c0-868f-49e6-a48c-8b8fbcadac20 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:25:32.383894 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184442c0-868f-49e6-a48c-8b8fbcadac20 None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:25:32.385267 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 764/1543] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 19 10:25:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:25:32.390453 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d893d7c1-9d83-4c39-83fb-fce2d04035a2 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:25:32.390938 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d893d7c1-9d83-4c39-83fb-fce2d04035a2 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:25:32.391593 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d893d7c1-9d83-4c39-83fb-fce2d04035a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:25:32.411121 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-d893d7c1-9d83-4c39-83fb-fce2d04035a2 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:25:32.412381 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-d893d7c1-9d83-4c39-83fb-fce2d04035a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:25:32.420603 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 780/1544] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 19 10:25:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:25:32.729634 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184442c0-868f-49e6-a48c-8b8fbcadac20 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:25:32.731313 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-184442c0-868f-49e6-a48c-8b8fbcadac20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:25:32.744918 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184442c0-868f-49e6-a48c-8b8fbcadac20 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:25:32.748404 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cbd103-7106-4c68-9c8f-20120f518eb7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa4d004fd44482cae761c4b3bdfab31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:25:32.749003 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cbd103-7106-4c68-9c8f-20120f518eb7 service cinder] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:25:32.749283 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cbd103-7106-4c68-9c8f-20120f518eb7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:25:32.749555 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cbd103-7106-4c68-9c8f-20120f518eb7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:25:32.758942 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cbd103-7106-4c68-9c8f-20120f518eb7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:25:32.760406 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cbd103-7106-4c68-9c8f-20120f518eb7 service cinder] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:25:32.769688 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 765/1545] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:25:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:25:42.406874 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=85 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:25:42.766124 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=27 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:27:05.442288 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0b259a-fa13-4b42-b004-f68726503aef None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:05.442944 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0b259a-fa13-4b42-b004-f68726503aef None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:05.442944 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0b259a-fa13-4b42-b004-f68726503aef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:05.470139 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-fa0b259a-fa13-4b42-b004-f68726503aef None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:27:05.471370 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-fa0b259a-fa13-4b42-b004-f68726503aef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:05.485203 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 781/1546] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:27:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:27:05.497293 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be21d26e-fc49-4d18-800d-1f59f9eee989 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:05.497937 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be21d26e-fc49-4d18-800d-1f59f9eee989 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:05.498338 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be21d26e-fc49-4d18-800d-1f59f9eee989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:05.534712 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-be21d26e-fc49-4d18-800d-1f59f9eee989 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:27:05.536080 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-be21d26e-fc49-4d18-800d-1f59f9eee989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:05.551528 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 766/1547] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:27:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:27:05.556623 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0b259a-fa13-4b42-b004-f68726503aef None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:05.570982 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0b259a-fa13-4b42-b004-f68726503aef None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:05.580707 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc1209b-7a89-4f56-9f66-119935fe5e40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:05.581331 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc1209b-7a89-4f56-9f66-119935fe5e40 admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:05.581609 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc1209b-7a89-4f56-9f66-119935fe5e40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:05.581874 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc1209b-7a89-4f56-9f66-119935fe5e40 admin admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:05.582523 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc1209b-7a89-4f56-9f66-119935fe5e40 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:27:05.582818 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc1209b-7a89-4f56-9f66-119935fe5e40 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:05.584451 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc1209b-7a89-4f56-9f66-119935fe5e40 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:05.605508 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 782/1548] 10.222.0.66 () {58 vars in 1153 bytes} [Mon Sep 19 10:27:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:27:05.614070 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be21d26e-fc49-4d18-800d-1f59f9eee989 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:05.624828 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fac753-a1c5-430f-9bbe-e9b7e51a7284 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:05.625156 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fac753-a1c5-430f-9bbe-e9b7e51a7284 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:05.625384 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fac753-a1c5-430f-9bbe-e9b7e51a7284 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:05.626423 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be21d26e-fc49-4d18-800d-1f59f9eee989 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:05.635279 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e1cd93-1dbe-4913-b226-2828b4c730ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:05.636053 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e1cd93-1dbe-4913-b226-2828b4c730ab admin admin] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:05.636507 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e1cd93-1dbe-4913-b226-2828b4c730ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:05.636789 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e1cd93-1dbe-4913-b226-2828b4c730ab admin admin] PATH_INFO: `/v3/projects` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:05.637434 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e1cd93-1dbe-4913-b226-2828b4c730ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:05.639938 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e1cd93-1dbe-4913-b226-2828b4c730ab admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:05.657256 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-36fac753-a1c5-430f-9bbe-e9b7e51a7284 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:27:05.658491 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-36fac753-a1c5-430f-9bbe-e9b7e51a7284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:05.677986 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 783/1549] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:27:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 10:27:05.679342 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6424a29c-1694-482a-8b5c-18e9ed811d07 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:05.679631 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6424a29c-1694-482a-8b5c-18e9ed811d07 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:05.679903 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6424a29c-1694-482a-8b5c-18e9ed811d07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:05.710092 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-6424a29c-1694-482a-8b5c-18e9ed811d07 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:27:05.710534 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 767/1550] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 19 10:27:05 2022] POST /identity/v3/projects => generated 365 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:27:05.711805 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-6424a29c-1694-482a-8b5c-18e9ed811d07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:05.711964 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b56bd6b-dfcf-47fb-8905-352331c27880 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:05.712196 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b56bd6b-dfcf-47fb-8905-352331c27880 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:05.712490 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b56bd6b-dfcf-47fb-8905-352331c27880 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:05.732681 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-0b56bd6b-dfcf-47fb-8905-352331c27880 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:27:05.733882 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-0b56bd6b-dfcf-47fb-8905-352331c27880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:05.773620 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 784/1551] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:27:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:27:05.775218 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ce49b5-b444-47ef-be98-db35ceba1ec4 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:05.775502 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ce49b5-b444-47ef-be98-db35ceba1ec4 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:05.775798 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ce49b5-b444-47ef-be98-db35ceba1ec4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:05.802907 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-12ce49b5-b444-47ef-be98-db35ceba1ec4 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:27:05.812194 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 768/1552] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:27:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:27:05.812393 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-12ce49b5-b444-47ef-be98-db35ceba1ec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:05.812489 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc93f605-7a8f-45d2-a999-721d18e0da34 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:05.812489 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc93f605-7a8f-45d2-a999-721d18e0da34 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:05.812489 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc93f605-7a8f-45d2-a999-721d18e0da34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:05.813417 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 785/1553] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:27:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:27:05.814667 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832e777f-66db-43bb-a928-33d83d21995a None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:05.814962 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832e777f-66db-43bb-a928-33d83d21995a None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:05.815236 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832e777f-66db-43bb-a928-33d83d21995a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:05.828773 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-bc93f605-7a8f-45d2-a999-721d18e0da34 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:27:05.830911 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-bc93f605-7a8f-45d2-a999-721d18e0da34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:05.835894 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-832e777f-66db-43bb-a928-33d83d21995a None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:27:05.837136 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-832e777f-66db-43bb-a928-33d83d21995a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:05.840482 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 769/1554] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:27:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:27:05.842136 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4132913a-8fb1-4d82-9e17-9251050d67e4 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:05.842660 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4132913a-8fb1-4d82-9e17-9251050d67e4 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:05.843174 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4132913a-8fb1-4d82-9e17-9251050d67e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:05.846687 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 786/1555] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:27:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:27:05.850227 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a767dc70-f233-49b1-9bf4-66ae5a4a4feb None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:05.850823 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a767dc70-f233-49b1-9bf4-66ae5a4a4feb None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:05.851440 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a767dc70-f233-49b1-9bf4-66ae5a4a4feb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:05.864197 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-4132913a-8fb1-4d82-9e17-9251050d67e4 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:27:05.865538 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-4132913a-8fb1-4d82-9e17-9251050d67e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:05.874156 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-a767dc70-f233-49b1-9bf4-66ae5a4a4feb None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:27:05.874323 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 770/1556] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:27:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:27:05.875283 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4132913a-8fb1-4d82-9e17-9251050d67e4 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:05.875424 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-a767dc70-f233-49b1-9bf4-66ae5a4a4feb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:05.884385 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 787/1557] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:27:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:27:05.885622 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a01bc1-c4b1-4f37-990a-ec91cdc76362 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:05.886281 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a01bc1-c4b1-4f37-990a-ec91cdc76362 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:05.886281 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a01bc1-c4b1-4f37-990a-ec91cdc76362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:05.886565 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4132913a-8fb1-4d82-9e17-9251050d67e4 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:05.891905 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a54282-7e85-4256-a058-7e5810e640b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:05.892737 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a54282-7e85-4256-a058-7e5810e640b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:05.893021 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a54282-7e85-4256-a058-7e5810e640b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:05.893297 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a54282-7e85-4256-a058-7e5810e640b7 admin admin] PATH_INFO: `/v3/users` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:05.893936 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a54282-7e85-4256-a058-7e5810e640b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:05.894980 dv-cinder-858275-1-smb devstack@keystone.service[81352]: WARNING py.warnings [None req-71a54282-7e85-4256-a058-7e5810e640b7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 19 10:27:05.894980 dv-cinder-858275-1-smb devstack@keystone.service[81352]: warnings.warn(msg) Sep 19 10:27:05.894980 dv-cinder-858275-1-smb devstack@keystone.service[81352]: Sep 19 10:27:05.896234 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a54282-7e85-4256-a058-7e5810e640b7 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:05.907568 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-a7a01bc1-c4b1-4f37-990a-ec91cdc76362 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:27:05.908902 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-a7a01bc1-c4b1-4f37-990a-ec91cdc76362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:05.917321 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 788/1558] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:27:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:27:05.921365 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 771/1559] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 19 10:27:05 2022] POST /identity/v3/users => generated 283 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:27:05.921519 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0400d586-8469-47fd-b035-394d744001bb None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:05.921519 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0400d586-8469-47fd-b035-394d744001bb None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:05.921519 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0400d586-8469-47fd-b035-394d744001bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:05.921770 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d989bf-9d0e-45ea-9a1e-42bbeca028b0 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:05.921770 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d989bf-9d0e-45ea-9a1e-42bbeca028b0 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:05.921770 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d989bf-9d0e-45ea-9a1e-42bbeca028b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:05.939830 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-0400d586-8469-47fd-b035-394d744001bb None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:27:05.940264 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-e8d989bf-9d0e-45ea-9a1e-42bbeca028b0 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:27:05.941068 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-0400d586-8469-47fd-b035-394d744001bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:05.941441 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-e8d989bf-9d0e-45ea-9a1e-42bbeca028b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:05.948867 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 789/1560] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:27:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:27:05.953618 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 772/1561] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:27:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:27:05.953810 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734cd003-a554-4839-b36a-a37d9322f422 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:05.953810 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734cd003-a554-4839-b36a-a37d9322f422 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:05.954010 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28a4063-cbff-40d7-a9c1-c3b839dc6d50 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:05.954134 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734cd003-a554-4839-b36a-a37d9322f422 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:05.954239 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28a4063-cbff-40d7-a9c1-c3b839dc6d50 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:05.954239 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28a4063-cbff-40d7-a9c1-c3b839dc6d50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:05.971343 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-734cd003-a554-4839-b36a-a37d9322f422 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:27:05.972089 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-f28a4063-cbff-40d7-a9c1-c3b839dc6d50 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:27:05.972495 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-734cd003-a554-4839-b36a-a37d9322f422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:05.973336 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-f28a4063-cbff-40d7-a9c1-c3b839dc6d50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:05.980594 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 790/1562] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:27:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:27:05.984808 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 773/1563] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:27:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:27:05.984808 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28a4063-cbff-40d7-a9c1-c3b839dc6d50 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:05.985064 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19c968d-3a2a-41fc-876e-f735efd932b6 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:05.985064 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19c968d-3a2a-41fc-876e-f735efd932b6 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:05.985064 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19c968d-3a2a-41fc-876e-f735efd932b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:05.993565 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28a4063-cbff-40d7-a9c1-c3b839dc6d50 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:05.998671 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec93000-46d1-409c-9a89-f2509d28e793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:05.999273 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec93000-46d1-409c-9a89-f2509d28e793 admin admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:05.999546 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec93000-46d1-409c-9a89-f2509d28e793 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:05.999814 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec93000-46d1-409c-9a89-f2509d28e793 admin admin] PATH_INFO: `/v3/domains` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:06.000477 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec93000-46d1-409c-9a89-f2509d28e793 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:27:06.000773 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec93000-46d1-409c-9a89-f2509d28e793 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:06.001776 dv-cinder-858275-1-smb devstack@keystone.service[81352]: WARNING py.warnings [None req-1ec93000-46d1-409c-9a89-f2509d28e793 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 19 10:27:06.001776 dv-cinder-858275-1-smb devstack@keystone.service[81352]: warnings.warn(msg) Sep 19 10:27:06.001776 dv-cinder-858275-1-smb devstack@keystone.service[81352]: Sep 19 10:27:06.002433 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-c19c968d-3a2a-41fc-876e-f735efd932b6 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:27:06.002650 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec93000-46d1-409c-9a89-f2509d28e793 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:06.003647 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-c19c968d-3a2a-41fc-876e-f735efd932b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:06.011823 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 791/1564] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:27:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:27:06.012773 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19c968d-3a2a-41fc-876e-f735efd932b6 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:06.022701 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 774/1565] 10.222.0.66 () {58 vars in 1153 bytes} [Mon Sep 19 10:27:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:27:06.022701 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec93000-46d1-409c-9a89-f2509d28e793 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:06.023581 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19c968d-3a2a-41fc-876e-f735efd932b6 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:06.026272 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec93000-46d1-409c-9a89-f2509d28e793 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:06.028527 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac4411a-2ab6-4363-95fa-0fb50cef80dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:06.029167 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac4411a-2ab6-4363-95fa-0fb50cef80dc admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:06.029455 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac4411a-2ab6-4363-95fa-0fb50cef80dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:06.029727 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac4411a-2ab6-4363-95fa-0fb50cef80dc admin admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:06.030369 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac4411a-2ab6-4363-95fa-0fb50cef80dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:27:06.030669 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac4411a-2ab6-4363-95fa-0fb50cef80dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:06.031096 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d493a8cb-2c06-476e-bec1-ef243eafdf8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:06.031679 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d493a8cb-2c06-476e-bec1-ef243eafdf8c admin admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:06.031955 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d493a8cb-2c06-476e-bec1-ef243eafdf8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:06.032297 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d493a8cb-2c06-476e-bec1-ef243eafdf8c admin admin] PATH_INFO: `/v3/roles` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:06.032417 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac4411a-2ab6-4363-95fa-0fb50cef80dc admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:06.032888 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d493a8cb-2c06-476e-bec1-ef243eafdf8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:06.034600 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d493a8cb-2c06-476e-bec1-ef243eafdf8c admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:06.051215 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 792/1566] 10.222.0.66 () {58 vars in 1153 bytes} [Mon Sep 19 10:27:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:27:06.051215 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac4411a-2ab6-4363-95fa-0fb50cef80dc admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:06.051511 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 775/1567] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:27:06 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 10:27:06.051511 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d493a8cb-2c06-476e-bec1-ef243eafdf8c admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:06.056673 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d493a8cb-2c06-476e-bec1-ef243eafdf8c admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:06.061753 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac4411a-2ab6-4363-95fa-0fb50cef80dc admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:06.061944 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537a40fa-c12f-4686-8c03-43a98468b366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:06.062540 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537a40fa-c12f-4686-8c03-43a98468b366 admin admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:06.062818 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537a40fa-c12f-4686-8c03-43a98468b366 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:06.063147 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537a40fa-c12f-4686-8c03-43a98468b366 admin admin] PATH_INFO: `/v3/domains` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:06.063757 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537a40fa-c12f-4686-8c03-43a98468b366 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:27:06.064058 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537a40fa-c12f-4686-8c03-43a98468b366 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:06.065791 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537a40fa-c12f-4686-8c03-43a98468b366 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:06.066425 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892ae131-7ce5-457f-b5d3-e6ea265091e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:06.067018 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892ae131-7ce5-457f-b5d3-e6ea265091e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:06.067334 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892ae131-7ce5-457f-b5d3-e6ea265091e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:06.067580 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892ae131-7ce5-457f-b5d3-e6ea265091e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:06.068246 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892ae131-7ce5-457f-b5d3-e6ea265091e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:27:06.068552 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892ae131-7ce5-457f-b5d3-e6ea265091e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:06.070141 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892ae131-7ce5-457f-b5d3-e6ea265091e7 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:06.077978 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 776/1568] 10.222.0.66 () {58 vars in 1153 bytes} [Mon Sep 19 10:27:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:27:06.078997 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537a40fa-c12f-4686-8c03-43a98468b366 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:06.090114 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 793/1569] 10.222.0.66 () {58 vars in 1153 bytes} [Mon Sep 19 10:27:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:27:06.090114 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892ae131-7ce5-457f-b5d3-e6ea265091e7 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:06.090676 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537a40fa-c12f-4686-8c03-43a98468b366 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:06.095419 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b2cac4-8633-46b3-ac13-9b7e045c77d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:06.095865 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892ae131-7ce5-457f-b5d3-e6ea265091e7 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:06.096194 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b2cac4-8633-46b3-ac13-9b7e045c77d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:06.096494 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b2cac4-8633-46b3-ac13-9b7e045c77d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:06.096772 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b2cac4-8633-46b3-ac13-9b7e045c77d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:06.097419 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b2cac4-8633-46b3-ac13-9b7e045c77d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:27:06.097720 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b2cac4-8633-46b3-ac13-9b7e045c77d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:06.099317 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b2cac4-8633-46b3-ac13-9b7e045c77d4 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:06.100515 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b20236-f696-4415-a6c7-b3f37596057d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:06.101261 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b20236-f696-4415-a6c7-b3f37596057d admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:06.101545 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b20236-f696-4415-a6c7-b3f37596057d admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:06.101824 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b20236-f696-4415-a6c7-b3f37596057d admin admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:06.102465 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b20236-f696-4415-a6c7-b3f37596057d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:27:06.102771 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b20236-f696-4415-a6c7-b3f37596057d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:06.104381 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b20236-f696-4415-a6c7-b3f37596057d admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:06.111774 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 777/1570] 10.222.0.66 () {58 vars in 1153 bytes} [Mon Sep 19 10:27:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:27:06.116991 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 794/1571] 10.222.0.66 () {58 vars in 1153 bytes} [Mon Sep 19 10:27:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:27:06.117392 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b2cac4-8633-46b3-ac13-9b7e045c77d4 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:06.118090 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b20236-f696-4415-a6c7-b3f37596057d admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:06.128674 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b2cac4-8633-46b3-ac13-9b7e045c77d4 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:06.128847 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b20236-f696-4415-a6c7-b3f37596057d admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:06.133291 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5812ca-1798-4652-aa0c-2accd8468708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:06.133482 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faa78cc-e01f-42f7-8bd6-57416fd10271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:06.133897 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5812ca-1798-4652-aa0c-2accd8468708 admin admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:06.134010 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faa78cc-e01f-42f7-8bd6-57416fd10271 admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:06.134176 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5812ca-1798-4652-aa0c-2accd8468708 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:06.134276 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faa78cc-e01f-42f7-8bd6-57416fd10271 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:06.134450 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5812ca-1798-4652-aa0c-2accd8468708 admin admin] PATH_INFO: `/v3/domains` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:06.134548 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faa78cc-e01f-42f7-8bd6-57416fd10271 admin admin] PATH_INFO: `/v3/projects` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:06.135086 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5812ca-1798-4652-aa0c-2accd8468708 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:27:06.135193 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faa78cc-e01f-42f7-8bd6-57416fd10271 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:06.135507 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5812ca-1798-4652-aa0c-2accd8468708 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:06.136114 dv-cinder-858275-1-smb devstack@keystone.service[81351]: WARNING py.warnings [None req-7faa78cc-e01f-42f7-8bd6-57416fd10271 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 19 10:27:06.136114 dv-cinder-858275-1-smb devstack@keystone.service[81351]: warnings.warn(msg) Sep 19 10:27:06.136114 dv-cinder-858275-1-smb devstack@keystone.service[81351]: Sep 19 10:27:06.137140 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5812ca-1798-4652-aa0c-2accd8468708 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:06.137384 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faa78cc-e01f-42f7-8bd6-57416fd10271 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:06.149686 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 778/1572] 10.222.0.66 () {58 vars in 1153 bytes} [Mon Sep 19 10:27:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:27:06.150578 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5812ca-1798-4652-aa0c-2accd8468708 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:06.162314 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5812ca-1798-4652-aa0c-2accd8468708 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:06.167364 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124aa51f-7fb4-47fa-9e7a-fd46d4db9886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:06.167996 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124aa51f-7fb4-47fa-9e7a-fd46d4db9886 admin admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:06.168321 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124aa51f-7fb4-47fa-9e7a-fd46d4db9886 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:06.168602 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124aa51f-7fb4-47fa-9e7a-fd46d4db9886 admin admin] PATH_INFO: `/v3/roles` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:06.169045 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 795/1573] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 19 10:27:06 2022] POST /identity/v3/projects => generated 377 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:27:06.169237 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124aa51f-7fb4-47fa-9e7a-fd46d4db9886 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:06.170702 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faa78cc-e01f-42f7-8bd6-57416fd10271 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:06.171804 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124aa51f-7fb4-47fa-9e7a-fd46d4db9886 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:06.183433 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 779/1574] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:27:06 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 10:27:06.184427 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124aa51f-7fb4-47fa-9e7a-fd46d4db9886 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:06.191185 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:27:06.195077 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124aa51f-7fb4-47fa-9e7a-fd46d4db9886 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:06.203411 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:27:06.237532 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faa78cc-e01f-42f7-8bd6-57416fd10271 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:06.242133 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c0a5a4-9739-465a-a824-f3a90a19da73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:06.242740 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c0a5a4-9739-465a-a824-f3a90a19da73 admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:06.243019 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c0a5a4-9739-465a-a824-f3a90a19da73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:06.243294 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c0a5a4-9739-465a-a824-f3a90a19da73 admin admin] PATH_INFO: `/v3/projects` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:06.243958 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c0a5a4-9739-465a-a824-f3a90a19da73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:06.245908 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c0a5a4-9739-465a-a824-f3a90a19da73 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:06.256335 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0feee7e-182d-402c-9662-175827689469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:06.256956 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0feee7e-182d-402c-9662-175827689469 admin admin] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:06.257302 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0feee7e-182d-402c-9662-175827689469 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:06.257520 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0feee7e-182d-402c-9662-175827689469 admin admin] PATH_INFO: `/v3/projects` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:06.258154 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0feee7e-182d-402c-9662-175827689469 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:06.260099 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0feee7e-182d-402c-9662-175827689469 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:06.273438 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 796/1575] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 19 10:27:06 2022] POST /identity/v3/projects => generated 371 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:27:06.274701 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c0a5a4-9739-465a-a824-f3a90a19da73 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:06.294476 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 780/1576] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 19 10:27:06 2022] POST /identity/v3/projects => generated 375 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:27:06.294476 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0feee7e-182d-402c-9662-175827689469 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:06.340687 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c0a5a4-9739-465a-a824-f3a90a19da73 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:06.356907 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0feee7e-182d-402c-9662-175827689469 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:06.363093 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab9933d-96dc-41de-9646-87dcfe2622e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:06.363803 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab9933d-96dc-41de-9646-87dcfe2622e4 admin admin] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:06.364083 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab9933d-96dc-41de-9646-87dcfe2622e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:06.364384 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab9933d-96dc-41de-9646-87dcfe2622e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:06.365363 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab9933d-96dc-41de-9646-87dcfe2622e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:06.367049 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab9933d-96dc-41de-9646-87dcfe2622e4 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:06.394379 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 781/1577] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 19 10:27:06 2022] POST /identity/v3/projects => generated 377 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:27:06.395591 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab9933d-96dc-41de-9646-87dcfe2622e4 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:06.397062 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6c9f1e-8f9c-49e7-945f-895ffe6bd041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:06.397730 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6c9f1e-8f9c-49e7-945f-895ffe6bd041 admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:06.398011 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6c9f1e-8f9c-49e7-945f-895ffe6bd041 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:06.398332 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6c9f1e-8f9c-49e7-945f-895ffe6bd041 admin admin] PATH_INFO: `/v3/projects` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:06.398959 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6c9f1e-8f9c-49e7-945f-895ffe6bd041 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:06.400933 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6c9f1e-8f9c-49e7-945f-895ffe6bd041 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:06.428614 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 797/1578] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 19 10:27:06 2022] POST /identity/v3/projects => generated 383 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:27:06.429697 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6c9f1e-8f9c-49e7-945f-895ffe6bd041 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:06.459109 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab9933d-96dc-41de-9646-87dcfe2622e4 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:06.477177 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:27:06.479020 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:27:06.496147 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6c9f1e-8f9c-49e7-945f-895ffe6bd041 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:06.500875 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9855371e-87b9-45ad-845b-ecb2b329ad0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:06.501488 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9855371e-87b9-45ad-845b-ecb2b329ad0d admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:06.501769 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9855371e-87b9-45ad-845b-ecb2b329ad0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:06.502045 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9855371e-87b9-45ad-845b-ecb2b329ad0d admin admin] PATH_INFO: `/v3/projects` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:06.502677 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9855371e-87b9-45ad-845b-ecb2b329ad0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:06.504630 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9855371e-87b9-45ad-845b-ecb2b329ad0d admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:06.521180 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fb3d66-ee9f-467f-9f06-f40606d58fb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:06.521795 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fb3d66-ee9f-467f-9f06-f40606d58fb9 admin admin] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:06.522122 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fb3d66-ee9f-467f-9f06-f40606d58fb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:06.522435 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fb3d66-ee9f-467f-9f06-f40606d58fb9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:06.523146 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fb3d66-ee9f-467f-9f06-f40606d58fb9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:06.525395 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fb3d66-ee9f-467f-9f06-f40606d58fb9 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:06.534303 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 798/1579] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 19 10:27:06 2022] POST /identity/v3/projects => generated 393 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:27:06.535122 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9855371e-87b9-45ad-845b-ecb2b329ad0d admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:06.554482 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 782/1580] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 19 10:27:06 2022] POST /identity/v3/projects => generated 383 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:27:06.555282 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fb3d66-ee9f-467f-9f06-f40606d58fb9 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:06.602086 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9855371e-87b9-45ad-845b-ecb2b329ad0d admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:06.618751 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fb3d66-ee9f-467f-9f06-f40606d58fb9 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:06.624176 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e1a21d-7002-401b-9381-aaf6e95116c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:06.624938 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e1a21d-7002-401b-9381-aaf6e95116c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:06.625218 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e1a21d-7002-401b-9381-aaf6e95116c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:06.625523 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e1a21d-7002-401b-9381-aaf6e95116c4 admin admin] PATH_INFO: `/v3/projects/fd0811ffb7d743dbaaabf1122103f839/users/1d1958945fe242dba235a89c48dd3f93/roles/cd5b42ed3b754b58817a62bbe74651b4` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:06.641499 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e1a21d-7002-401b-9381-aaf6e95116c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd0811ffb7d743dbaaabf1122103f839, user_id=1d1958945fe242dba235a89c48dd3f93, role_id=cd5b42ed3b754b58817a62bbe74651b4)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:06.644286 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e1a21d-7002-401b-9381-aaf6e95116c4 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:06.658308 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 783/1581] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 19 10:27:06 2022] PUT /identity/v3/projects/fd0811ffb7d743dbaaabf1122103f839/users/1d1958945fe242dba235a89c48dd3f93/roles/cd5b42ed3b754b58817a62bbe74651b4 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:27:06.659217 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e1a21d-7002-401b-9381-aaf6e95116c4 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:06.676481 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee50b678-6224-4413-af63-4432538fa726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:06.677228 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee50b678-6224-4413-af63-4432538fa726 admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:06.677513 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee50b678-6224-4413-af63-4432538fa726 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:06.677789 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee50b678-6224-4413-af63-4432538fa726 admin admin] PATH_INFO: `/v3/users` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:06.678426 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee50b678-6224-4413-af63-4432538fa726 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:06.680645 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee50b678-6224-4413-af63-4432538fa726 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:06.708722 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 799/1582] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 19 10:27:06 2022] POST /identity/v3/users => generated 289 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:27:06.709656 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee50b678-6224-4413-af63-4432538fa726 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:06.720029 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee50b678-6224-4413-af63-4432538fa726 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:06.725028 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abde1942-113b-46a4-9d49-afe21d9ebbca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:06.725642 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abde1942-113b-46a4-9d49-afe21d9ebbca admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:06.725926 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abde1942-113b-46a4-9d49-afe21d9ebbca admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:06.726197 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abde1942-113b-46a4-9d49-afe21d9ebbca admin admin] PATH_INFO: `/v3/users` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:06.726832 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abde1942-113b-46a4-9d49-afe21d9ebbca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:06.728801 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abde1942-113b-46a4-9d49-afe21d9ebbca admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:06.729760 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e1a21d-7002-401b-9381-aaf6e95116c4 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:06.734351 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40396b3-3f46-45ad-8f93-cbb18962f7fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:06.734956 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40396b3-3f46-45ad-8f93-cbb18962f7fe admin admin] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:06.735261 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40396b3-3f46-45ad-8f93-cbb18962f7fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:06.735535 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40396b3-3f46-45ad-8f93-cbb18962f7fe admin admin] PATH_INFO: `/v3/users` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:06.736180 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40396b3-3f46-45ad-8f93-cbb18962f7fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:06.738144 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40396b3-3f46-45ad-8f93-cbb18962f7fe admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:06.752476 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 800/1583] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 19 10:27:06 2022] POST /identity/v3/users => generated 288 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:27:06.753475 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abde1942-113b-46a4-9d49-afe21d9ebbca admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:06.762721 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 784/1584] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 19 10:27:06 2022] POST /identity/v3/users => generated 286 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:27:06.764418 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40396b3-3f46-45ad-8f93-cbb18962f7fe admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:06.768991 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abde1942-113b-46a4-9d49-afe21d9ebbca admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:06.773671 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16ed987-1677-4b7b-a64d-dc7ecbd755c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:06.774177 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40396b3-3f46-45ad-8f93-cbb18962f7fe admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:06.774299 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16ed987-1677-4b7b-a64d-dc7ecbd755c7 admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:06.774613 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16ed987-1677-4b7b-a64d-dc7ecbd755c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:06.774887 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16ed987-1677-4b7b-a64d-dc7ecbd755c7 admin admin] PATH_INFO: `/v3/users` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:06.775528 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16ed987-1677-4b7b-a64d-dc7ecbd755c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:06.777652 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16ed987-1677-4b7b-a64d-dc7ecbd755c7 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:06.778998 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8423a7e2-7b8d-4436-a9da-2149858a948c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:06.779617 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8423a7e2-7b8d-4436-a9da-2149858a948c admin admin] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:06.779895 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8423a7e2-7b8d-4436-a9da-2149858a948c admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:06.780191 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8423a7e2-7b8d-4436-a9da-2149858a948c admin admin] PATH_INFO: `/v3/users` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:06.780816 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8423a7e2-7b8d-4436-a9da-2149858a948c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:06.782730 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8423a7e2-7b8d-4436-a9da-2149858a948c admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:06.801971 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 801/1585] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 19 10:27:06 2022] POST /identity/v3/users => generated 289 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:27:06.802874 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16ed987-1677-4b7b-a64d-dc7ecbd755c7 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:06.809535 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 785/1586] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 19 10:27:06 2022] POST /identity/v3/users => generated 292 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:27:06.809535 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8423a7e2-7b8d-4436-a9da-2149858a948c admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:06.813759 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16ed987-1677-4b7b-a64d-dc7ecbd755c7 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:06.814912 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:27:06.818937 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a559f99-ef0b-4862-bd75-71305a1f271d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:06.819549 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a559f99-ef0b-4862-bd75-71305a1f271d admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:06.819863 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a559f99-ef0b-4862-bd75-71305a1f271d admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:06.820224 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8423a7e2-7b8d-4436-a9da-2149858a948c admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:06.820392 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a559f99-ef0b-4862-bd75-71305a1f271d admin admin] PATH_INFO: `/v3/users` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:06.820821 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a559f99-ef0b-4862-bd75-71305a1f271d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:06.822884 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a559f99-ef0b-4862-bd75-71305a1f271d admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:06.825660 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df47188-a75b-497f-a75e-298ae9fc8b3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:06.827050 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df47188-a75b-497f-a75e-298ae9fc8b3c admin admin] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:06.827328 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df47188-a75b-497f-a75e-298ae9fc8b3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:06.827595 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df47188-a75b-497f-a75e-298ae9fc8b3c admin admin] PATH_INFO: `/v3/users` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:06.828242 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df47188-a75b-497f-a75e-298ae9fc8b3c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:06.830151 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df47188-a75b-497f-a75e-298ae9fc8b3c admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:06.846361 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 802/1587] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 19 10:27:06 2022] POST /identity/v3/users => generated 297 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:27:06.847707 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a31c66-eace-4267-b74c-7740b50065a9 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:06.848095 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a31c66-eace-4267-b74c-7740b50065a9 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:06.848494 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a31c66-eace-4267-b74c-7740b50065a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:06.855280 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 786/1588] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 19 10:27:06 2022] POST /identity/v3/users => generated 292 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:27:06.855280 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df47188-a75b-497f-a75e-298ae9fc8b3c admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:06.862597 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df47188-a75b-497f-a75e-298ae9fc8b3c admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:06.867083 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ea14d8-5e8e-4ad5-8b14-0ad914b70c2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:06.867664 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ea14d8-5e8e-4ad5-8b14-0ad914b70c2f admin admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:06.867936 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ea14d8-5e8e-4ad5-8b14-0ad914b70c2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:06.868233 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ea14d8-5e8e-4ad5-8b14-0ad914b70c2f admin admin] PATH_INFO: `/v3/roles` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:06.868865 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ea14d8-5e8e-4ad5-8b14-0ad914b70c2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:06.870497 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ea14d8-5e8e-4ad5-8b14-0ad914b70c2f admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:06.875009 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=87,keystone:INSERT=13 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:27:06.878566 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-66a31c66-eace-4267-b74c-7740b50065a9 None None] MFA Rules not processed for user `1d1958945fe242dba235a89c48dd3f93`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:27:06.880479 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-66a31c66-eace-4267-b74c-7740b50065a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:06.881558 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 787/1589] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:27:06 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 10:27:06.882561 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ea14d8-5e8e-4ad5-8b14-0ad914b70c2f admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:06.893328 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ea14d8-5e8e-4ad5-8b14-0ad914b70c2f admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:06.898205 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ceec42-c4bd-4030-b8ac-109acf81fb2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:06.898817 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ceec42-c4bd-4030-b8ac-109acf81fb2e admin admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:06.899100 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ceec42-c4bd-4030-b8ac-109acf81fb2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:06.899374 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ceec42-c4bd-4030-b8ac-109acf81fb2e admin admin] PATH_INFO: `/v3/roles` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:06.900025 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ceec42-c4bd-4030-b8ac-109acf81fb2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:06.901672 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ceec42-c4bd-4030-b8ac-109acf81fb2e admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:06.911709 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 788/1590] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:27:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 10:27:06.912541 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ceec42-c4bd-4030-b8ac-109acf81fb2e admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:06.922843 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ceec42-c4bd-4030-b8ac-109acf81fb2e admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:06.927867 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c611ed14-162c-4902-aec5-9cba3ead217c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:06.928798 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c611ed14-162c-4902-aec5-9cba3ead217c admin admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:06.928798 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c611ed14-162c-4902-aec5-9cba3ead217c admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:06.929045 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c611ed14-162c-4902-aec5-9cba3ead217c admin admin] PATH_INFO: `/v3/roles` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:06.929634 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c611ed14-162c-4902-aec5-9cba3ead217c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:06.931226 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c611ed14-162c-4902-aec5-9cba3ead217c admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:06.942183 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 789/1591] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:27:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 10:27:06.942974 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c611ed14-162c-4902-aec5-9cba3ead217c admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:06.952441 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c611ed14-162c-4902-aec5-9cba3ead217c admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:06.953118 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 803/1592] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:27:06 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:27:06.953961 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a31c66-eace-4267-b74c-7740b50065a9 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:06.960201 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d4ef7d-0bf7-4ec3-8abc-40f30f23485e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:06.960934 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d4ef7d-0bf7-4ec3-8abc-40f30f23485e admin admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:06.961301 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d4ef7d-0bf7-4ec3-8abc-40f30f23485e admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:06.961672 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d4ef7d-0bf7-4ec3-8abc-40f30f23485e admin admin] PATH_INFO: `/v3/roles` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:06.962435 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d4ef7d-0bf7-4ec3-8abc-40f30f23485e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:06.964046 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d4ef7d-0bf7-4ec3-8abc-40f30f23485e admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:06.965081 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a31c66-eace-4267-b74c-7740b50065a9 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:06.970128 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da653c87-77f4-40d8-8a00-852dec0aa4aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:06.970692 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da653c87-77f4-40d8-8a00-852dec0aa4aa admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:06.970972 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da653c87-77f4-40d8-8a00-852dec0aa4aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:06.971248 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da653c87-77f4-40d8-8a00-852dec0aa4aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:06.971895 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da653c87-77f4-40d8-8a00-852dec0aa4aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:06.973520 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da653c87-77f4-40d8-8a00-852dec0aa4aa admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:06.977710 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 790/1593] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:27:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 10:27:06.977710 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d4ef7d-0bf7-4ec3-8abc-40f30f23485e admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:06.984089 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 804/1594] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:27:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 10:27:06.986476 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d4ef7d-0bf7-4ec3-8abc-40f30f23485e admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:06.987811 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da653c87-77f4-40d8-8a00-852dec0aa4aa admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:06.991203 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da7ea31-aecf-458b-b109-dbc0ecb3c56d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:06.991829 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da7ea31-aecf-458b-b109-dbc0ecb3c56d admin admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:06.992111 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da7ea31-aecf-458b-b109-dbc0ecb3c56d admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:06.992452 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da7ea31-aecf-458b-b109-dbc0ecb3c56d admin admin] PATH_INFO: `/v3/roles` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:06.993090 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da7ea31-aecf-458b-b109-dbc0ecb3c56d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:06.994722 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da7ea31-aecf-458b-b109-dbc0ecb3c56d admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:06.997413 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da653c87-77f4-40d8-8a00-852dec0aa4aa admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:07.002648 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bcb675-2bad-4411-a846-147a9c3a0fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:07.003174 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bcb675-2bad-4411-a846-147a9c3a0fd7 admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:07.003459 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bcb675-2bad-4411-a846-147a9c3a0fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:07.003732 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bcb675-2bad-4411-a846-147a9c3a0fd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:07.004386 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bcb675-2bad-4411-a846-147a9c3a0fd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:07.008505 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 791/1595] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:27:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 10:27:07.008656 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bcb675-2bad-4411-a846-147a9c3a0fd7 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:07.008753 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da7ea31-aecf-458b-b109-dbc0ecb3c56d admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:07.016443 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da7ea31-aecf-458b-b109-dbc0ecb3c56d admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:07.018091 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 805/1596] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:27:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 10:27:07.018824 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bcb675-2bad-4411-a846-147a9c3a0fd7 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:07.021654 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883e15eb-3552-428d-a7f9-a12da18f6db7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:07.022252 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883e15eb-3552-428d-a7f9-a12da18f6db7 admin admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:07.022534 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883e15eb-3552-428d-a7f9-a12da18f6db7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:07.022809 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883e15eb-3552-428d-a7f9-a12da18f6db7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:07.023450 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883e15eb-3552-428d-a7f9-a12da18f6db7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:07.025098 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883e15eb-3552-428d-a7f9-a12da18f6db7 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:07.029219 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bcb675-2bad-4411-a846-147a9c3a0fd7 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:07.036985 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 792/1597] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:27:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 10:27:07.036985 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883e15eb-3552-428d-a7f9-a12da18f6db7 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:07.040781 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba55832-283b-4ea3-a452-30119acd4d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:07.041409 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba55832-283b-4ea3-a452-30119acd4d88 admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:07.041691 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba55832-283b-4ea3-a452-30119acd4d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:07.041965 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba55832-283b-4ea3-a452-30119acd4d88 admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:07.042608 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba55832-283b-4ea3-a452-30119acd4d88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:07.044248 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba55832-283b-4ea3-a452-30119acd4d88 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:07.048752 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883e15eb-3552-428d-a7f9-a12da18f6db7 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:07.053859 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb90223-f986-439a-b9ef-0295c84203b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:07.054125 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb90223-f986-439a-b9ef-0295c84203b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:07.054562 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb90223-f986-439a-b9ef-0295c84203b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:07.054847 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb90223-f986-439a-b9ef-0295c84203b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:07.055638 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb90223-f986-439a-b9ef-0295c84203b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:07.056386 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 806/1598] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:27:07 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 10:27:07.057247 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba55832-283b-4ea3-a452-30119acd4d88 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:07.057602 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb90223-f986-439a-b9ef-0295c84203b4 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:07.072553 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 793/1599] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:27:07 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 10:27:07.073457 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb90223-f986-439a-b9ef-0295c84203b4 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:07.083130 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb90223-f986-439a-b9ef-0295c84203b4 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:07.087733 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200fde6a-3513-4edb-b187-431c55293cbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:07.088366 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200fde6a-3513-4edb-b187-431c55293cbb admin admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:07.088649 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200fde6a-3513-4edb-b187-431c55293cbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:07.088924 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200fde6a-3513-4edb-b187-431c55293cbb admin admin] PATH_INFO: `/v3/roles` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:07.089570 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200fde6a-3513-4edb-b187-431c55293cbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:07.091396 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200fde6a-3513-4edb-b187-431c55293cbb admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:07.101788 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 794/1600] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:27:07 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 10:27:07.102590 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200fde6a-3513-4edb-b187-431c55293cbb admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:07.113053 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200fde6a-3513-4edb-b187-431c55293cbb admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:07.117818 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec9e693-b7f1-432a-afae-3f412af43f3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:07.118385 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec9e693-b7f1-432a-afae-3f412af43f3c admin admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:07.118666 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec9e693-b7f1-432a-afae-3f412af43f3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:07.118940 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec9e693-b7f1-432a-afae-3f412af43f3c admin admin] PATH_INFO: `/v3/roles` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:07.119547 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba55832-283b-4ea3-a452-30119acd4d88 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:07.119669 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec9e693-b7f1-432a-afae-3f412af43f3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:07.121266 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec9e693-b7f1-432a-afae-3f412af43f3c admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:07.123765 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb840783-bed5-4a41-b16c-e878faeb57c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa4d004fd44482cae761c4b3bdfab31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:07.124401 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb840783-bed5-4a41-b16c-e878faeb57c5 service cinder] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:07.124687 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb840783-bed5-4a41-b16c-e878faeb57c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:07.124959 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb840783-bed5-4a41-b16c-e878faeb57c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:07.135336 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 795/1601] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:27:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 10:27:07.135336 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec9e693-b7f1-432a-afae-3f412af43f3c admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:07.135638 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb840783-bed5-4a41-b16c-e878faeb57c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:07.135638 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb840783-bed5-4a41-b16c-e878faeb57c5 service cinder] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:07.142939 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec9e693-b7f1-432a-afae-3f412af43f3c admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:07.144362 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 807/1602] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:27:07 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:27:07.145238 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb840783-bed5-4a41-b16c-e878faeb57c5 service cinder] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:07.148199 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea3d0ec-b8a8-4875-abe1-2e79e08a3f72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:07.148809 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea3d0ec-b8a8-4875-abe1-2e79e08a3f72 admin admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:07.149091 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea3d0ec-b8a8-4875-abe1-2e79e08a3f72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:07.149383 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea3d0ec-b8a8-4875-abe1-2e79e08a3f72 admin admin] PATH_INFO: `/v3/roles` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:07.150008 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea3d0ec-b8a8-4875-abe1-2e79e08a3f72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:07.151602 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea3d0ec-b8a8-4875-abe1-2e79e08a3f72 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:07.155581 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb840783-bed5-4a41-b16c-e878faeb57c5 service cinder] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:07.160763 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc47c6ff-0c82-4d3f-8b59-c1133050a04d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:07.161361 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc47c6ff-0c82-4d3f-8b59-c1133050a04d admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:07.161641 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc47c6ff-0c82-4d3f-8b59-c1133050a04d admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:07.161917 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc47c6ff-0c82-4d3f-8b59-c1133050a04d admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:07.162547 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc47c6ff-0c82-4d3f-8b59-c1133050a04d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:07.166396 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 796/1603] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:27:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 10:27:07.166396 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea3d0ec-b8a8-4875-abe1-2e79e08a3f72 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:07.166638 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc47c6ff-0c82-4d3f-8b59-c1133050a04d admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:07.175027 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea3d0ec-b8a8-4875-abe1-2e79e08a3f72 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:07.179603 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 808/1604] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:27:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 10:27:07.179603 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc47c6ff-0c82-4d3f-8b59-c1133050a04d admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:07.183009 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f8698c-f778-4804-827a-16f6fa47a243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:07.183681 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f8698c-f778-4804-827a-16f6fa47a243 admin admin] REQUEST_METHOD: `PUT` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:07.183963 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f8698c-f778-4804-827a-16f6fa47a243 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:07.184275 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f8698c-f778-4804-827a-16f6fa47a243 admin admin] PATH_INFO: `/v3/projects/f2463dad7d57409aad467508aaa0be9f/users/204ec2e4c24b43299099b9b0346683e1/roles/cd5b42ed3b754b58817a62bbe74651b4` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:07.188231 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc47c6ff-0c82-4d3f-8b59-c1133050a04d admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:07.194530 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9c609d-cabf-45ab-ba04-463ae70577d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:07.195204 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9c609d-cabf-45ab-ba04-463ae70577d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:07.197322 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9c609d-cabf-45ab-ba04-463ae70577d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:07.197590 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9c609d-cabf-45ab-ba04-463ae70577d9 admin admin] PATH_INFO: `/v3/projects/adb52f925ee84e5381450dd64b6c8d91/users/28727f7a16614b55b4df3e05b6b42be5/roles/cd5b42ed3b754b58817a62bbe74651b4` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:07.204990 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f8698c-f778-4804-827a-16f6fa47a243 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2463dad7d57409aad467508aaa0be9f, user_id=204ec2e4c24b43299099b9b0346683e1, role_id=cd5b42ed3b754b58817a62bbe74651b4)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:07.207688 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f8698c-f778-4804-827a-16f6fa47a243 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:07.215225 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9c609d-cabf-45ab-ba04-463ae70577d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=adb52f925ee84e5381450dd64b6c8d91, user_id=28727f7a16614b55b4df3e05b6b42be5, role_id=cd5b42ed3b754b58817a62bbe74651b4)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:07.216361 dv-cinder-858275-1-smb devstack@keystone.service[81351]: WARNING py.warnings [None req-da9c609d-cabf-45ab-ba04-463ae70577d9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 19 10:27:07.216361 dv-cinder-858275-1-smb devstack@keystone.service[81351]: warnings.warn(msg) Sep 19 10:27:07.216361 dv-cinder-858275-1-smb devstack@keystone.service[81351]: Sep 19 10:27:07.218384 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9c609d-cabf-45ab-ba04-463ae70577d9 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:07.222620 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 797/1605] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 19 10:27:07 2022] PUT /identity/v3/projects/f2463dad7d57409aad467508aaa0be9f/users/204ec2e4c24b43299099b9b0346683e1/roles/cd5b42ed3b754b58817a62bbe74651b4 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:27:07.223388 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f8698c-f778-4804-827a-16f6fa47a243 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:07.233987 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 809/1606] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 19 10:27:07 2022] PUT /identity/v3/projects/adb52f925ee84e5381450dd64b6c8d91/users/28727f7a16614b55b4df3e05b6b42be5/roles/cd5b42ed3b754b58817a62bbe74651b4 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:27:07.236452 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9c609d-cabf-45ab-ba04-463ae70577d9 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:07.280927 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:27:07.298279 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f8698c-f778-4804-827a-16f6fa47a243 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:07.304306 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9c609d-cabf-45ab-ba04-463ae70577d9 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:07.304607 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2beee5ef-aca7-4cc8-93ac-9620ac45b3b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:07.305135 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beee5ef-aca7-4cc8-93ac-9620ac45b3b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:07.305423 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beee5ef-aca7-4cc8-93ac-9620ac45b3b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:07.305840 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beee5ef-aca7-4cc8-93ac-9620ac45b3b1 admin admin] PATH_INFO: `/v3/projects/3e704b8fb6ca4c57ac5b593e57bbdaef/users/13d5dbf66de64ee5a79e4e95b00c6608/roles/cd5b42ed3b754b58817a62bbe74651b4` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:07.309376 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9191152c-863b-4f37-af90-a35c242fa0db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:07.310244 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9191152c-863b-4f37-af90-a35c242fa0db admin admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:07.310532 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9191152c-863b-4f37-af90-a35c242fa0db admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:07.310810 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9191152c-863b-4f37-af90-a35c242fa0db admin admin] PATH_INFO: `/v3/projects/ccc7a89363f147aaa48d3b5e28b6d821/users/d37107a7553248409c6cd63406c3ddef/roles/cd5b42ed3b754b58817a62bbe74651b4` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:07.323435 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2beee5ef-aca7-4cc8-93ac-9620ac45b3b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e704b8fb6ca4c57ac5b593e57bbdaef, user_id=13d5dbf66de64ee5a79e4e95b00c6608, role_id=cd5b42ed3b754b58817a62bbe74651b4)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:07.325940 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2beee5ef-aca7-4cc8-93ac-9620ac45b3b1 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:07.326251 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9191152c-863b-4f37-af90-a35c242fa0db admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccc7a89363f147aaa48d3b5e28b6d821, user_id=d37107a7553248409c6cd63406c3ddef, role_id=cd5b42ed3b754b58817a62bbe74651b4)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:07.328521 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:27:07.329311 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9191152c-863b-4f37-af90-a35c242fa0db admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:07.343751 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 798/1607] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 19 10:27:07 2022] PUT /identity/v3/projects/3e704b8fb6ca4c57ac5b593e57bbdaef/users/13d5dbf66de64ee5a79e4e95b00c6608/roles/cd5b42ed3b754b58817a62bbe74651b4 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:27:07.344702 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2beee5ef-aca7-4cc8-93ac-9620ac45b3b1 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:07.349841 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 810/1608] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 19 10:27:07 2022] PUT /identity/v3/projects/ccc7a89363f147aaa48d3b5e28b6d821/users/d37107a7553248409c6cd63406c3ddef/roles/cd5b42ed3b754b58817a62bbe74651b4 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:27:07.349841 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9191152c-863b-4f37-af90-a35c242fa0db admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:07.430586 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9191152c-863b-4f37-af90-a35c242fa0db admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:07.433625 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2beee5ef-aca7-4cc8-93ac-9620ac45b3b1 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:07.436394 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676134be-0d07-4d39-a9b8-28c2065b5cda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:07.437070 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676134be-0d07-4d39-a9b8-28c2065b5cda admin admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:07.437357 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676134be-0d07-4d39-a9b8-28c2065b5cda admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:07.437632 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676134be-0d07-4d39-a9b8-28c2065b5cda admin admin] PATH_INFO: `/v3/projects/2e33eb747357460eb0ad450ad46ca7bb/users/e62a6e400ad7425f9217164bc9190a21/roles/cd5b42ed3b754b58817a62bbe74651b4` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:07.439389 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc83c287-ba4e-45aa-ac5a-e5f509d87c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:07.440252 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc83c287-ba4e-45aa-ac5a-e5f509d87c8a admin admin] REQUEST_METHOD: `PUT` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:07.440536 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc83c287-ba4e-45aa-ac5a-e5f509d87c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:07.440857 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc83c287-ba4e-45aa-ac5a-e5f509d87c8a admin admin] PATH_INFO: `/v3/projects/97f6586878654c5391e747184e41935f/users/8c811a86c77f412585603fd45a5c2ee1/roles/cd5b42ed3b754b58817a62bbe74651b4` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:07.453553 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676134be-0d07-4d39-a9b8-28c2065b5cda admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e33eb747357460eb0ad450ad46ca7bb, user_id=e62a6e400ad7425f9217164bc9190a21, role_id=cd5b42ed3b754b58817a62bbe74651b4)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:07.456456 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676134be-0d07-4d39-a9b8-28c2065b5cda admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:07.461162 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc83c287-ba4e-45aa-ac5a-e5f509d87c8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=97f6586878654c5391e747184e41935f, user_id=8c811a86c77f412585603fd45a5c2ee1, role_id=cd5b42ed3b754b58817a62bbe74651b4)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:07.464566 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc83c287-ba4e-45aa-ac5a-e5f509d87c8a admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:07.474472 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 811/1609] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 19 10:27:07 2022] PUT /identity/v3/projects/2e33eb747357460eb0ad450ad46ca7bb/users/e62a6e400ad7425f9217164bc9190a21/roles/cd5b42ed3b754b58817a62bbe74651b4 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:27:07.478625 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676134be-0d07-4d39-a9b8-28c2065b5cda admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:07.481700 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 799/1610] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 19 10:27:07 2022] PUT /identity/v3/projects/97f6586878654c5391e747184e41935f/users/8c811a86c77f412585603fd45a5c2ee1/roles/cd5b42ed3b754b58817a62bbe74651b4 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:27:07.483744 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41da2c2-48b2-4059-910f-4184cfdb28ea None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:07.484231 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41da2c2-48b2-4059-910f-4184cfdb28ea None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:07.484678 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41da2c2-48b2-4059-910f-4184cfdb28ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:07.513924 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-d41da2c2-48b2-4059-910f-4184cfdb28ea None None] MFA Rules not processed for user `204ec2e4c24b43299099b9b0346683e1`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:27:07.515168 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-d41da2c2-48b2-4059-910f-4184cfdb28ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:07.561312 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676134be-0d07-4d39-a9b8-28c2065b5cda admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:07.590125 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 800/1611] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:27:07 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:27:07.590125 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9723790-97c4-448c-bb08-6974f2ffcb04 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:07.590125 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9723790-97c4-448c-bb08-6974f2ffcb04 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:07.590125 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9723790-97c4-448c-bb08-6974f2ffcb04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:07.614371 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-f9723790-97c4-448c-bb08-6974f2ffcb04 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:27:07.615401 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-f9723790-97c4-448c-bb08-6974f2ffcb04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:07.622245 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:27:07.635607 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e844d381-0efd-4876-8bc3-1314a5d8d9cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:07.636401 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e844d381-0efd-4876-8bc3-1314a5d8d9cc admin admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:07.636759 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e844d381-0efd-4876-8bc3-1314a5d8d9cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:07.637098 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e844d381-0efd-4876-8bc3-1314a5d8d9cc admin admin] PATH_INFO: `/v3/projects/2d73df62bc2a44d1976316eaccf2e06c/users/f66555915f3b46f0a687df2a69fc7eee/roles/cd5b42ed3b754b58817a62bbe74651b4` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:07.662182 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e844d381-0efd-4876-8bc3-1314a5d8d9cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d73df62bc2a44d1976316eaccf2e06c, user_id=f66555915f3b46f0a687df2a69fc7eee, role_id=cd5b42ed3b754b58817a62bbe74651b4)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:07.666491 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e844d381-0efd-4876-8bc3-1314a5d8d9cc admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:07.693954 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 812/1612] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 19 10:27:07 2022] PUT /identity/v3/projects/2d73df62bc2a44d1976316eaccf2e06c/users/f66555915f3b46f0a687df2a69fc7eee/roles/cd5b42ed3b754b58817a62bbe74651b4 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:27:07.695546 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9d9328-8c0b-4091-ad70-dd86bd65a23b None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:07.695837 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9d9328-8c0b-4091-ad70-dd86bd65a23b None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:07.696114 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9d9328-8c0b-4091-ad70-dd86bd65a23b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:07.703478 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 801/1613] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:27:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:27:07.705154 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c788bc-f414-4d0c-8f7a-d289f5f90d00 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:07.705609 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c788bc-f414-4d0c-8f7a-d289f5f90d00 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:07.706897 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c788bc-f414-4d0c-8f7a-d289f5f90d00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:07.719017 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-7d9d9328-8c0b-4091-ad70-dd86bd65a23b None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:27:07.720480 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-7d9d9328-8c0b-4091-ad70-dd86bd65a23b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:07.722884 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:27:07.742190 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-e5c788bc-f414-4d0c-8f7a-d289f5f90d00 None None] MFA Rules not processed for user `13d5dbf66de64ee5a79e4e95b00c6608`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:27:07.743591 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-e5c788bc-f414-4d0c-8f7a-d289f5f90d00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:07.817415 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 813/1614] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:27:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:27:07.818760 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa39ea0c-101b-48df-be3b-c51c21cd8b66 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:07.819116 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa39ea0c-101b-48df-be3b-c51c21cd8b66 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:07.819585 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa39ea0c-101b-48df-be3b-c51c21cd8b66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:07.839908 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 802/1615] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:27:07 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:27:07.842178 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab100506-9132-453e-af12-77ff5da972d5 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:07.842327 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-aa39ea0c-101b-48df-be3b-c51c21cd8b66 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:27:07.842832 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab100506-9132-453e-af12-77ff5da972d5 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:07.843279 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab100506-9132-453e-af12-77ff5da972d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:07.843943 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-aa39ea0c-101b-48df-be3b-c51c21cd8b66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:07.852445 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 814/1616] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:27:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:27:07.854299 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa39ea0c-101b-48df-be3b-c51c21cd8b66 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:07.865635 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa39ea0c-101b-48df-be3b-c51c21cd8b66 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:07.872223 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58427009-86ce-4cb1-b935-8f90f88720b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:07.873026 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58427009-86ce-4cb1-b935-8f90f88720b1 admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:07.873517 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58427009-86ce-4cb1-b935-8f90f88720b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:07.873880 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58427009-86ce-4cb1-b935-8f90f88720b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:07.875205 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58427009-86ce-4cb1-b935-8f90f88720b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:07.878564 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58427009-86ce-4cb1-b935-8f90f88720b1 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:07.881530 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-ab100506-9132-453e-af12-77ff5da972d5 None None] MFA Rules not processed for user `8c811a86c77f412585603fd45a5c2ee1`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:27:07.882738 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-ab100506-9132-453e-af12-77ff5da972d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:07.916292 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 815/1617] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 19 10:27:07 2022] POST /identity/v3/projects => generated 377 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:27:07.916292 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607eac53-d65a-473a-bcc3-08716fd047cd None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:07.916292 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607eac53-d65a-473a-bcc3-08716fd047cd None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:07.916292 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607eac53-d65a-473a-bcc3-08716fd047cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:07.934235 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-607eac53-d65a-473a-bcc3-08716fd047cd None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:27:07.935504 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-607eac53-d65a-473a-bcc3-08716fd047cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:07.958148 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 803/1618] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:27:07 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:27:07.959002 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab100506-9132-453e-af12-77ff5da972d5 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:08.004941 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 816/1619] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:27:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:27:08.008345 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607eac53-d65a-473a-bcc3-08716fd047cd None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:08.026249 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab100506-9132-453e-af12-77ff5da972d5 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:08.061307 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:27:08.066396 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607eac53-d65a-473a-bcc3-08716fd047cd None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:08.068253 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:27:08.070630 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575bfe4e-d312-4f94-b7a0-8f2fd54c90fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c1289b015854c6bb6aee8fed6b807db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:08.071273 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575bfe4e-d312-4f94-b7a0-8f2fd54c90fd service neutron] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:08.071831 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575bfe4e-d312-4f94-b7a0-8f2fd54c90fd service neutron] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:08.072396 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575bfe4e-d312-4f94-b7a0-8f2fd54c90fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:08.078125 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da3102f-d7f6-4891-809c-15d58b933d6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c1289b015854c6bb6aee8fed6b807db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:08.078741 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da3102f-d7f6-4891-809c-15d58b933d6b service neutron] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:08.079020 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da3102f-d7f6-4891-809c-15d58b933d6b service neutron] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:08.079294 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da3102f-d7f6-4891-809c-15d58b933d6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:08.083186 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575bfe4e-d312-4f94-b7a0-8f2fd54c90fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:08.084751 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575bfe4e-d312-4f94-b7a0-8f2fd54c90fd service neutron] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:08.088326 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da3102f-d7f6-4891-809c-15d58b933d6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:08.089763 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da3102f-d7f6-4891-809c-15d58b933d6b service neutron] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:08.094509 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 817/1620] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:27:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:27:08.095448 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575bfe4e-d312-4f94-b7a0-8f2fd54c90fd service neutron] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:08.098210 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-575bfe4e-d312-4f94-b7a0-8f2fd54c90fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:08.101257 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 804/1621] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:27:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:27:08.102499 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918e35ac-b9f1-4dd2-9d7a-6d5ba4bfd7c8 None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:08.102789 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918e35ac-b9f1-4dd2-9d7a-6d5ba4bfd7c8 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:08.104097 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918e35ac-b9f1-4dd2-9d7a-6d5ba4bfd7c8 None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:08.105665 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 805/1622] 10.222.0.66 () {54 vars in 965 bytes} [Mon Sep 19 10:27:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:27:08.106370 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918e35ac-b9f1-4dd2-9d7a-6d5ba4bfd7c8 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:08.109054 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575bfe4e-d312-4f94-b7a0-8f2fd54c90fd service neutron] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:08.113725 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4057774c-9d1e-4a01-bad8-33d64b42c648 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c1289b015854c6bb6aee8fed6b807db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:08.114634 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4057774c-9d1e-4a01-bad8-33d64b42c648 service neutron] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:08.114634 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4057774c-9d1e-4a01-bad8-33d64b42c648 service neutron] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:08.114865 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4057774c-9d1e-4a01-bad8-33d64b42c648 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:08.123400 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918e35ac-b9f1-4dd2-9d7a-6d5ba4bfd7c8 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:08.124891 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4057774c-9d1e-4a01-bad8-33d64b42c648 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:08.126334 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4057774c-9d1e-4a01-bad8-33d64b42c648 service neutron] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:08.128291 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de554b9f-e62f-4f4f-be77-9640922c7268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:08.128967 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de554b9f-e62f-4f4f-be77-9640922c7268 admin admin] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:08.129314 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de554b9f-e62f-4f4f-be77-9640922c7268 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:08.129653 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de554b9f-e62f-4f4f-be77-9640922c7268 admin admin] PATH_INFO: `/v3/users` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:08.130352 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de554b9f-e62f-4f4f-be77-9640922c7268 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:08.132364 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de554b9f-e62f-4f4f-be77-9640922c7268 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:08.137787 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 818/1623] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:27:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:27:08.139850 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9d03c9-6ae6-4658-a2f2-63153f081908 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:08.140516 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9d03c9-6ae6-4658-a2f2-63153f081908 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:08.141006 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9d03c9-6ae6-4658-a2f2-63153f081908 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:08.142980 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 819/1624] 10.222.0.66 () {54 vars in 965 bytes} [Mon Sep 19 10:27:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:27:08.148974 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9d03c9-6ae6-4658-a2f2-63153f081908 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:08.163512 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9d03c9-6ae6-4658-a2f2-63153f081908 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:08.168520 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbd4777-ce35-40cf-aa0e-696b1f5e7004 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c1289b015854c6bb6aee8fed6b807db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:08.169212 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbd4777-ce35-40cf-aa0e-696b1f5e7004 service neutron] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:08.169616 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbd4777-ce35-40cf-aa0e-696b1f5e7004 service neutron] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:08.170337 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbd4777-ce35-40cf-aa0e-696b1f5e7004 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:08.170884 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 806/1625] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 19 10:27:08 2022] POST /identity/v3/users => generated 295 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:27:08.172603 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83425a29-7bce-45a1-aca0-720cb2cca506 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:08.172929 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83425a29-7bce-45a1-aca0-720cb2cca506 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:08.173346 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83425a29-7bce-45a1-aca0-720cb2cca506 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:08.184702 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbd4777-ce35-40cf-aa0e-696b1f5e7004 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:08.189664 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbd4777-ce35-40cf-aa0e-696b1f5e7004 service neutron] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:08.205162 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 820/1626] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:27:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:27:08.207679 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e986aec-b9e2-41cb-8074-88b2f65ca979 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:08.207813 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e986aec-b9e2-41cb-8074-88b2f65ca979 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:08.208303 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e986aec-b9e2-41cb-8074-88b2f65ca979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:08.229761 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-83425a29-7bce-45a1-aca0-720cb2cca506 None None] MFA Rules not processed for user `15c70bfb085a44e9b84942b480ff22f1`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:27:08.232481 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-83425a29-7bce-45a1-aca0-720cb2cca506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:08.239352 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-2e986aec-b9e2-41cb-8074-88b2f65ca979 None None] MFA Rules not processed for user `15c70bfb085a44e9b84942b480ff22f1`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:27:08.241356 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-2e986aec-b9e2-41cb-8074-88b2f65ca979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:08.352143 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 807/1627] 10.222.0.66 () {58 vars in 1062 bytes} [Mon Sep 19 10:27:08 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:27:08.353544 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83425a29-7bce-45a1-aca0-720cb2cca506 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:08.367158 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 821/1628] 10.222.0.66 () {58 vars in 1062 bytes} [Mon Sep 19 10:27:08 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:27:08.372901 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83425a29-7bce-45a1-aca0-720cb2cca506 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:08.377036 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e986aec-b9e2-41cb-8074-88b2f65ca979 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:08.380366 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd44ecdd-b8bb-4244-b382-fff3c5fc6241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:08.381339 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd44ecdd-b8bb-4244-b382-fff3c5fc6241 admin admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:08.381566 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd44ecdd-b8bb-4244-b382-fff3c5fc6241 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:08.381850 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd44ecdd-b8bb-4244-b382-fff3c5fc6241 admin admin] PATH_INFO: `/v3/roles` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:08.382603 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd44ecdd-b8bb-4244-b382-fff3c5fc6241 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:08.386189 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd44ecdd-b8bb-4244-b382-fff3c5fc6241 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:08.391914 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e986aec-b9e2-41cb-8074-88b2f65ca979 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:08.402748 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 808/1629] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:27:08 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 10:27:08.403856 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd44ecdd-b8bb-4244-b382-fff3c5fc6241 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:08.406277 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f7ab8b-5b28-4478-a19f-4fa58897f90b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15c70bfb085a44e9b84942b480ff22f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:08.407282 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f7ab8b-5b28-4478-a19f-4fa58897f90b service nova] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:08.407721 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f7ab8b-5b28-4478-a19f-4fa58897f90b service nova] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:08.407957 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f7ab8b-5b28-4478-a19f-4fa58897f90b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:08.425579 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd44ecdd-b8bb-4244-b382-fff3c5fc6241 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:08.434787 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad3eff0-886f-48a3-925d-27beead7a2bb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15c70bfb085a44e9b84942b480ff22f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:08.435907 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad3eff0-886f-48a3-925d-27beead7a2bb service nova] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:08.436221 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad3eff0-886f-48a3-925d-27beead7a2bb service nova] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:08.436564 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad3eff0-886f-48a3-925d-27beead7a2bb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:08.534635 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f7ab8b-5b28-4478-a19f-4fa58897f90b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:08.537648 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f7ab8b-5b28-4478-a19f-4fa58897f90b service nova] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:08.551598 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad3eff0-886f-48a3-925d-27beead7a2bb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:08.551976 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 822/1630] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:27:08 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:27:08.553018 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f7ab8b-5b28-4478-a19f-4fa58897f90b service nova] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:08.553959 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad3eff0-886f-48a3-925d-27beead7a2bb service nova] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:08.566209 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f7ab8b-5b28-4478-a19f-4fa58897f90b service nova] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:08.571797 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991f98d0-7461-4132-8cf3-2d61d49b0156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:08.572576 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991f98d0-7461-4132-8cf3-2d61d49b0156 admin admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:08.573158 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991f98d0-7461-4132-8cf3-2d61d49b0156 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:08.573469 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991f98d0-7461-4132-8cf3-2d61d49b0156 admin admin] PATH_INFO: `/v3/projects/5cef41e3769a449cb29aa4460e87865e/users/b408912b9d4c4641b7bd80766661f6f5/roles/5c8b89fae4fa45bd944cbeaf442136e1` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:08.579257 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 809/1631] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:27:08 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:27:08.598825 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991f98d0-7461-4132-8cf3-2d61d49b0156 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5cef41e3769a449cb29aa4460e87865e, user_id=b408912b9d4c4641b7bd80766661f6f5, role_id=5c8b89fae4fa45bd944cbeaf442136e1)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:08.601757 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991f98d0-7461-4132-8cf3-2d61d49b0156 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:08.619924 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 823/1632] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 19 10:27:08 2022] PUT /identity/v3/projects/5cef41e3769a449cb29aa4460e87865e/users/b408912b9d4c4641b7bd80766661f6f5/roles/5c8b89fae4fa45bd944cbeaf442136e1 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:27:08.624521 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad3eff0-886f-48a3-925d-27beead7a2bb service nova] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:08.652129 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad3eff0-886f-48a3-925d-27beead7a2bb service nova] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:08.690876 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:27:08.739355 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0877bb-3617-490b-9c52-e22bdad1f0ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:08.740761 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0877bb-3617-490b-9c52-e22bdad1f0ba admin admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:08.741181 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0877bb-3617-490b-9c52-e22bdad1f0ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:08.741554 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0877bb-3617-490b-9c52-e22bdad1f0ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:08.742353 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0877bb-3617-490b-9c52-e22bdad1f0ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:08.744219 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0877bb-3617-490b-9c52-e22bdad1f0ba admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:08.759169 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 810/1633] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:27:08 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 10:27:08.763031 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991f98d0-7461-4132-8cf3-2d61d49b0156 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:08.777581 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991f98d0-7461-4132-8cf3-2d61d49b0156 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:08.789793 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe235f6d-a9e2-4b65-9ef0-99484817277d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:08.792676 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe235f6d-a9e2-4b65-9ef0-99484817277d admin admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:08.792964 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe235f6d-a9e2-4b65-9ef0-99484817277d admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:08.793247 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe235f6d-a9e2-4b65-9ef0-99484817277d admin admin] PATH_INFO: `/v3/projects/5cef41e3769a449cb29aa4460e87865e/users/b408912b9d4c4641b7bd80766661f6f5/roles/5c8b89fae4fa45bd944cbeaf442136e1` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:08.797916 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe235f6d-a9e2-4b65-9ef0-99484817277d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5cef41e3769a449cb29aa4460e87865e, user_id=b408912b9d4c4641b7bd80766661f6f5, role_id=5c8b89fae4fa45bd944cbeaf442136e1)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:08.804182 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe235f6d-a9e2-4b65-9ef0-99484817277d admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:08.832412 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 824/1634] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 19 10:27:08 2022] PUT /identity/v3/projects/5cef41e3769a449cb29aa4460e87865e/users/b408912b9d4c4641b7bd80766661f6f5/roles/5c8b89fae4fa45bd944cbeaf442136e1 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:27:08.842366 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4eeeab-fb3a-49a9-afad-e95737f43efc None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:08.842679 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4eeeab-fb3a-49a9-afad-e95737f43efc None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:08.843123 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4eeeab-fb3a-49a9-afad-e95737f43efc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:08.859395 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087ba232-3041-485d-b5dd-921473b70062 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:08.860483 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087ba232-3041-485d-b5dd-921473b70062 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:08.861057 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087ba232-3041-485d-b5dd-921473b70062 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:08.862468 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 825/1635] 10.222.0.66 () {54 vars in 912 bytes} [Mon Sep 19 10:27:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:27:08.868613 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339539c1-6975-4334-b5ce-48f2ea471d04 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:08.869096 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339539c1-6975-4334-b5ce-48f2ea471d04 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:08.869532 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339539c1-6975-4334-b5ce-48f2ea471d04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:08.938457 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-339539c1-6975-4334-b5ce-48f2ea471d04 None None] MFA Rules not processed for user `15c70bfb085a44e9b84942b480ff22f1`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:27:08.940120 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-339539c1-6975-4334-b5ce-48f2ea471d04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:08.947393 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-8a4eeeab-fb3a-49a9-afad-e95737f43efc None None] MFA Rules not processed for user `b408912b9d4c4641b7bd80766661f6f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:27:08.953677 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-8a4eeeab-fb3a-49a9-afad-e95737f43efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:08.969698 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:27:09.103118 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 826/1636] 10.222.0.66 () {58 vars in 1009 bytes} [Mon Sep 19 10:27:08 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:27:09.103729 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 811/1637] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:27:08 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:27:09.105310 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23896a7-3c97-4657-90b5-0d6f7ba07cc5 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:09.105603 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23896a7-3c97-4657-90b5-0d6f7ba07cc5 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:09.105880 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23896a7-3c97-4657-90b5-0d6f7ba07cc5 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:09.107853 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 827/1638] 10.222.0.66 () {54 vars in 912 bytes} [Mon Sep 19 10:27:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:27:09.125197 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3e53e7-37bf-47ad-91d3-7d9ebf360a05 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:09.127087 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3e53e7-37bf-47ad-91d3-7d9ebf360a05 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:09.127560 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3e53e7-37bf-47ad-91d3-7d9ebf360a05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:09.135215 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23896a7-3c97-4657-90b5-0d6f7ba07cc5 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:09.182693 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-ae3e53e7-37bf-47ad-91d3-7d9ebf360a05 None None] MFA Rules not processed for user `15c70bfb085a44e9b84942b480ff22f1`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:27:09.184325 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-ae3e53e7-37bf-47ad-91d3-7d9ebf360a05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:09.209641 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 812/1639] 10.222.0.66 () {58 vars in 1009 bytes} [Mon Sep 19 10:27:09 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:27:09.210606 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3e53e7-37bf-47ad-91d3-7d9ebf360a05 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:09.284700 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23896a7-3c97-4657-90b5-0d6f7ba07cc5 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:09.289919 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8089f74d-2d5a-427e-844c-f2b908d52474 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa4d004fd44482cae761c4b3bdfab31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:09.290879 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8089f74d-2d5a-427e-844c-f2b908d52474 service cinder] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:09.291370 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8089f74d-2d5a-427e-844c-f2b908d52474 service cinder] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:09.291874 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8089f74d-2d5a-427e-844c-f2b908d52474 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:09.332041 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3e53e7-37bf-47ad-91d3-7d9ebf360a05 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:09.341802 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f739cb-98d7-4351-a883-a3213cbd76f9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa4d004fd44482cae761c4b3bdfab31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:09.342609 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f739cb-98d7-4351-a883-a3213cbd76f9 service cinder] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:09.343063 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f739cb-98d7-4351-a883-a3213cbd76f9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:09.343484 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f739cb-98d7-4351-a883-a3213cbd76f9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:09.365055 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f739cb-98d7-4351-a883-a3213cbd76f9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:09.366817 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f739cb-98d7-4351-a883-a3213cbd76f9 service cinder] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:09.396884 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 813/1640] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:27:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:27:09.435014 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8089f74d-2d5a-427e-844c-f2b908d52474 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:09.438373 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8089f74d-2d5a-427e-844c-f2b908d52474 service cinder] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:09.473787 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 828/1641] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:27:09 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:27:09.869572 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f739cb-98d7-4351-a883-a3213cbd76f9 service cinder] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:09.881016 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f739cb-98d7-4351-a883-a3213cbd76f9 service cinder] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:09.889773 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc3bbb1-96a5-457c-908c-adbf4bc2ac37 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa4d004fd44482cae761c4b3bdfab31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:09.890689 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc3bbb1-96a5-457c-908c-adbf4bc2ac37 service cinder] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:09.892200 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc3bbb1-96a5-457c-908c-adbf4bc2ac37 service cinder] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:09.892645 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc3bbb1-96a5-457c-908c-adbf4bc2ac37 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:09.915404 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc3bbb1-96a5-457c-908c-adbf4bc2ac37 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:09.917682 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc3bbb1-96a5-457c-908c-adbf4bc2ac37 service cinder] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:09.947415 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 814/1642] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:27:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 10:27:13.078766 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8089f74d-2d5a-427e-844c-f2b908d52474 service cinder] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:13.102560 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8089f74d-2d5a-427e-844c-f2b908d52474 service cinder] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:13.118681 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bc4416-dc9e-4ad7-a111-3b78ded0479c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa4d004fd44482cae761c4b3bdfab31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:13.119919 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bc4416-dc9e-4ad7-a111-3b78ded0479c service cinder] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:13.119919 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bc4416-dc9e-4ad7-a111-3b78ded0479c service cinder] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:13.119919 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bc4416-dc9e-4ad7-a111-3b78ded0479c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:13.155961 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bc4416-dc9e-4ad7-a111-3b78ded0479c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:13.163256 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bc4416-dc9e-4ad7-a111-3b78ded0479c service cinder] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:13.199649 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 829/1643] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:27:13 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:27:13.347496 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc3bbb1-96a5-457c-908c-adbf4bc2ac37 service cinder] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:13.460922 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:27:13.528433 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc3bbb1-96a5-457c-908c-adbf4bc2ac37 service cinder] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:13.541440 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3869463f-d0e5-4ecf-ae53-059c1a4b052d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:13.542826 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3869463f-d0e5-4ecf-ae53-059c1a4b052d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:13.543413 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3869463f-d0e5-4ecf-ae53-059c1a4b052d admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:13.543883 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3869463f-d0e5-4ecf-ae53-059c1a4b052d admin admin] PATH_INFO: `/v3/users/13d5dbf66de64ee5a79e4e95b00c6608` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:13.549704 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3869463f-d0e5-4ecf-ae53-059c1a4b052d admin admin] RBAC: Authorizing `identity:delete_user(user_id=13d5dbf66de64ee5a79e4e95b00c6608)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:13.555066 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3869463f-d0e5-4ecf-ae53-059c1a4b052d admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:13.695477 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-3869463f-d0e5-4ecf-ae53-059c1a4b052d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13d5dbf66de64ee5a79e4e95b00c6608'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:13.713917 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-3869463f-d0e5-4ecf-ae53-059c1a4b052d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13d5dbf66de64ee5a79e4e95b00c6608'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:13.716944 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-3869463f-d0e5-4ecf-ae53-059c1a4b052d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13d5dbf66de64ee5a79e4e95b00c6608'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:13.717730 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-3869463f-d0e5-4ecf-ae53-059c1a4b052d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13d5dbf66de64ee5a79e4e95b00c6608'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:13.741331 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-3869463f-d0e5-4ecf-ae53-059c1a4b052d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13d5dbf66de64ee5a79e4e95b00c6608'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:13.813189 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 815/1644] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 19 10:27:13 2022] DELETE /identity/v3/users/13d5dbf66de64ee5a79e4e95b00c6608 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:27:13.815705 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b132df-cced-4e95-86aa-e75ab623fc49 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:13.816288 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b132df-cced-4e95-86aa-e75ab623fc49 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:13.816618 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b132df-cced-4e95-86aa-e75ab623fc49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:13.898608 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-08b132df-cced-4e95-86aa-e75ab623fc49 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:27:13.899787 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-08b132df-cced-4e95-86aa-e75ab623fc49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:14.030926 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:27:14.066295 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 830/1645] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:27:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 10:27:14.091713 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3869463f-d0e5-4ecf-ae53-059c1a4b052d admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:14.093389 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-3869463f-d0e5-4ecf-ae53-059c1a4b052d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:14.249220 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3869463f-d0e5-4ecf-ae53-059c1a4b052d admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:14.254498 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9246810a-64fe-4d22-82b9-796fbb49193b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c1289b015854c6bb6aee8fed6b807db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:14.255277 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9246810a-64fe-4d22-82b9-796fbb49193b service neutron] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:14.255560 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9246810a-64fe-4d22-82b9-796fbb49193b service neutron] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:14.255837 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9246810a-64fe-4d22-82b9-796fbb49193b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:14.290277 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9246810a-64fe-4d22-82b9-796fbb49193b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:14.291774 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9246810a-64fe-4d22-82b9-796fbb49193b service neutron] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:14.355813 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 816/1646] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:27:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:27:15.904117 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b132df-cced-4e95-86aa-e75ab623fc49 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:15.906256 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-08b132df-cced-4e95-86aa-e75ab623fc49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:15.926343 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b132df-cced-4e95-86aa-e75ab623fc49 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:15.939543 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26cc54a-0d0d-4533-8741-4487f564c866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:15.941041 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26cc54a-0d0d-4533-8741-4487f564c866 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:15.941429 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26cc54a-0d0d-4533-8741-4487f564c866 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:15.942067 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26cc54a-0d0d-4533-8741-4487f564c866 admin admin] PATH_INFO: `/v3/users/8c811a86c77f412585603fd45a5c2ee1` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:15.943596 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26cc54a-0d0d-4533-8741-4487f564c866 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c811a86c77f412585603fd45a5c2ee1)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:15.945126 dv-cinder-858275-1-smb devstack@keystone.service[81351]: WARNING py.warnings [None req-c26cc54a-0d0d-4533-8741-4487f564c866 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 19 10:27:15.945126 dv-cinder-858275-1-smb devstack@keystone.service[81351]: warnings.warn(msg) Sep 19 10:27:15.945126 dv-cinder-858275-1-smb devstack@keystone.service[81351]: Sep 19 10:27:15.946980 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26cc54a-0d0d-4533-8741-4487f564c866 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:16.070177 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-c26cc54a-0d0d-4533-8741-4487f564c866 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c811a86c77f412585603fd45a5c2ee1'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:16.087746 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-c26cc54a-0d0d-4533-8741-4487f564c866 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c811a86c77f412585603fd45a5c2ee1'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:16.088528 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-c26cc54a-0d0d-4533-8741-4487f564c866 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c811a86c77f412585603fd45a5c2ee1'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:16.089588 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-c26cc54a-0d0d-4533-8741-4487f564c866 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c811a86c77f412585603fd45a5c2ee1'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:16.122315 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-c26cc54a-0d0d-4533-8741-4487f564c866 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c811a86c77f412585603fd45a5c2ee1'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:16.190693 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 831/1647] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 19 10:27:15 2022] DELETE /identity/v3/users/8c811a86c77f412585603fd45a5c2ee1 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:27:16.191588 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9fb45f-cbfe-4a64-a4d9-34bb355f1fa5 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:16.192079 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9fb45f-cbfe-4a64-a4d9-34bb355f1fa5 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:16.192398 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9fb45f-cbfe-4a64-a4d9-34bb355f1fa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:16.233335 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-1c9fb45f-cbfe-4a64-a4d9-34bb355f1fa5 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:27:16.234828 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-1c9fb45f-cbfe-4a64-a4d9-34bb355f1fa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:16.402653 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:27:16.422154 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 817/1648] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:27:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 10:27:16.429754 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26cc54a-0d0d-4533-8741-4487f564c866 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:16.431881 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-c26cc54a-0d0d-4533-8741-4487f564c866 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:16.481006 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26cc54a-0d0d-4533-8741-4487f564c866 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:16.496875 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9fb45f-cbfe-4a64-a4d9-34bb355f1fa5 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:16.498336 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-1c9fb45f-cbfe-4a64-a4d9-34bb355f1fa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:16.507289 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316e408f-c144-4ab2-8750-589504d71cda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:16.508277 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316e408f-c144-4ab2-8750-589504d71cda admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:16.508570 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316e408f-c144-4ab2-8750-589504d71cda admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:16.508851 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316e408f-c144-4ab2-8750-589504d71cda admin admin] PATH_INFO: `/v3/projects/3e704b8fb6ca4c57ac5b593e57bbdaef` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:16.517186 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316e408f-c144-4ab2-8750-589504d71cda admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e704b8fb6ca4c57ac5b593e57bbdaef)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:16.519818 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316e408f-c144-4ab2-8750-589504d71cda admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:16.702648 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-316e408f-c144-4ab2-8750-589504d71cda admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e704b8fb6ca4c57ac5b593e57bbdaef', 'request_id': 'req-316e408f-c144-4ab2-8750-589504d71cda'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:16.742801 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-316e408f-c144-4ab2-8750-589504d71cda admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e704b8fb6ca4c57ac5b593e57bbdaef', 'request_id': 'req-316e408f-c144-4ab2-8750-589504d71cda'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:16.776726 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-316e408f-c144-4ab2-8750-589504d71cda admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e704b8fb6ca4c57ac5b593e57bbdaef', 'request_id': 'req-316e408f-c144-4ab2-8750-589504d71cda'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:16.783824 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9fb45f-cbfe-4a64-a4d9-34bb355f1fa5 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:16.817961 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-316e408f-c144-4ab2-8750-589504d71cda admin admin] The token cache is being invalidate because project 3e704b8fb6ca4c57ac5b593e57bbdaef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 10:27:16.823437 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-316e408f-c144-4ab2-8750-589504d71cda admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:16.832251 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-316e408f-c144-4ab2-8750-589504d71cda admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:16.848346 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 832/1649] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 19 10:27:16 2022] DELETE /identity/v3/projects/3e704b8fb6ca4c57ac5b593e57bbdaef => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:27:16.852695 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a87506-a265-4d9a-b9eb-d41d92e5c088 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:16.852907 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a87506-a265-4d9a-b9eb-d41d92e5c088 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:16.856381 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a87506-a265-4d9a-b9eb-d41d92e5c088 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:16.939075 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-88a87506-a265-4d9a-b9eb-d41d92e5c088 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:27:16.943259 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-88a87506-a265-4d9a-b9eb-d41d92e5c088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:17.018985 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f12fe66-120e-481b-b115-40ac31294573 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c1289b015854c6bb6aee8fed6b807db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:17.025249 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f12fe66-120e-481b-b115-40ac31294573 service neutron] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:17.025539 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f12fe66-120e-481b-b115-40ac31294573 service neutron] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:17.025856 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f12fe66-120e-481b-b115-40ac31294573 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:17.035705 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-6f12fe66-120e-481b-b115-40ac31294573 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:17.135899 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:27:17.199351 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 833/1650] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:27:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 348 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:27:17.208065 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25709f08-7ac1-4202-8573-c6285c57a44b None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:17.208065 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25709f08-7ac1-4202-8573-c6285c57a44b None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:17.208509 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25709f08-7ac1-4202-8573-c6285c57a44b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:17.246935 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-25709f08-7ac1-4202-8573-c6285c57a44b None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:27:17.248841 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-25709f08-7ac1-4202-8573-c6285c57a44b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:17.282079 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 834/1651] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:27:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:27:17.290615 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25709f08-7ac1-4202-8573-c6285c57a44b None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:17.316956 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f12fe66-120e-481b-b115-40ac31294573 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:17.318523 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f12fe66-120e-481b-b115-40ac31294573 service neutron] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:17.326545 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25709f08-7ac1-4202-8573-c6285c57a44b None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:17.335416 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952a34aa-b311-4644-80ba-037f2fc4bf9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:17.336053 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952a34aa-b311-4644-80ba-037f2fc4bf9e admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:17.336368 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952a34aa-b311-4644-80ba-037f2fc4bf9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:17.336644 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952a34aa-b311-4644-80ba-037f2fc4bf9e admin admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:17.337303 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952a34aa-b311-4644-80ba-037f2fc4bf9e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:27:17.337608 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952a34aa-b311-4644-80ba-037f2fc4bf9e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:17.342018 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952a34aa-b311-4644-80ba-037f2fc4bf9e admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:17.344023 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 818/1652] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:27:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 848 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 10:27:17.366493 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 835/1653] 10.222.0.66 () {58 vars in 1153 bytes} [Mon Sep 19 10:27:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 10:27:17.367321 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f12fe66-120e-481b-b115-40ac31294573 service neutron] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:17.389902 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f12fe66-120e-481b-b115-40ac31294573 service neutron] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:17.406488 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cf55ed-ca94-4ffc-90f7-60018c37e741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:17.407044 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cf55ed-ca94-4ffc-90f7-60018c37e741 admin admin] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:17.407314 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cf55ed-ca94-4ffc-90f7-60018c37e741 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:17.407808 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cf55ed-ca94-4ffc-90f7-60018c37e741 admin admin] PATH_INFO: `/v3/projects` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:17.408782 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cf55ed-ca94-4ffc-90f7-60018c37e741 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:17.410907 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cf55ed-ca94-4ffc-90f7-60018c37e741 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:17.472386 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 819/1654] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 19 10:27:17 2022] POST /identity/v3/projects => generated 403 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:27:17.476597 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952a34aa-b311-4644-80ba-037f2fc4bf9e admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:17.508408 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952a34aa-b311-4644-80ba-037f2fc4bf9e admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:17.709026 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d84c16-c453-440c-a500-c52181d1bdbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:17.709272 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d84c16-c453-440c-a500-c52181d1bdbd admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:17.709556 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d84c16-c453-440c-a500-c52181d1bdbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:17.709838 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d84c16-c453-440c-a500-c52181d1bdbd admin admin] PATH_INFO: `/v3/users` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:17.710488 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d84c16-c453-440c-a500-c52181d1bdbd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:17.712490 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d84c16-c453-440c-a500-c52181d1bdbd admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:17.759992 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 836/1655] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 19 10:27:17 2022] POST /identity/v3/users => generated 302 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:27:17.764917 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cf55ed-ca94-4ffc-90f7-60018c37e741 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:17.783943 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cf55ed-ca94-4ffc-90f7-60018c37e741 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:17.815747 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea325323-2e55-4f54-8e4c-a0004402bed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:17.816723 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea325323-2e55-4f54-8e4c-a0004402bed8 admin admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:17.817567 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea325323-2e55-4f54-8e4c-a0004402bed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:17.817567 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea325323-2e55-4f54-8e4c-a0004402bed8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:17.818752 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea325323-2e55-4f54-8e4c-a0004402bed8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:17.823889 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea325323-2e55-4f54-8e4c-a0004402bed8 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:17.849597 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 820/1656] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:27:17 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 10:27:17.851279 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d84c16-c453-440c-a500-c52181d1bdbd admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:17.868331 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d84c16-c453-440c-a500-c52181d1bdbd admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:17.877776 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a5c022-cc03-47ed-ac6e-1cf2833835e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:17.879254 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a5c022-cc03-47ed-ac6e-1cf2833835e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:17.879660 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a5c022-cc03-47ed-ac6e-1cf2833835e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:17.879814 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a5c022-cc03-47ed-ac6e-1cf2833835e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:17.880530 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a5c022-cc03-47ed-ac6e-1cf2833835e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:17.885411 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a5c022-cc03-47ed-ac6e-1cf2833835e5 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:17.914355 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea325323-2e55-4f54-8e4c-a0004402bed8 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:17.923564 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 837/1657] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:27:17 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 10:27:17.928728 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea325323-2e55-4f54-8e4c-a0004402bed8 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:17.934268 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ec927a-9d0b-4cd3-a242-ebbc0b13d2ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:17.935506 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ec927a-9d0b-4cd3-a242-ebbc0b13d2ff admin admin] REQUEST_METHOD: `PUT` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:17.935798 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ec927a-9d0b-4cd3-a242-ebbc0b13d2ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:17.936075 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ec927a-9d0b-4cd3-a242-ebbc0b13d2ff admin admin] PATH_INFO: `/v3/projects/41311537016b43d78c4274a6f6ad7fcb/users/baf3396017c54929bccf5c3ae4cbdc74/roles/cd5b42ed3b754b58817a62bbe74651b4` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:17.974041 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ec927a-9d0b-4cd3-a242-ebbc0b13d2ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=41311537016b43d78c4274a6f6ad7fcb, user_id=baf3396017c54929bccf5c3ae4cbdc74, role_id=cd5b42ed3b754b58817a62bbe74651b4)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:17.977441 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ec927a-9d0b-4cd3-a242-ebbc0b13d2ff admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:18.010396 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 821/1658] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 19 10:27:17 2022] PUT /identity/v3/projects/41311537016b43d78c4274a6f6ad7fcb/users/baf3396017c54929bccf5c3ae4cbdc74/roles/cd5b42ed3b754b58817a62bbe74651b4 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:27:18.023442 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f5e08e-ba5c-47c1-8dfb-9f8724d6a9e2 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:18.024333 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f5e08e-ba5c-47c1-8dfb-9f8724d6a9e2 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:18.024782 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f5e08e-ba5c-47c1-8dfb-9f8724d6a9e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:18.117166 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-d3f5e08e-ba5c-47c1-8dfb-9f8724d6a9e2 None None] MFA Rules not processed for user `baf3396017c54929bccf5c3ae4cbdc74`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:27:18.120606 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-d3f5e08e-ba5c-47c1-8dfb-9f8724d6a9e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:18.208982 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f328fa3-fab2-4222-be13-04898a691dc7 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:18.209379 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f328fa3-fab2-4222-be13-04898a691dc7 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:18.209719 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f328fa3-fab2-4222-be13-04898a691dc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:18.258920 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:27:18.278117 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-8f328fa3-fab2-4222-be13-04898a691dc7 None None] MFA Rules not processed for user `f66555915f3b46f0a687df2a69fc7eee`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:27:18.279412 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-8f328fa3-fab2-4222-be13-04898a691dc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:18.379150 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 838/1659] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:27:18 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 356 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:27:18.380129 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f5e08e-ba5c-47c1-8dfb-9f8724d6a9e2 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:18.498830 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 822/1660] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:27:18 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:27:18.510619 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f328fa3-fab2-4222-be13-04898a691dc7 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:18.513446 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-8f328fa3-fab2-4222-be13-04898a691dc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:18.520827 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:27:18.586823 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f5e08e-ba5c-47c1-8dfb-9f8724d6a9e2 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:18.615175 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc23dfb-bf00-4efd-b818-ea511626ec96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:18.615807 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc23dfb-bf00-4efd-b818-ea511626ec96 admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:18.616089 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc23dfb-bf00-4efd-b818-ea511626ec96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:18.616388 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc23dfb-bf00-4efd-b818-ea511626ec96 admin admin] PATH_INFO: `/v3/projects` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:18.617037 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc23dfb-bf00-4efd-b818-ea511626ec96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:18.618995 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc23dfb-bf00-4efd-b818-ea511626ec96 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:18.700007 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 839/1661] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 19 10:27:18 2022] POST /identity/v3/projects => generated 403 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:27:18.704337 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc23dfb-bf00-4efd-b818-ea511626ec96 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:18.718249 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f328fa3-fab2-4222-be13-04898a691dc7 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:18.875431 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49035e90-ea5e-4d4a-b3a2-1e6933dc2b65 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15c70bfb085a44e9b84942b480ff22f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:18.876135 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49035e90-ea5e-4d4a-b3a2-1e6933dc2b65 service nova] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:18.876460 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49035e90-ea5e-4d4a-b3a2-1e6933dc2b65 service nova] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:18.876739 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49035e90-ea5e-4d4a-b3a2-1e6933dc2b65 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:18.892134 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc23dfb-bf00-4efd-b818-ea511626ec96 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:18.914763 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c161de-fc72-4d67-8b4e-72b48738a026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:18.915766 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c161de-fc72-4d67-8b4e-72b48738a026 admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:18.916277 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c161de-fc72-4d67-8b4e-72b48738a026 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:18.916767 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c161de-fc72-4d67-8b4e-72b48738a026 admin admin] PATH_INFO: `/v3/users` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:18.917988 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c161de-fc72-4d67-8b4e-72b48738a026 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:18.927692 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c161de-fc72-4d67-8b4e-72b48738a026 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:18.943279 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:27:18.996680 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 840/1662] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 19 10:27:18 2022] POST /identity/v3/users => generated 308 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 10:27:18.999838 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c161de-fc72-4d67-8b4e-72b48738a026 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:19.034771 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c161de-fc72-4d67-8b4e-72b48738a026 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:19.040600 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49035e90-ea5e-4d4a-b3a2-1e6933dc2b65 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:19.045512 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49035e90-ea5e-4d4a-b3a2-1e6933dc2b65 service nova] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:19.054486 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1ebf11-8b8f-452f-9369-4c0391f26662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:19.055428 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1ebf11-8b8f-452f-9369-4c0391f26662 admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:19.055911 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1ebf11-8b8f-452f-9369-4c0391f26662 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:19.056416 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1ebf11-8b8f-452f-9369-4c0391f26662 admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:19.064768 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1ebf11-8b8f-452f-9369-4c0391f26662 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:19.067325 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1ebf11-8b8f-452f-9369-4c0391f26662 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:19.083412 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 823/1663] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:27:18 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 573 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:27:19.098710 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 841/1664] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:27:18 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 10:27:19.100199 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49035e90-ea5e-4d4a-b3a2-1e6933dc2b65 service nova] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:19.115868 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49035e90-ea5e-4d4a-b3a2-1e6933dc2b65 service nova] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:19.126938 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8528ef-d532-4836-b524-d6b908009d70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:19.127495 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8528ef-d532-4836-b524-d6b908009d70 admin admin] REQUEST_METHOD: `PUT` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:19.127876 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8528ef-d532-4836-b524-d6b908009d70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:19.128287 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8528ef-d532-4836-b524-d6b908009d70 admin admin] PATH_INFO: `/v3/projects/9fd040e97804403986906eb29d00d013/users/4b35355ea95a4cb1b507303f0d9b210a/roles/5c8b89fae4fa45bd944cbeaf442136e1` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:19.164760 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8528ef-d532-4836-b524-d6b908009d70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9fd040e97804403986906eb29d00d013, user_id=4b35355ea95a4cb1b507303f0d9b210a, role_id=5c8b89fae4fa45bd944cbeaf442136e1)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:19.168521 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8528ef-d532-4836-b524-d6b908009d70 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:19.201183 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 824/1665] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 19 10:27:19 2022] PUT /identity/v3/projects/9fd040e97804403986906eb29d00d013/users/4b35355ea95a4cb1b507303f0d9b210a/roles/5c8b89fae4fa45bd944cbeaf442136e1 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:27:19.206625 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1ebf11-8b8f-452f-9369-4c0391f26662 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:19.221712 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1ebf11-8b8f-452f-9369-4c0391f26662 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:19.307378 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8528ef-d532-4836-b524-d6b908009d70 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:19.309459 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-2a8528ef-d532-4836-b524-d6b908009d70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:19.500029 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638da8d1-3fb9-453c-b38e-94b10413e871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:19.500740 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638da8d1-3fb9-453c-b38e-94b10413e871 admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:19.501026 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638da8d1-3fb9-453c-b38e-94b10413e871 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:19.501299 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638da8d1-3fb9-453c-b38e-94b10413e871 admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:19.502465 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638da8d1-3fb9-453c-b38e-94b10413e871 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:19.504139 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638da8d1-3fb9-453c-b38e-94b10413e871 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:19.534405 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 842/1666] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:27:19 2022] GET /identity/v3/roles => generated 1420 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 10:27:19.534685 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8528ef-d532-4836-b524-d6b908009d70 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:19.535836 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638da8d1-3fb9-453c-b38e-94b10413e871 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:19.552415 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35c69e9-eddf-4a05-bd0e-11d220007e40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:19.554008 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35c69e9-eddf-4a05-bd0e-11d220007e40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:19.554297 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35c69e9-eddf-4a05-bd0e-11d220007e40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:19.554579 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35c69e9-eddf-4a05-bd0e-11d220007e40 admin admin] PATH_INFO: `/v3/projects/97f6586878654c5391e747184e41935f` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:19.556299 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35c69e9-eddf-4a05-bd0e-11d220007e40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=97f6586878654c5391e747184e41935f)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:19.557503 dv-cinder-858275-1-smb devstack@keystone.service[81352]: WARNING py.warnings [None req-d35c69e9-eddf-4a05-bd0e-11d220007e40 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 19 10:27:19.557503 dv-cinder-858275-1-smb devstack@keystone.service[81352]: warnings.warn(msg) Sep 19 10:27:19.557503 dv-cinder-858275-1-smb devstack@keystone.service[81352]: Sep 19 10:27:19.558728 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35c69e9-eddf-4a05-bd0e-11d220007e40 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:19.563267 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638da8d1-3fb9-453c-b38e-94b10413e871 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:19.578124 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cd075b-1aad-4d45-bf9a-f2bb6917afec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:19.580312 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cd075b-1aad-4d45-bf9a-f2bb6917afec admin admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:19.582419 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cd075b-1aad-4d45-bf9a-f2bb6917afec admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:19.582708 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cd075b-1aad-4d45-bf9a-f2bb6917afec admin admin] PATH_INFO: `/v3/projects/9fd040e97804403986906eb29d00d013/users/4b35355ea95a4cb1b507303f0d9b210a/roles/5c8b89fae4fa45bd944cbeaf442136e1` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:19.591700 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cd075b-1aad-4d45-bf9a-f2bb6917afec admin admin] RBAC: Authorizing `identity:create_grant(project_id=9fd040e97804403986906eb29d00d013, user_id=4b35355ea95a4cb1b507303f0d9b210a, role_id=5c8b89fae4fa45bd944cbeaf442136e1)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:19.597511 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cd075b-1aad-4d45-bf9a-f2bb6917afec admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:19.635562 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 843/1667] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 19 10:27:19 2022] PUT /identity/v3/projects/9fd040e97804403986906eb29d00d013/users/4b35355ea95a4cb1b507303f0d9b210a/roles/5c8b89fae4fa45bd944cbeaf442136e1 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 10:27:19.647878 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eeafa3-270c-4b25-859e-ac83701a4e00 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:19.648193 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eeafa3-270c-4b25-859e-ac83701a4e00 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:19.648514 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eeafa3-270c-4b25-859e-ac83701a4e00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:19.725005 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-d5eeafa3-270c-4b25-859e-ac83701a4e00 None None] MFA Rules not processed for user `4b35355ea95a4cb1b507303f0d9b210a`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:27:19.726378 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-d5eeafa3-270c-4b25-859e-ac83701a4e00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:19.751400 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:27:19.767285 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-d35c69e9-eddf-4a05-bd0e-11d220007e40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97f6586878654c5391e747184e41935f', 'request_id': 'req-d35c69e9-eddf-4a05-bd0e-11d220007e40'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:19.835525 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-d35c69e9-eddf-4a05-bd0e-11d220007e40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97f6586878654c5391e747184e41935f', 'request_id': 'req-d35c69e9-eddf-4a05-bd0e-11d220007e40'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:19.862657 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-d35c69e9-eddf-4a05-bd0e-11d220007e40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97f6586878654c5391e747184e41935f', 'request_id': 'req-d35c69e9-eddf-4a05-bd0e-11d220007e40'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:19.899874 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-d35c69e9-eddf-4a05-bd0e-11d220007e40 admin admin] The token cache is being invalidate because project 97f6586878654c5391e747184e41935f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 10:27:19.900184 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-d35c69e9-eddf-4a05-bd0e-11d220007e40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:19.902494 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-d35c69e9-eddf-4a05-bd0e-11d220007e40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:19.906365 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 825/1668] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 19 10:27:19 2022] DELETE /identity/v3/projects/97f6586878654c5391e747184e41935f => generated 0 bytes in 599 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:27:19.913755 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c24b222-195b-47be-acc5-6dc17b31d0b6 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:19.914039 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c24b222-195b-47be-acc5-6dc17b31d0b6 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:19.914316 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c24b222-195b-47be-acc5-6dc17b31d0b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:19.960032 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 844/1669] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:27:19 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:27:19.974260 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5eeafa3-270c-4b25-859e-ac83701a4e00 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:19.974459 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-1c24b222-195b-47be-acc5-6dc17b31d0b6 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:27:19.974549 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-d5eeafa3-270c-4b25-859e-ac83701a4e00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:19.974629 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-1c24b222-195b-47be-acc5-6dc17b31d0b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:20.101316 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:27:20.121779 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5eeafa3-270c-4b25-859e-ac83701a4e00 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:20.134371 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2461ac6f-7d0e-475b-b7ab-ce607fdae23d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa4d004fd44482cae761c4b3bdfab31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:20.135410 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2461ac6f-7d0e-475b-b7ab-ce607fdae23d service cinder] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:20.135928 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2461ac6f-7d0e-475b-b7ab-ce607fdae23d service cinder] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:20.136441 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2461ac6f-7d0e-475b-b7ab-ce607fdae23d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:20.139323 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-2461ac6f-7d0e-475b-b7ab-ce607fdae23d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:20.165208 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2461ac6f-7d0e-475b-b7ab-ce607fdae23d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:20.167760 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 826/1670] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:27:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 10:27:20.168107 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2461ac6f-7d0e-475b-b7ab-ce607fdae23d service cinder] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:20.176906 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56fb989-1ee6-4da0-9802-73040e43efef None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:20.177237 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56fb989-1ee6-4da0-9802-73040e43efef None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:20.177469 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56fb989-1ee6-4da0-9802-73040e43efef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:20.190725 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 845/1671] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:27:19 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:27:20.219972 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-a56fb989-1ee6-4da0-9802-73040e43efef None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:27:20.222562 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-a56fb989-1ee6-4da0-9802-73040e43efef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:20.278775 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 827/1672] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:27:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:27:20.282676 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2461ac6f-7d0e-475b-b7ab-ce607fdae23d service cinder] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:20.311312 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2461ac6f-7d0e-475b-b7ab-ce607fdae23d service cinder] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:20.325175 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b163c3f-d7bb-4e68-97fb-2c0c0eb682c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:20.330278 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b163c3f-d7bb-4e68-97fb-2c0c0eb682c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:20.331008 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b163c3f-d7bb-4e68-97fb-2c0c0eb682c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:20.331008 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b163c3f-d7bb-4e68-97fb-2c0c0eb682c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:20.336045 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b163c3f-d7bb-4e68-97fb-2c0c0eb682c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:27:20.347716 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b163c3f-d7bb-4e68-97fb-2c0c0eb682c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:20.358220 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b163c3f-d7bb-4e68-97fb-2c0c0eb682c4 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:20.406876 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 846/1673] 10.222.0.66 () {58 vars in 1153 bytes} [Mon Sep 19 10:27:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:27:20.411624 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56fb989-1ee6-4da0-9802-73040e43efef None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:20.424854 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56fb989-1ee6-4da0-9802-73040e43efef None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:20.440339 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc5acdf-b0c0-4dee-84e9-ca7ec85f2382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:20.442354 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc5acdf-b0c0-4dee-84e9-ca7ec85f2382 admin admin] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:20.443977 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc5acdf-b0c0-4dee-84e9-ca7ec85f2382 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:20.446051 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc5acdf-b0c0-4dee-84e9-ca7ec85f2382 admin admin] PATH_INFO: `/v3/projects` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:20.447240 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc5acdf-b0c0-4dee-84e9-ca7ec85f2382 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:20.453372 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc5acdf-b0c0-4dee-84e9-ca7ec85f2382 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:20.491755 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b163c3f-d7bb-4e68-97fb-2c0c0eb682c4 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:20.493694 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-4b163c3f-d7bb-4e68-97fb-2c0c0eb682c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:20.524419 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b163c3f-d7bb-4e68-97fb-2c0c0eb682c4 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:20.547002 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a4ace6-0a00-4d48-99d4-921480ee8e08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:20.547685 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a4ace6-0a00-4d48-99d4-921480ee8e08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:20.547968 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a4ace6-0a00-4d48-99d4-921480ee8e08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:20.548540 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a4ace6-0a00-4d48-99d4-921480ee8e08 admin admin] PATH_INFO: `/v3/users/baf3396017c54929bccf5c3ae4cbdc74` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:20.552198 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a4ace6-0a00-4d48-99d4-921480ee8e08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=baf3396017c54929bccf5c3ae4cbdc74)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:20.554374 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a4ace6-0a00-4d48-99d4-921480ee8e08 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:20.556587 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 828/1674] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 19 10:27:20 2022] POST /identity/v3/projects => generated 393 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:27:20.561229 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc5acdf-b0c0-4dee-84e9-ca7ec85f2382 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:20.682900 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-b2a4ace6-0a00-4d48-99d4-921480ee8e08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'baf3396017c54929bccf5c3ae4cbdc74'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:20.706408 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-b2a4ace6-0a00-4d48-99d4-921480ee8e08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'baf3396017c54929bccf5c3ae4cbdc74'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:20.707234 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-b2a4ace6-0a00-4d48-99d4-921480ee8e08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'baf3396017c54929bccf5c3ae4cbdc74'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:20.707994 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-b2a4ace6-0a00-4d48-99d4-921480ee8e08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'baf3396017c54929bccf5c3ae4cbdc74'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:20.740562 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-b2a4ace6-0a00-4d48-99d4-921480ee8e08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'baf3396017c54929bccf5c3ae4cbdc74'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:20.752933 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc5acdf-b0c0-4dee-84e9-ca7ec85f2382 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:20.763350 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647df97d-a912-4465-878c-cd67641974c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:20.765545 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647df97d-a912-4465-878c-cd67641974c0 admin admin] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:20.765886 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647df97d-a912-4465-878c-cd67641974c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:20.766226 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647df97d-a912-4465-878c-cd67641974c0 admin admin] PATH_INFO: `/v3/users` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:20.767384 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647df97d-a912-4465-878c-cd67641974c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:20.775098 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647df97d-a912-4465-878c-cd67641974c0 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:20.787623 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 847/1675] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 19 10:27:20 2022] DELETE /identity/v3/users/baf3396017c54929bccf5c3ae4cbdc74 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 10:27:20.791941 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae66abf-d18c-4a2b-97d9-18296ca55ee2 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:20.792301 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae66abf-d18c-4a2b-97d9-18296ca55ee2 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:20.792502 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae66abf-d18c-4a2b-97d9-18296ca55ee2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:20.819311 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:27:20.834110 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 829/1676] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 19 10:27:20 2022] POST /identity/v3/users => generated 297 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:27:20.836667 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647df97d-a912-4465-878c-cd67641974c0 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:20.839176 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-0ae66abf-d18c-4a2b-97d9-18296ca55ee2 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:27:20.840455 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-0ae66abf-d18c-4a2b-97d9-18296ca55ee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:20.842014 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-647df97d-a912-4465-878c-cd67641974c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:20.868021 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647df97d-a912-4465-878c-cd67641974c0 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:20.998118 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 848/1677] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:27:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 10:27:20.999035 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae66abf-d18c-4a2b-97d9-18296ca55ee2 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:21.005003 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-0ae66abf-d18c-4a2b-97d9-18296ca55ee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:21.017203 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f451a0e8-643b-4aa7-bd35-72779cb6395d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:21.017965 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f451a0e8-643b-4aa7-bd35-72779cb6395d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:21.018312 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f451a0e8-643b-4aa7-bd35-72779cb6395d admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:21.018651 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f451a0e8-643b-4aa7-bd35-72779cb6395d admin admin] PATH_INFO: `/v3/users/1d1958945fe242dba235a89c48dd3f93` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:21.020645 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f451a0e8-643b-4aa7-bd35-72779cb6395d admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d1958945fe242dba235a89c48dd3f93)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:21.023862 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f451a0e8-643b-4aa7-bd35-72779cb6395d admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:21.040603 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae66abf-d18c-4a2b-97d9-18296ca55ee2 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:21.056998 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc78fd30-71ae-4d65-8cef-07205b15cbe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:21.058332 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc78fd30-71ae-4d65-8cef-07205b15cbe0 admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:21.058622 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc78fd30-71ae-4d65-8cef-07205b15cbe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:21.058899 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc78fd30-71ae-4d65-8cef-07205b15cbe0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:21.059563 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc78fd30-71ae-4d65-8cef-07205b15cbe0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:21.065889 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc78fd30-71ae-4d65-8cef-07205b15cbe0 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:21.092341 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 849/1678] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:27:20 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 10:27:21.094776 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc78fd30-71ae-4d65-8cef-07205b15cbe0 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:21.099383 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-fc78fd30-71ae-4d65-8cef-07205b15cbe0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:21.147717 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=90,keystone:INSERT=4,keystone:DELETE=6 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:27:21.164182 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-f451a0e8-643b-4aa7-bd35-72779cb6395d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d1958945fe242dba235a89c48dd3f93'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:21.183998 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-f451a0e8-643b-4aa7-bd35-72779cb6395d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d1958945fe242dba235a89c48dd3f93'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:21.187847 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-f451a0e8-643b-4aa7-bd35-72779cb6395d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d1958945fe242dba235a89c48dd3f93'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:21.188658 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-f451a0e8-643b-4aa7-bd35-72779cb6395d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d1958945fe242dba235a89c48dd3f93'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:21.205375 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-f451a0e8-643b-4aa7-bd35-72779cb6395d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d1958945fe242dba235a89c48dd3f93'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:21.255338 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 830/1679] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 19 10:27:20 2022] DELETE /identity/v3/users/1d1958945fe242dba235a89c48dd3f93 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:27:21.262391 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f451a0e8-643b-4aa7-bd35-72779cb6395d admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:21.265998 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-f451a0e8-643b-4aa7-bd35-72779cb6395d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:21.279441 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc78fd30-71ae-4d65-8cef-07205b15cbe0 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:21.388271 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f451a0e8-643b-4aa7-bd35-72779cb6395d admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:21.397037 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc13f88-74c6-4888-aaf6-5cdfa5b05b58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:21.398057 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc13f88-74c6-4888-aaf6-5cdfa5b05b58 admin admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:21.398532 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc13f88-74c6-4888-aaf6-5cdfa5b05b58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:21.399143 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc13f88-74c6-4888-aaf6-5cdfa5b05b58 admin admin] PATH_INFO: `/v3/roles` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:21.400365 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc13f88-74c6-4888-aaf6-5cdfa5b05b58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:21.402651 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc13f88-74c6-4888-aaf6-5cdfa5b05b58 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:21.417341 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 831/1680] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:27:21 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 10:27:21.419546 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdd0a4b-9c66-43ad-a71b-f19bf1fe8288 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c1289b015854c6bb6aee8fed6b807db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:21.421895 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdd0a4b-9c66-43ad-a71b-f19bf1fe8288 service neutron] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:21.422195 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdd0a4b-9c66-43ad-a71b-f19bf1fe8288 service neutron] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:21.422473 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdd0a4b-9c66-43ad-a71b-f19bf1fe8288 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:21.425958 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-5cdd0a4b-9c66-43ad-a71b-f19bf1fe8288 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:21.439952 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f83868-0061-4341-86e9-09aeb6f9df3a None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:21.440529 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f83868-0061-4341-86e9-09aeb6f9df3a None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:21.441004 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f83868-0061-4341-86e9-09aeb6f9df3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:21.459261 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdd0a4b-9c66-43ad-a71b-f19bf1fe8288 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:21.463522 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdd0a4b-9c66-43ad-a71b-f19bf1fe8288 service neutron] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:21.488236 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 850/1681] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:27:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:27:21.489098 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdd0a4b-9c66-43ad-a71b-f19bf1fe8288 service neutron] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:21.492906 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-60f83868-0061-4341-86e9-09aeb6f9df3a None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:27:21.508633 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-60f83868-0061-4341-86e9-09aeb6f9df3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:21.525661 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdd0a4b-9c66-43ad-a71b-f19bf1fe8288 service neutron] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:21.545475 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de8e959-2dcc-4a29-9984-da0d62e80d4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:21.546378 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de8e959-2dcc-4a29-9984-da0d62e80d4f admin admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:21.546803 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de8e959-2dcc-4a29-9984-da0d62e80d4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:21.548005 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de8e959-2dcc-4a29-9984-da0d62e80d4f admin admin] PATH_INFO: `/v3/projects/a29fc9cddbf54689a3111f26dd8051cb/users/f191664ba8fa4c25a26a3ce22e85915f/roles/cd5b42ed3b754b58817a62bbe74651b4` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:21.548362 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 832/1682] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:27:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:27:21.602270 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f83868-0061-4341-86e9-09aeb6f9df3a None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:21.604062 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-60f83868-0061-4341-86e9-09aeb6f9df3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:21.607893 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de8e959-2dcc-4a29-9984-da0d62e80d4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a29fc9cddbf54689a3111f26dd8051cb, user_id=f191664ba8fa4c25a26a3ce22e85915f, role_id=cd5b42ed3b754b58817a62bbe74651b4)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:21.610718 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de8e959-2dcc-4a29-9984-da0d62e80d4f admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:21.625714 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f83868-0061-4341-86e9-09aeb6f9df3a None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:21.634694 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7100a3-0d9f-49d3-a8ab-d561cb5dd386 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c1289b015854c6bb6aee8fed6b807db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:21.639475 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7100a3-0d9f-49d3-a8ab-d561cb5dd386 service neutron] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:21.639933 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7100a3-0d9f-49d3-a8ab-d561cb5dd386 service neutron] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:21.643359 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7100a3-0d9f-49d3-a8ab-d561cb5dd386 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:21.659046 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 851/1683] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 19 10:27:21 2022] PUT /identity/v3/projects/a29fc9cddbf54689a3111f26dd8051cb/users/f191664ba8fa4c25a26a3ce22e85915f/roles/cd5b42ed3b754b58817a62bbe74651b4 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:27:21.662377 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71063b7-b65c-424e-ab93-0c7dfaf7e7b5 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:21.662667 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71063b7-b65c-424e-ab93-0c7dfaf7e7b5 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:21.662948 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71063b7-b65c-424e-ab93-0c7dfaf7e7b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:21.682899 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7100a3-0d9f-49d3-a8ab-d561cb5dd386 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:21.686011 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7100a3-0d9f-49d3-a8ab-d561cb5dd386 service neutron] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:21.722119 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 833/1684] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:27:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:27:21.739785 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-d71063b7-b65c-424e-ab93-0c7dfaf7e7b5 None None] MFA Rules not processed for user `f191664ba8fa4c25a26a3ce22e85915f`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:27:21.741993 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-d71063b7-b65c-424e-ab93-0c7dfaf7e7b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:21.775783 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:27:21.870969 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 852/1685] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:27:21 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:27:21.876229 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7100a3-0d9f-49d3-a8ab-d561cb5dd386 service neutron] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:21.918149 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7100a3-0d9f-49d3-a8ab-d561cb5dd386 service neutron] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:22.125434 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c16d9c9-f41c-4b54-b013-ab3e87e81f7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:22.126218 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c16d9c9-f41c-4b54-b013-ab3e87e81f7e admin admin] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:22.126508 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c16d9c9-f41c-4b54-b013-ab3e87e81f7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:22.126876 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c16d9c9-f41c-4b54-b013-ab3e87e81f7e admin admin] PATH_INFO: `/v3/projects` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:22.127638 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c16d9c9-f41c-4b54-b013-ab3e87e81f7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:22.131628 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c16d9c9-f41c-4b54-b013-ab3e87e81f7e admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:22.194082 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 834/1686] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 19 10:27:21 2022] POST /identity/v3/projects => generated 393 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:27:22.196495 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71063b7-b65c-424e-ab93-0c7dfaf7e7b5 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:22.220579 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71063b7-b65c-424e-ab93-0c7dfaf7e7b5 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:22.360046 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216ec81d-c333-4348-a8ce-7df1240d36a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:22.361095 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216ec81d-c333-4348-a8ce-7df1240d36a1 admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:22.361480 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216ec81d-c333-4348-a8ce-7df1240d36a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:22.361920 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216ec81d-c333-4348-a8ce-7df1240d36a1 admin admin] PATH_INFO: `/v3/users` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:22.363081 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216ec81d-c333-4348-a8ce-7df1240d36a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:22.366422 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216ec81d-c333-4348-a8ce-7df1240d36a1 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:22.417059 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 853/1687] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 19 10:27:22 2022] POST /identity/v3/users => generated 303 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:27:22.418163 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c16d9c9-f41c-4b54-b013-ab3e87e81f7e admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:22.437773 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c16d9c9-f41c-4b54-b013-ab3e87e81f7e admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:22.454217 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecaac69-d32c-4301-a7ad-aa9b9f7e3b62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:22.455147 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecaac69-d32c-4301-a7ad-aa9b9f7e3b62 admin admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:22.455742 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecaac69-d32c-4301-a7ad-aa9b9f7e3b62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:22.456222 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecaac69-d32c-4301-a7ad-aa9b9f7e3b62 admin admin] PATH_INFO: `/v3/roles` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:22.457068 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecaac69-d32c-4301-a7ad-aa9b9f7e3b62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:22.462651 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecaac69-d32c-4301-a7ad-aa9b9f7e3b62 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:22.495477 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 835/1688] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:27:22 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 10:27:22.501196 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216ec81d-c333-4348-a8ce-7df1240d36a1 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:22.523338 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216ec81d-c333-4348-a8ce-7df1240d36a1 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:22.537394 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3e8874-9c7d-4db4-a341-9a2b6b96c143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:22.538249 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3e8874-9c7d-4db4-a341-9a2b6b96c143 admin admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:22.539059 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3e8874-9c7d-4db4-a341-9a2b6b96c143 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:22.540538 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3e8874-9c7d-4db4-a341-9a2b6b96c143 admin admin] PATH_INFO: `/v3/projects/8d2d9f5d04fa45e8a708037d9679df63/users/2c3cd8f8cbb145f5bd2cb526ef150638/roles/5c8b89fae4fa45bd944cbeaf442136e1` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:22.581453 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3e8874-9c7d-4db4-a341-9a2b6b96c143 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d2d9f5d04fa45e8a708037d9679df63, user_id=2c3cd8f8cbb145f5bd2cb526ef150638, role_id=5c8b89fae4fa45bd944cbeaf442136e1)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:22.591744 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3e8874-9c7d-4db4-a341-9a2b6b96c143 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:22.616818 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 854/1689] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 19 10:27:22 2022] PUT /identity/v3/projects/8d2d9f5d04fa45e8a708037d9679df63/users/2c3cd8f8cbb145f5bd2cb526ef150638/roles/5c8b89fae4fa45bd944cbeaf442136e1 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:27:22.623460 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecaac69-d32c-4301-a7ad-aa9b9f7e3b62 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:22.645067 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecaac69-d32c-4301-a7ad-aa9b9f7e3b62 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:22.674617 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:DELETE=4,keystone:SELECT=94,keystone:INSERT=2 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:27:22.835643 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9ab42e-94a8-4d2d-990a-bea4843525e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:22.837523 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9ab42e-94a8-4d2d-990a-bea4843525e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:22.837809 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9ab42e-94a8-4d2d-990a-bea4843525e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:22.838085 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9ab42e-94a8-4d2d-990a-bea4843525e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:22.841061 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9ab42e-94a8-4d2d-990a-bea4843525e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:22.845018 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9ab42e-94a8-4d2d-990a-bea4843525e7 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:22.889841 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 836/1690] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:27:22 2022] GET /identity/v3/roles => generated 1420 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 10:27:22.894200 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3e8874-9c7d-4db4-a341-9a2b6b96c143 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:22.906294 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3e8874-9c7d-4db4-a341-9a2b6b96c143 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:22.926281 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734d114f-2af8-43d3-8197-dc0cc86098bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:22.928266 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734d114f-2af8-43d3-8197-dc0cc86098bf admin admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:22.928857 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734d114f-2af8-43d3-8197-dc0cc86098bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:22.929401 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734d114f-2af8-43d3-8197-dc0cc86098bf admin admin] PATH_INFO: `/v3/projects/8d2d9f5d04fa45e8a708037d9679df63/users/2c3cd8f8cbb145f5bd2cb526ef150638/roles/5c8b89fae4fa45bd944cbeaf442136e1` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:22.936324 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734d114f-2af8-43d3-8197-dc0cc86098bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d2d9f5d04fa45e8a708037d9679df63, user_id=2c3cd8f8cbb145f5bd2cb526ef150638, role_id=5c8b89fae4fa45bd944cbeaf442136e1)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:22.945104 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734d114f-2af8-43d3-8197-dc0cc86098bf admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:22.987999 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418fb977-5a7f-489e-98de-1562e3ef7bb0 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:22.988974 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418fb977-5a7f-489e-98de-1562e3ef7bb0 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:22.989411 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418fb977-5a7f-489e-98de-1562e3ef7bb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:22.992055 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 855/1691] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 19 10:27:22 2022] PUT /identity/v3/projects/8d2d9f5d04fa45e8a708037d9679df63/users/2c3cd8f8cbb145f5bd2cb526ef150638/roles/5c8b89fae4fa45bd944cbeaf442136e1 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:27:23.059790 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-418fb977-5a7f-489e-98de-1562e3ef7bb0 None None] MFA Rules not processed for user `2c3cd8f8cbb145f5bd2cb526ef150638`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:27:23.062704 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-418fb977-5a7f-489e-98de-1562e3ef7bb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:23.267458 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 837/1692] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:27:22 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:27:23.283819 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734d114f-2af8-43d3-8197-dc0cc86098bf admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:23.292826 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-734d114f-2af8-43d3-8197-dc0cc86098bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:23.564293 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734d114f-2af8-43d3-8197-dc0cc86098bf admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:23.574781 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ca23d2-ca12-4a98-aca6-768c326261b0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa4d004fd44482cae761c4b3bdfab31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:23.576100 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ca23d2-ca12-4a98-aca6-768c326261b0 service cinder] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:23.576430 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ca23d2-ca12-4a98-aca6-768c326261b0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:23.576697 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ca23d2-ca12-4a98-aca6-768c326261b0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:23.619787 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ca23d2-ca12-4a98-aca6-768c326261b0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:23.621575 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ca23d2-ca12-4a98-aca6-768c326261b0 service cinder] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:23.674392 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 856/1693] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:27:23 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:27:23.843613 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418fb977-5a7f-489e-98de-1562e3ef7bb0 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:23.859883 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418fb977-5a7f-489e-98de-1562e3ef7bb0 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:23.883575 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d123d26a-92da-4f2e-8d6a-6e24b31195f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa4d004fd44482cae761c4b3bdfab31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:23.885443 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d123d26a-92da-4f2e-8d6a-6e24b31195f0 service cinder] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:23.885766 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d123d26a-92da-4f2e-8d6a-6e24b31195f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:23.886821 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d123d26a-92da-4f2e-8d6a-6e24b31195f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:24.148623 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d123d26a-92da-4f2e-8d6a-6e24b31195f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:24.152861 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d123d26a-92da-4f2e-8d6a-6e24b31195f0 service cinder] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:24.199345 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 838/1694] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:27:23 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:27:24.390950 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ca23d2-ca12-4a98-aca6-768c326261b0 service cinder] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:24.393714 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-02ca23d2-ca12-4a98-aca6-768c326261b0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:24.450606 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:27:24.554302 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ca23d2-ca12-4a98-aca6-768c326261b0 service cinder] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:24.562549 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90941fe2-78a6-42fc-a28d-4bf521a371a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:24.563569 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90941fe2-78a6-42fc-a28d-4bf521a371a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:24.564102 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90941fe2-78a6-42fc-a28d-4bf521a371a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:24.564752 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90941fe2-78a6-42fc-a28d-4bf521a371a7 admin admin] PATH_INFO: `/v3/projects/fd0811ffb7d743dbaaabf1122103f839` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:24.568109 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90941fe2-78a6-42fc-a28d-4bf521a371a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd0811ffb7d743dbaaabf1122103f839)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:24.570799 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90941fe2-78a6-42fc-a28d-4bf521a371a7 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:24.640639 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d123d26a-92da-4f2e-8d6a-6e24b31195f0 service cinder] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:24.641985 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-d123d26a-92da-4f2e-8d6a-6e24b31195f0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:24.664854 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d123d26a-92da-4f2e-8d6a-6e24b31195f0 service cinder] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:24.705128 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-90941fe2-78a6-42fc-a28d-4bf521a371a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd0811ffb7d743dbaaabf1122103f839', 'request_id': 'req-90941fe2-78a6-42fc-a28d-4bf521a371a7'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:24.720663 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-90941fe2-78a6-42fc-a28d-4bf521a371a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd0811ffb7d743dbaaabf1122103f839', 'request_id': 'req-90941fe2-78a6-42fc-a28d-4bf521a371a7'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:24.741606 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-90941fe2-78a6-42fc-a28d-4bf521a371a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd0811ffb7d743dbaaabf1122103f839', 'request_id': 'req-90941fe2-78a6-42fc-a28d-4bf521a371a7'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:24.756416 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:27:24.761252 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-90941fe2-78a6-42fc-a28d-4bf521a371a7 admin admin] The token cache is being invalidate because project fd0811ffb7d743dbaaabf1122103f839 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 10:27:24.761756 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-90941fe2-78a6-42fc-a28d-4bf521a371a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:24.763111 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-90941fe2-78a6-42fc-a28d-4bf521a371a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:24.769895 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 857/1695] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 19 10:27:24 2022] DELETE /identity/v3/projects/fd0811ffb7d743dbaaabf1122103f839 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:27:24.776306 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8ad05a-3fd2-407a-903b-08f5ce27a946 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:24.776738 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8ad05a-3fd2-407a-903b-08f5ce27a946 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:24.777622 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8ad05a-3fd2-407a-903b-08f5ce27a946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:24.844198 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681f26c7-c3c7-43af-9ab2-1f67f422b654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:24.845168 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681f26c7-c3c7-43af-9ab2-1f67f422b654 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:24.845465 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681f26c7-c3c7-43af-9ab2-1f67f422b654 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:24.847594 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681f26c7-c3c7-43af-9ab2-1f67f422b654 admin admin] PATH_INFO: `/v3/projects/41311537016b43d78c4274a6f6ad7fcb` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:24.850286 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681f26c7-c3c7-43af-9ab2-1f67f422b654 admin admin] RBAC: Authorizing `identity:delete_project(project_id=41311537016b43d78c4274a6f6ad7fcb)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:24.854928 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681f26c7-c3c7-43af-9ab2-1f67f422b654 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:24.893374 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-ce8ad05a-3fd2-407a-903b-08f5ce27a946 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:27:24.901824 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-ce8ad05a-3fd2-407a-903b-08f5ce27a946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:24.942805 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 858/1696] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:27:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:27:24.945657 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c117425d-1995-4e65-9621-9161eee7b071 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:24.945950 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c117425d-1995-4e65-9621-9161eee7b071 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:24.948497 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c117425d-1995-4e65-9621-9161eee7b071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:24.977592 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-681f26c7-c3c7-43af-9ab2-1f67f422b654 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41311537016b43d78c4274a6f6ad7fcb', 'request_id': 'req-681f26c7-c3c7-43af-9ab2-1f67f422b654'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:24.995028 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-681f26c7-c3c7-43af-9ab2-1f67f422b654 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41311537016b43d78c4274a6f6ad7fcb', 'request_id': 'req-681f26c7-c3c7-43af-9ab2-1f67f422b654'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:25.010881 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-681f26c7-c3c7-43af-9ab2-1f67f422b654 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41311537016b43d78c4274a6f6ad7fcb', 'request_id': 'req-681f26c7-c3c7-43af-9ab2-1f67f422b654'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:25.022218 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-c117425d-1995-4e65-9621-9161eee7b071 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:27:25.025943 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-c117425d-1995-4e65-9621-9161eee7b071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:25.035300 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-681f26c7-c3c7-43af-9ab2-1f67f422b654 admin admin] The token cache is being invalidate because project 41311537016b43d78c4274a6f6ad7fcb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 10:27:25.036467 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-681f26c7-c3c7-43af-9ab2-1f67f422b654 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:25.037576 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-681f26c7-c3c7-43af-9ab2-1f67f422b654 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:25.041584 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 839/1697] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 19 10:27:24 2022] DELETE /identity/v3/projects/41311537016b43d78c4274a6f6ad7fcb => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:27:25.045775 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681f26c7-c3c7-43af-9ab2-1f67f422b654 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:25.050108 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-681f26c7-c3c7-43af-9ab2-1f67f422b654 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:25.223534 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 859/1698] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:27:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:27:25.226146 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c117425d-1995-4e65-9621-9161eee7b071 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:25.226790 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681f26c7-c3c7-43af-9ab2-1f67f422b654 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:25.245103 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364043ce-9a48-4c79-a3e3-aba4e0c0ab07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:25.246034 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364043ce-9a48-4c79-a3e3-aba4e0c0ab07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:25.246380 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364043ce-9a48-4c79-a3e3-aba4e0c0ab07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:25.246661 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364043ce-9a48-4c79-a3e3-aba4e0c0ab07 admin admin] PATH_INFO: `/v3/users/4b35355ea95a4cb1b507303f0d9b210a` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:25.252660 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364043ce-9a48-4c79-a3e3-aba4e0c0ab07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b35355ea95a4cb1b507303f0d9b210a)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:25.254851 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364043ce-9a48-4c79-a3e3-aba4e0c0ab07 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:25.255483 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c117425d-1995-4e65-9621-9161eee7b071 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:25.273729 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6e740a-398d-4833-9908-a7f942ea03e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:25.274908 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6e740a-398d-4833-9908-a7f942ea03e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:25.275196 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6e740a-398d-4833-9908-a7f942ea03e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:25.278190 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6e740a-398d-4833-9908-a7f942ea03e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:25.279474 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6e740a-398d-4833-9908-a7f942ea03e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:27:25.280752 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6e740a-398d-4833-9908-a7f942ea03e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:25.282412 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6e740a-398d-4833-9908-a7f942ea03e6 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:25.320195 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 860/1699] 10.222.0.66 () {58 vars in 1153 bytes} [Mon Sep 19 10:27:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:27:25.321857 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6e740a-398d-4833-9908-a7f942ea03e6 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:25.352398 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6e740a-398d-4833-9908-a7f942ea03e6 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:25.356029 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-364043ce-9a48-4c79-a3e3-aba4e0c0ab07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b35355ea95a4cb1b507303f0d9b210a'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:25.365957 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1284080e-e3ed-4043-9051-c74336769098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:25.367057 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1284080e-e3ed-4043-9051-c74336769098 admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:25.367398 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1284080e-e3ed-4043-9051-c74336769098 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:25.368481 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1284080e-e3ed-4043-9051-c74336769098 admin admin] PATH_INFO: `/v3/projects` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:25.370037 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1284080e-e3ed-4043-9051-c74336769098 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:25.373591 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1284080e-e3ed-4043-9051-c74336769098 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:25.374453 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-364043ce-9a48-4c79-a3e3-aba4e0c0ab07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b35355ea95a4cb1b507303f0d9b210a'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:25.375221 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-364043ce-9a48-4c79-a3e3-aba4e0c0ab07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b35355ea95a4cb1b507303f0d9b210a'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:25.375963 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-364043ce-9a48-4c79-a3e3-aba4e0c0ab07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b35355ea95a4cb1b507303f0d9b210a'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:25.388711 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-364043ce-9a48-4c79-a3e3-aba4e0c0ab07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b35355ea95a4cb1b507303f0d9b210a'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:25.390033 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:27:25.422593 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 861/1700] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 19 10:27:25 2022] POST /identity/v3/projects => generated 369 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:27:25.427128 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1284080e-e3ed-4043-9051-c74336769098 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:25.429236 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-1284080e-e3ed-4043-9051-c74336769098 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:25.430363 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 840/1701] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 19 10:27:25 2022] DELETE /identity/v3/users/4b35355ea95a4cb1b507303f0d9b210a => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 10:27:25.437728 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:27:25.534071 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2049d89-058d-472b-8654-0d782cf97414 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:25.534645 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2049d89-058d-472b-8654-0d782cf97414 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:25.535017 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2049d89-058d-472b-8654-0d782cf97414 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:25.601569 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-f2049d89-058d-472b-8654-0d782cf97414 None None] MFA Rules not processed for user `28727f7a16614b55b4df3e05b6b42be5`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:27:25.603342 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-f2049d89-058d-472b-8654-0d782cf97414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:25.615459 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1284080e-e3ed-4043-9051-c74336769098 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:25.794879 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 841/1702] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:27:25 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:27:25.806045 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab93193-483e-4627-b314-8ca69cc11706 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:25.810644 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab93193-483e-4627-b314-8ca69cc11706 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:25.816193 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab93193-483e-4627-b314-8ca69cc11706 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:25.828256 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0245dc7f-03e8-4edb-8b8e-6d2bb0eb5423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:25.829183 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0245dc7f-03e8-4edb-8b8e-6d2bb0eb5423 admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:25.829616 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0245dc7f-03e8-4edb-8b8e-6d2bb0eb5423 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:25.830025 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0245dc7f-03e8-4edb-8b8e-6d2bb0eb5423 admin admin] PATH_INFO: `/v3/users` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:25.831225 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0245dc7f-03e8-4edb-8b8e-6d2bb0eb5423 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:25.836510 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0245dc7f-03e8-4edb-8b8e-6d2bb0eb5423 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:25.886779 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 862/1703] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 19 10:27:25 2022] POST /identity/v3/users => generated 285 bytes in 460 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:27:25.890217 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cb3b4b-4fef-48b2-8904-c1247451729b None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:25.891349 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cb3b4b-4fef-48b2-8904-c1247451729b None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:25.891996 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cb3b4b-4fef-48b2-8904-c1247451729b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:25.897496 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-6ab93193-483e-4627-b314-8ca69cc11706 None None] MFA Rules not processed for user `e62a6e400ad7425f9217164bc9190a21`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:27:25.901271 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-6ab93193-483e-4627-b314-8ca69cc11706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:25.945246 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-d3cb3b4b-4fef-48b2-8904-c1247451729b None None] MFA Rules not processed for user `28727f7a16614b55b4df3e05b6b42be5`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:27:25.946892 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-d3cb3b4b-4fef-48b2-8904-c1247451729b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:25.968145 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 863/1704] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:27:25 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:27:25.972118 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cb3b4b-4fef-48b2-8904-c1247451729b None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:26.007798 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cb3b4b-4fef-48b2-8904-c1247451729b None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:26.024447 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1b0235-5b95-4bd4-917b-afc13cb738a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:26.025202 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1b0235-5b95-4bd4-917b-afc13cb738a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:26.025575 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1b0235-5b95-4bd4-917b-afc13cb738a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:26.025860 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1b0235-5b95-4bd4-917b-afc13cb738a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:26.026515 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1b0235-5b95-4bd4-917b-afc13cb738a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:26.032218 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1b0235-5b95-4bd4-917b-afc13cb738a9 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:26.052653 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 864/1705] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:27:25 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 10:27:26.053086 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 842/1706] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:27:25 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:27:26.054018 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1b0235-5b95-4bd4-917b-afc13cb738a9 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:26.063275 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67db20f8-9aa3-40cf-9888-7fb0be6cd6f6 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:26.063275 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67db20f8-9aa3-40cf-9888-7fb0be6cd6f6 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:26.063275 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67db20f8-9aa3-40cf-9888-7fb0be6cd6f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:26.066398 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-cc1b0235-5b95-4bd4-917b-afc13cb738a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:26.118993 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-67db20f8-9aa3-40cf-9888-7fb0be6cd6f6 None None] MFA Rules not processed for user `e62a6e400ad7425f9217164bc9190a21`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:27:26.121315 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-67db20f8-9aa3-40cf-9888-7fb0be6cd6f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:26.145589 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 843/1707] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:27:26 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:27:26.146732 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67db20f8-9aa3-40cf-9888-7fb0be6cd6f6 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:26.183989 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67db20f8-9aa3-40cf-9888-7fb0be6cd6f6 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:26.195928 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678ecb75-a331-4d9f-86db-32a070333286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:26.197800 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678ecb75-a331-4d9f-86db-32a070333286 admin admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:26.200929 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678ecb75-a331-4d9f-86db-32a070333286 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:26.201891 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678ecb75-a331-4d9f-86db-32a070333286 admin admin] PATH_INFO: `/v3/roles` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:26.203460 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678ecb75-a331-4d9f-86db-32a070333286 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:26.206401 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678ecb75-a331-4d9f-86db-32a070333286 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:26.235137 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 844/1708] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:27:26 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 10:27:26.236798 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437f9281-b513-460b-bdab-8a597b5fc2fa None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:26.237252 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437f9281-b513-460b-bdab-8a597b5fc2fa None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:26.237671 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437f9281-b513-460b-bdab-8a597b5fc2fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:26.307394 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-437f9281-b513-460b-bdab-8a597b5fc2fa None None] MFA Rules not processed for user `d37107a7553248409c6cd63406c3ddef`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:27:26.309182 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-437f9281-b513-460b-bdab-8a597b5fc2fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:26.373995 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1b0235-5b95-4bd4-917b-afc13cb738a9 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:26.394000 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e7feef-af97-4932-9fd7-b461a2280c65 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15c70bfb085a44e9b84942b480ff22f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:26.394219 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e7feef-af97-4932-9fd7-b461a2280c65 service nova] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:26.394483 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e7feef-af97-4932-9fd7-b461a2280c65 service nova] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:26.394761 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e7feef-af97-4932-9fd7-b461a2280c65 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:26.414508 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:27:26.416248 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e7feef-af97-4932-9fd7-b461a2280c65 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:26.418058 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e7feef-af97-4932-9fd7-b461a2280c65 service nova] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:26.440682 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 865/1709] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:27:26 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:27:26.441618 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e7feef-af97-4932-9fd7-b461a2280c65 service nova] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:26.443168 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-02e7feef-af97-4932-9fd7-b461a2280c65 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:26.470668 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e7feef-af97-4932-9fd7-b461a2280c65 service nova] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:26.491392 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7c3519-0d07-4a79-a07d-10fa6c39eb8b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15c70bfb085a44e9b84942b480ff22f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:26.492458 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7c3519-0d07-4a79-a07d-10fa6c39eb8b service nova] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:26.492862 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7c3519-0d07-4a79-a07d-10fa6c39eb8b service nova] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:26.493792 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7c3519-0d07-4a79-a07d-10fa6c39eb8b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:26.505001 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:27:26.508454 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7c3519-0d07-4a79-a07d-10fa6c39eb8b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:26.513535 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7c3519-0d07-4a79-a07d-10fa6c39eb8b service nova] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:26.535575 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 866/1710] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:27:26 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:27:26.536604 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7c3519-0d07-4a79-a07d-10fa6c39eb8b service nova] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:26.558487 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 845/1711] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:27:26 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:27:26.558820 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7c3519-0d07-4a79-a07d-10fa6c39eb8b service nova] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:26.576419 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f791dc9-dea4-49ec-906a-60a045d322c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:26.578422 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f791dc9-dea4-49ec-906a-60a045d322c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:26.582955 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f791dc9-dea4-49ec-906a-60a045d322c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:26.583469 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f791dc9-dea4-49ec-906a-60a045d322c9 admin admin] PATH_INFO: `/v3/projects/dd3e9e87e86a4ee5b41318e873af45d3/users/c68b3b24dcb2428a8cb081863a83d8dd/roles/cd5b42ed3b754b58817a62bbe74651b4` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:26.602926 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437f9281-b513-460b-bdab-8a597b5fc2fa None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:26.604545 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-437f9281-b513-460b-bdab-8a597b5fc2fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:26.634117 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437f9281-b513-460b-bdab-8a597b5fc2fa None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:26.635810 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f791dc9-dea4-49ec-906a-60a045d322c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd3e9e87e86a4ee5b41318e873af45d3, user_id=c68b3b24dcb2428a8cb081863a83d8dd, role_id=cd5b42ed3b754b58817a62bbe74651b4)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:26.642379 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f791dc9-dea4-49ec-906a-60a045d322c9 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:26.657804 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5517e9c-7a2f-4795-bc71-b8ed407f43b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:26.658554 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5517e9c-7a2f-4795-bc71-b8ed407f43b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:26.658841 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5517e9c-7a2f-4795-bc71-b8ed407f43b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:26.659119 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5517e9c-7a2f-4795-bc71-b8ed407f43b2 admin admin] PATH_INFO: `/v3/projects/9fd040e97804403986906eb29d00d013` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:26.660436 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5517e9c-7a2f-4795-bc71-b8ed407f43b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9fd040e97804403986906eb29d00d013)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:26.662637 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5517e9c-7a2f-4795-bc71-b8ed407f43b2 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:26.671513 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 867/1712] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 19 10:27:26 2022] PUT /identity/v3/projects/dd3e9e87e86a4ee5b41318e873af45d3/users/c68b3b24dcb2428a8cb081863a83d8dd/roles/cd5b42ed3b754b58817a62bbe74651b4 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:27:26.686532 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931396ff-189a-42c1-8a16-97363d644b8a None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:26.687529 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931396ff-189a-42c1-8a16-97363d644b8a None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:26.688059 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931396ff-189a-42c1-8a16-97363d644b8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:26.829607 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-931396ff-189a-42c1-8a16-97363d644b8a None None] MFA Rules not processed for user `c68b3b24dcb2428a8cb081863a83d8dd`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:27:26.838284 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-931396ff-189a-42c1-8a16-97363d644b8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:26.889349 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-f5517e9c-7a2f-4795-bc71-b8ed407f43b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9fd040e97804403986906eb29d00d013', 'request_id': 'req-f5517e9c-7a2f-4795-bc71-b8ed407f43b2'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:26.925921 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-f5517e9c-7a2f-4795-bc71-b8ed407f43b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9fd040e97804403986906eb29d00d013', 'request_id': 'req-f5517e9c-7a2f-4795-bc71-b8ed407f43b2'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:26.951124 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-f5517e9c-7a2f-4795-bc71-b8ed407f43b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9fd040e97804403986906eb29d00d013', 'request_id': 'req-f5517e9c-7a2f-4795-bc71-b8ed407f43b2'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:26.975081 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-f5517e9c-7a2f-4795-bc71-b8ed407f43b2 admin admin] The token cache is being invalidate because project 9fd040e97804403986906eb29d00d013 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 10:27:26.975387 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-f5517e9c-7a2f-4795-bc71-b8ed407f43b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:26.976528 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-f5517e9c-7a2f-4795-bc71-b8ed407f43b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:26.981740 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 846/1713] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 19 10:27:26 2022] DELETE /identity/v3/projects/9fd040e97804403986906eb29d00d013 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 10:27:26.983366 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f45e69b-7824-46d7-8140-38b63b72d8fa None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:26.984900 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f45e69b-7824-46d7-8140-38b63b72d8fa None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:26.985034 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f45e69b-7824-46d7-8140-38b63b72d8fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:27.037778 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-8f45e69b-7824-46d7-8140-38b63b72d8fa None None] MFA Rules not processed for user `f66555915f3b46f0a687df2a69fc7eee`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:27:27.041194 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-8f45e69b-7824-46d7-8140-38b63b72d8fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:27.100188 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 868/1714] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:27:26 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 415 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:27:27.106196 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13eee98-179f-43fb-824b-e57eea24173a None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:27.111621 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13eee98-179f-43fb-824b-e57eea24173a None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:27.111970 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13eee98-179f-43fb-824b-e57eea24173a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:27.180096 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-c13eee98-179f-43fb-824b-e57eea24173a None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:27:27.180096 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-c13eee98-179f-43fb-824b-e57eea24173a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:27.206809 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 847/1715] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:27:26 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:27:27.212032 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f45e69b-7824-46d7-8140-38b63b72d8fa None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:27.212032 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-8f45e69b-7824-46d7-8140-38b63b72d8fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:27.402321 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f45e69b-7824-46d7-8140-38b63b72d8fa None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:27.415880 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2557c17-e1ea-4fc5-951b-a6b3c8874383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:27.420301 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2557c17-e1ea-4fc5-951b-a6b3c8874383 admin admin] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:27.420664 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2557c17-e1ea-4fc5-951b-a6b3c8874383 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:27.420927 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2557c17-e1ea-4fc5-951b-a6b3c8874383 admin admin] PATH_INFO: `/v3/projects` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:27.421594 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2557c17-e1ea-4fc5-951b-a6b3c8874383 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:27.436586 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2557c17-e1ea-4fc5-951b-a6b3c8874383 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:27.453688 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 869/1716] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:27:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 353 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:27:27.459508 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:27:27.461394 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87cac6d-0807-42f6-9345-4fd71df06704 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:27.461692 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87cac6d-0807-42f6-9345-4fd71df06704 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:27.461972 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87cac6d-0807-42f6-9345-4fd71df06704 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:27.529875 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 848/1717] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 19 10:27:27 2022] POST /identity/v3/projects => generated 367 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:27:27.530768 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2557c17-e1ea-4fc5-951b-a6b3c8874383 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:27.541373 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-a87cac6d-0807-42f6-9345-4fd71df06704 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:27:27.542785 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-a87cac6d-0807-42f6-9345-4fd71df06704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:27.681972 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2557c17-e1ea-4fc5-951b-a6b3c8874383 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:27.701544 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bfa71f-94b8-4998-92d3-bb1ebe14c8e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:27.702188 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bfa71f-94b8-4998-92d3-bb1ebe14c8e3 admin admin] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:27.702472 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bfa71f-94b8-4998-92d3-bb1ebe14c8e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:27.702754 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bfa71f-94b8-4998-92d3-bb1ebe14c8e3 admin admin] PATH_INFO: `/v3/users` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:27.703403 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bfa71f-94b8-4998-92d3-bb1ebe14c8e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:27.705420 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bfa71f-94b8-4998-92d3-bb1ebe14c8e3 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:27.755731 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 849/1718] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 19 10:27:27 2022] POST /identity/v3/users => generated 290 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:27:27.756744 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bfa71f-94b8-4998-92d3-bb1ebe14c8e3 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:27.768766 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bfa71f-94b8-4998-92d3-bb1ebe14c8e3 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:27.776182 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 870/1719] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:27:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 10:27:27.777431 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044d559d-6014-4bf7-a4e3-1578c02ec9d7 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:27.777826 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044d559d-6014-4bf7-a4e3-1578c02ec9d7 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:27.778006 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044d559d-6014-4bf7-a4e3-1578c02ec9d7 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:27.779353 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 871/1720] 10.222.0.66 () {54 vars in 912 bytes} [Mon Sep 19 10:27:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:27:27.780043 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044d559d-6014-4bf7-a4e3-1578c02ec9d7 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:27.780972 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f52fae-954b-4282-9fe7-659b533cd3e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:27.781849 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f52fae-954b-4282-9fe7-659b533cd3e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:27.782366 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f52fae-954b-4282-9fe7-659b533cd3e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:27.792555 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f52fae-954b-4282-9fe7-659b533cd3e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:27.793423 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f52fae-954b-4282-9fe7-659b533cd3e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:27.796054 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f52fae-954b-4282-9fe7-659b533cd3e3 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:27.813051 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:27:27.822369 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 850/1721] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:27:27 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 10:27:27.827042 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c4a9e7-7019-4ffe-bac8-ef134fbc80ec None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:27.827323 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044d559d-6014-4bf7-a4e3-1578c02ec9d7 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:27.827433 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c4a9e7-7019-4ffe-bac8-ef134fbc80ec None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:27.827621 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c4a9e7-7019-4ffe-bac8-ef134fbc80ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:27.836636 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41023025-29ac-429a-b7e4-954c8dd0582a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:27.839061 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41023025-29ac-429a-b7e4-954c8dd0582a admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:27.839362 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41023025-29ac-429a-b7e4-954c8dd0582a admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:27.839643 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41023025-29ac-429a-b7e4-954c8dd0582a admin admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:27.840374 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41023025-29ac-429a-b7e4-954c8dd0582a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:27:27.841929 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41023025-29ac-429a-b7e4-954c8dd0582a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:27.849556 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41023025-29ac-429a-b7e4-954c8dd0582a admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:27.877324 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 872/1722] 10.222.0.66 () {58 vars in 1153 bytes} [Mon Sep 19 10:27:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:27:27.879270 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41023025-29ac-429a-b7e4-954c8dd0582a admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:27.893985 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41023025-29ac-429a-b7e4-954c8dd0582a admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:27.899372 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-a0c4a9e7-7019-4ffe-bac8-ef134fbc80ec None None] MFA Rules not processed for user `0c1289b015854c6bb6aee8fed6b807db`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:27:27.899583 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6540b240-28ea-47e1-940b-daa87ca6ed84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:27.900427 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6540b240-28ea-47e1-940b-daa87ca6ed84 admin admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:27.900732 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6540b240-28ea-47e1-940b-daa87ca6ed84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:27.901012 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6540b240-28ea-47e1-940b-daa87ca6ed84 admin admin] PATH_INFO: `/v3/projects/a36dedd2e2784d449e30fa4a49074a2e/users/0c142ec9f59c49a98a983c00bc38b1e9/roles/5c8b89fae4fa45bd944cbeaf442136e1` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:27.901245 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-a0c4a9e7-7019-4ffe-bac8-ef134fbc80ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:27.920679 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6540b240-28ea-47e1-940b-daa87ca6ed84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a36dedd2e2784d449e30fa4a49074a2e, user_id=0c142ec9f59c49a98a983c00bc38b1e9, role_id=5c8b89fae4fa45bd944cbeaf442136e1)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:27.924399 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6540b240-28ea-47e1-940b-daa87ca6ed84 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:27.951610 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 873/1723] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 19 10:27:27 2022] PUT /identity/v3/projects/a36dedd2e2784d449e30fa4a49074a2e/users/0c142ec9f59c49a98a983c00bc38b1e9/roles/5c8b89fae4fa45bd944cbeaf442136e1 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:27:27.951610 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f64ddd-580f-438a-9c78-ab40430b2612 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:27.951610 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f64ddd-580f-438a-9c78-ab40430b2612 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:27.951610 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f64ddd-580f-438a-9c78-ab40430b2612 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:27.952425 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 874/1724] 10.222.0.66 () {54 vars in 912 bytes} [Mon Sep 19 10:27:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:27:27.958865 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f64ddd-580f-438a-9c78-ab40430b2612 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:27.997716 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 851/1725] 10.222.0.66 () {58 vars in 1009 bytes} [Mon Sep 19 10:27:27 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:27:28.000432 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c4a9e7-7019-4ffe-bac8-ef134fbc80ec None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:28.031037 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c4a9e7-7019-4ffe-bac8-ef134fbc80ec None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:28.070820 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f64ddd-580f-438a-9c78-ab40430b2612 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:28.080075 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dd9430-6c5f-418f-8543-5b7d3e18ef43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:28.081548 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dd9430-6c5f-418f-8543-5b7d3e18ef43 admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:28.083234 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dd9430-6c5f-418f-8543-5b7d3e18ef43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:28.083559 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dd9430-6c5f-418f-8543-5b7d3e18ef43 admin admin] PATH_INFO: `/v3/projects` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:28.084245 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dd9430-6c5f-418f-8543-5b7d3e18ef43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:28.090809 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dd9430-6c5f-418f-8543-5b7d3e18ef43 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:28.128501 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b71e8c4-647e-48c4-95fe-a9979d41e66d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:28.129546 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b71e8c4-647e-48c4-95fe-a9979d41e66d admin admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:28.129833 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b71e8c4-647e-48c4-95fe-a9979d41e66d admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:28.130110 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b71e8c4-647e-48c4-95fe-a9979d41e66d admin admin] PATH_INFO: `/v3/roles` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:28.130777 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b71e8c4-647e-48c4-95fe-a9979d41e66d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:28.133029 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b71e8c4-647e-48c4-95fe-a9979d41e66d admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:28.135198 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:27:28.152132 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 852/1726] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:27:27 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 10:27:28.153705 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e772042-a9f8-40bd-9b0c-bf12f3fcf2ff None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:28.154009 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e772042-a9f8-40bd-9b0c-bf12f3fcf2ff None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:28.154447 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e772042-a9f8-40bd-9b0c-bf12f3fcf2ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:28.160779 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 875/1727] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 19 10:27:27 2022] POST /identity/v3/projects => generated 373 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:27:28.161702 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dd9430-6c5f-418f-8543-5b7d3e18ef43 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:28.163901 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-24dd9430-6c5f-418f-8543-5b7d3e18ef43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:28.198774 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-6e772042-a9f8-40bd-9b0c-bf12f3fcf2ff None None] MFA Rules not processed for user `0c1289b015854c6bb6aee8fed6b807db`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:27:28.201040 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-6e772042-a9f8-40bd-9b0c-bf12f3fcf2ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:28.236220 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dd9430-6c5f-418f-8543-5b7d3e18ef43 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:28.255063 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f5618c-7fd2-485c-846f-979884ecd20f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c1289b015854c6bb6aee8fed6b807db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:28.255742 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f5618c-7fd2-485c-846f-979884ecd20f service neutron] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:28.256034 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f5618c-7fd2-485c-846f-979884ecd20f service neutron] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:28.259733 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f5618c-7fd2-485c-846f-979884ecd20f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:28.274916 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f5618c-7fd2-485c-846f-979884ecd20f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:28.276507 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f5618c-7fd2-485c-846f-979884ecd20f service neutron] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:28.288598 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 853/1728] 10.222.0.66 () {58 vars in 1009 bytes} [Mon Sep 19 10:27:28 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:27:28.289305 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e772042-a9f8-40bd-9b0c-bf12f3fcf2ff None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:28.321517 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 876/1729] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:27:28 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:27:28.322507 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f5618c-7fd2-485c-846f-979884ecd20f service neutron] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:28.436663 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e772042-a9f8-40bd-9b0c-bf12f3fcf2ff None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:28.449239 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8ae5b3-a4c1-4caf-9637-47834332f332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:28.450372 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8ae5b3-a4c1-4caf-9637-47834332f332 admin admin] REQUEST_METHOD: `PUT` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:28.450840 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8ae5b3-a4c1-4caf-9637-47834332f332 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:28.451296 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8ae5b3-a4c1-4caf-9637-47834332f332 admin admin] PATH_INFO: `/v3/projects/a36dedd2e2784d449e30fa4a49074a2e/users/0c142ec9f59c49a98a983c00bc38b1e9/roles/5c8b89fae4fa45bd944cbeaf442136e1` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:28.456081 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8ae5b3-a4c1-4caf-9637-47834332f332 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a36dedd2e2784d449e30fa4a49074a2e, user_id=0c142ec9f59c49a98a983c00bc38b1e9, role_id=5c8b89fae4fa45bd944cbeaf442136e1)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:28.459419 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8ae5b3-a4c1-4caf-9637-47834332f332 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:28.475762 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:27:28.496482 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 854/1730] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 19 10:27:28 2022] PUT /identity/v3/projects/a36dedd2e2784d449e30fa4a49074a2e/users/0c142ec9f59c49a98a983c00bc38b1e9/roles/5c8b89fae4fa45bd944cbeaf442136e1 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:27:28.498475 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8ae5b3-a4c1-4caf-9637-47834332f332 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:28.500644 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-aa8ae5b3-a4c1-4caf-9637-47834332f332 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:28.517947 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f5618c-7fd2-485c-846f-979884ecd20f service neutron] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:28.601143 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8ae5b3-a4c1-4caf-9637-47834332f332 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:28.612294 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17119d54-4e48-4e5a-8505-49817e5d8363 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c1289b015854c6bb6aee8fed6b807db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:28.612740 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17119d54-4e48-4e5a-8505-49817e5d8363 service neutron] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:28.613062 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17119d54-4e48-4e5a-8505-49817e5d8363 service neutron] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:28.613339 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17119d54-4e48-4e5a-8505-49817e5d8363 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:28.624420 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17119d54-4e48-4e5a-8505-49817e5d8363 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:28.628638 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17119d54-4e48-4e5a-8505-49817e5d8363 service neutron] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:28.654659 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e017e28-aabc-468a-9d41-5f59b541ee36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:28.655293 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e017e28-aabc-468a-9d41-5f59b541ee36 admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:28.655578 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e017e28-aabc-468a-9d41-5f59b541ee36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:28.655854 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e017e28-aabc-468a-9d41-5f59b541ee36 admin admin] PATH_INFO: `/v3/users` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:28.656543 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e017e28-aabc-468a-9d41-5f59b541ee36 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:28.657624 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 855/1731] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:27:28 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:27:28.658673 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e017e28-aabc-468a-9d41-5f59b541ee36 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:28.662163 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45936501-1365-47ad-bcd5-c4043e428d70 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:28.662163 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45936501-1365-47ad-bcd5-c4043e428d70 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:28.662443 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45936501-1365-47ad-bcd5-c4043e428d70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:28.706852 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 877/1732] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 19 10:27:28 2022] POST /identity/v3/users => generated 287 bytes in 385 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:27:28.708410 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e017e28-aabc-468a-9d41-5f59b541ee36 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:28.714066 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-45936501-1365-47ad-bcd5-c4043e428d70 None None] MFA Rules not processed for user `0c142ec9f59c49a98a983c00bc38b1e9`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:27:28.714985 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-45936501-1365-47ad-bcd5-c4043e428d70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:28.731337 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e017e28-aabc-468a-9d41-5f59b541ee36 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:28.751344 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef34ba28-3d88-4f1f-b501-de53ba2604ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:28.751985 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef34ba28-3d88-4f1f-b501-de53ba2604ab admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:28.752311 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef34ba28-3d88-4f1f-b501-de53ba2604ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:28.752591 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef34ba28-3d88-4f1f-b501-de53ba2604ab admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:28.753253 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef34ba28-3d88-4f1f-b501-de53ba2604ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:28.755491 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef34ba28-3d88-4f1f-b501-de53ba2604ab admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:28.772920 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:27:28.783033 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 878/1733] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:27:28 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 10:27:28.786701 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef34ba28-3d88-4f1f-b501-de53ba2604ab admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:28.816593 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef34ba28-3d88-4f1f-b501-de53ba2604ab admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:28.827966 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077e646c-b93f-4b8e-a7ad-c4d35d9c4a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:28.828655 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077e646c-b93f-4b8e-a7ad-c4d35d9c4a79 admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:28.828942 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077e646c-b93f-4b8e-a7ad-c4d35d9c4a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:28.829223 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077e646c-b93f-4b8e-a7ad-c4d35d9c4a79 admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:28.829935 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077e646c-b93f-4b8e-a7ad-c4d35d9c4a79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:28.831559 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077e646c-b93f-4b8e-a7ad-c4d35d9c4a79 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:28.833016 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 856/1734] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:27:28 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:27:28.845778 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45936501-1365-47ad-bcd5-c4043e428d70 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:28.852754 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-45936501-1365-47ad-bcd5-c4043e428d70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:28.856821 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 879/1735] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:27:28 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 10:27:28.860285 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077e646c-b93f-4b8e-a7ad-c4d35d9c4a79 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:28.904017 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077e646c-b93f-4b8e-a7ad-c4d35d9c4a79 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:28.931027 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7822db44-ad2e-435e-b02b-d881191a5111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:28.933569 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7822db44-ad2e-435e-b02b-d881191a5111 admin admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:28.934201 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7822db44-ad2e-435e-b02b-d881191a5111 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:28.935911 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7822db44-ad2e-435e-b02b-d881191a5111 admin admin] PATH_INFO: `/v3/projects/110e858c19b04f41a48550efc103e0a8/users/66626e1b76b74b038126aabb57aa8608/roles/cd5b42ed3b754b58817a62bbe74651b4` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:28.995752 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7822db44-ad2e-435e-b02b-d881191a5111 admin admin] RBAC: Authorizing `identity:create_grant(project_id=110e858c19b04f41a48550efc103e0a8, user_id=66626e1b76b74b038126aabb57aa8608, role_id=cd5b42ed3b754b58817a62bbe74651b4)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:28.998031 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45936501-1365-47ad-bcd5-c4043e428d70 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:29.006262 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7822db44-ad2e-435e-b02b-d881191a5111 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:29.008534 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfe6ec7-f4f8-4edb-a1ad-652457b55999 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa4d004fd44482cae761c4b3bdfab31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:29.009287 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfe6ec7-f4f8-4edb-a1ad-652457b55999 service cinder] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:29.011112 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfe6ec7-f4f8-4edb-a1ad-652457b55999 service cinder] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:29.011516 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfe6ec7-f4f8-4edb-a1ad-652457b55999 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:29.047226 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 880/1736] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 19 10:27:28 2022] PUT /identity/v3/projects/110e858c19b04f41a48550efc103e0a8/users/66626e1b76b74b038126aabb57aa8608/roles/cd5b42ed3b754b58817a62bbe74651b4 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:27:29.054140 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfe6ec7-f4f8-4edb-a1ad-652457b55999 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:29.060070 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfe6ec7-f4f8-4edb-a1ad-652457b55999 service cinder] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:29.060672 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53501027-cc31-4596-add6-487f05e51495 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:29.061689 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53501027-cc31-4596-add6-487f05e51495 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:29.061689 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53501027-cc31-4596-add6-487f05e51495 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:29.101592 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-53501027-cc31-4596-add6-487f05e51495 None None] MFA Rules not processed for user `66626e1b76b74b038126aabb57aa8608`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:27:29.103250 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-53501027-cc31-4596-add6-487f05e51495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:29.103376 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 857/1737] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:27:28 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:27:29.120729 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfe6ec7-f4f8-4edb-a1ad-652457b55999 service cinder] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:29.123966 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-fcfe6ec7-f4f8-4edb-a1ad-652457b55999 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:29.268248 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 881/1738] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:27:29 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 10:27:29.277172 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53501027-cc31-4596-add6-487f05e51495 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:29.366701 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfe6ec7-f4f8-4edb-a1ad-652457b55999 service cinder] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:29.417568 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:27:29.514511 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53501027-cc31-4596-add6-487f05e51495 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:29.532978 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f723579-e737-4050-b127-9435ef14fa6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:29.534432 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f723579-e737-4050-b127-9435ef14fa6d admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:29.538681 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f723579-e737-4050-b127-9435ef14fa6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:29.539756 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f723579-e737-4050-b127-9435ef14fa6d admin admin] PATH_INFO: `/v3/projects` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:29.540608 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f723579-e737-4050-b127-9435ef14fa6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:29.544533 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb1d43b-7802-4d45-9a3b-3a2f8067d80e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15c70bfb085a44e9b84942b480ff22f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:29.545987 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb1d43b-7802-4d45-9a3b-3a2f8067d80e service nova] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:29.548061 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb1d43b-7802-4d45-9a3b-3a2f8067d80e service nova] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:29.549081 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb1d43b-7802-4d45-9a3b-3a2f8067d80e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:29.550727 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f723579-e737-4050-b127-9435ef14fa6d admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:29.553889 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-4bb1d43b-7802-4d45-9a3b-3a2f8067d80e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:29.569629 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:27:29.661990 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 882/1739] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 19 10:27:29 2022] POST /identity/v3/projects => generated 373 bytes in 384 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:27:29.661990 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f723579-e737-4050-b127-9435ef14fa6d admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:29.664524 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-6f723579-e737-4050-b127-9435ef14fa6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:29.789164 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb1d43b-7802-4d45-9a3b-3a2f8067d80e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:29.793033 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb1d43b-7802-4d45-9a3b-3a2f8067d80e service nova] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:29.824753 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 858/1740] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:27:29 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 705 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:27:29.825997 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb1d43b-7802-4d45-9a3b-3a2f8067d80e service nova] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:29.828407 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-4bb1d43b-7802-4d45-9a3b-3a2f8067d80e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:29.843844 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb1d43b-7802-4d45-9a3b-3a2f8067d80e service nova] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:29.865080 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f723579-e737-4050-b127-9435ef14fa6d admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:29.877162 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0133db33-42a9-47fb-99d1-08012b82e55a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46b78120cac64f09bd0f4cdc42424163', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:29.877884 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0133db33-42a9-47fb-99d1-08012b82e55a service placement] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:29.878236 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0133db33-42a9-47fb-99d1-08012b82e55a service placement] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:29.878581 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0133db33-42a9-47fb-99d1-08012b82e55a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:29.883242 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-0133db33-42a9-47fb-99d1-08012b82e55a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:29.908273 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0133db33-42a9-47fb-99d1-08012b82e55a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:29.910095 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0133db33-42a9-47fb-99d1-08012b82e55a service placement] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:29.925162 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 883/1741] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:27:29 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:27:29.926239 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0133db33-42a9-47fb-99d1-08012b82e55a service placement] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:29.982575 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0d4563-80d1-4060-90a6-e1c5d66a014a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:29.983404 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0d4563-80d1-4060-90a6-e1c5d66a014a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:29.983696 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0d4563-80d1-4060-90a6-e1c5d66a014a admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:29.983972 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0d4563-80d1-4060-90a6-e1c5d66a014a admin admin] PATH_INFO: `/v3/users/f191664ba8fa4c25a26a3ce22e85915f` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:29.985315 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0d4563-80d1-4060-90a6-e1c5d66a014a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f191664ba8fa4c25a26a3ce22e85915f)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:29.991376 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0d4563-80d1-4060-90a6-e1c5d66a014a admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:30.053909 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0133db33-42a9-47fb-99d1-08012b82e55a service placement] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:30.071905 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460a6be0-cc2f-4c57-9f1a-8ea5407c25cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:30.072765 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460a6be0-cc2f-4c57-9f1a-8ea5407c25cc admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:30.072765 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460a6be0-cc2f-4c57-9f1a-8ea5407c25cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:30.072979 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460a6be0-cc2f-4c57-9f1a-8ea5407c25cc admin admin] PATH_INFO: `/v3/users` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:30.073760 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460a6be0-cc2f-4c57-9f1a-8ea5407c25cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:30.081068 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460a6be0-cc2f-4c57-9f1a-8ea5407c25cc admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:30.134594 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 884/1742] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 19 10:27:29 2022] POST /identity/v3/users => generated 293 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:27:30.136218 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b2f2e8-7038-4c31-9e14-e80a553aa835 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:30.136512 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b2f2e8-7038-4c31-9e14-e80a553aa835 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:30.136788 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b2f2e8-7038-4c31-9e14-e80a553aa835 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:30.145855 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 885/1743] 10.222.0.66 () {54 vars in 961 bytes} [Mon Sep 19 10:27:30 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:27:30.148658 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b2f2e8-7038-4c31-9e14-e80a553aa835 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:30.151253 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-63b2f2e8-7038-4c31-9e14-e80a553aa835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:30.164009 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-fc0d4563-80d1-4060-90a6-e1c5d66a014a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f191664ba8fa4c25a26a3ce22e85915f'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:30.185292 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b2f2e8-7038-4c31-9e14-e80a553aa835 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:30.194848 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-fc0d4563-80d1-4060-90a6-e1c5d66a014a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f191664ba8fa4c25a26a3ce22e85915f'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:30.195602 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-fc0d4563-80d1-4060-90a6-e1c5d66a014a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f191664ba8fa4c25a26a3ce22e85915f'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:30.200707 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-fc0d4563-80d1-4060-90a6-e1c5d66a014a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f191664ba8fa4c25a26a3ce22e85915f'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:30.208417 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa57af3b-7c28-449b-bca6-c93a3bcaeb77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:30.209085 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa57af3b-7c28-449b-bca6-c93a3bcaeb77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:30.209371 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa57af3b-7c28-449b-bca6-c93a3bcaeb77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:30.210375 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa57af3b-7c28-449b-bca6-c93a3bcaeb77 admin admin] PATH_INFO: `/v3/users/204ec2e4c24b43299099b9b0346683e1` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:30.212372 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa57af3b-7c28-449b-bca6-c93a3bcaeb77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=204ec2e4c24b43299099b9b0346683e1)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:30.215816 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa57af3b-7c28-449b-bca6-c93a3bcaeb77 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:30.220338 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-fc0d4563-80d1-4060-90a6-e1c5d66a014a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f191664ba8fa4c25a26a3ce22e85915f'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:30.322821 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 859/1744] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 19 10:27:29 2022] DELETE /identity/v3/users/f191664ba8fa4c25a26a3ce22e85915f => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:27:30.324797 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0d4563-80d1-4060-90a6-e1c5d66a014a admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:30.326926 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-fc0d4563-80d1-4060-90a6-e1c5d66a014a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:30.346767 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=91,keystone:INSERT=4,keystone:DELETE=5 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:27:30.411660 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-aa57af3b-7c28-449b-bca6-c93a3bcaeb77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '204ec2e4c24b43299099b9b0346683e1'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:30.429278 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-aa57af3b-7c28-449b-bca6-c93a3bcaeb77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '204ec2e4c24b43299099b9b0346683e1'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:30.430422 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-aa57af3b-7c28-449b-bca6-c93a3bcaeb77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '204ec2e4c24b43299099b9b0346683e1'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:30.432108 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-aa57af3b-7c28-449b-bca6-c93a3bcaeb77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '204ec2e4c24b43299099b9b0346683e1'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:30.459441 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-aa57af3b-7c28-449b-bca6-c93a3bcaeb77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '204ec2e4c24b43299099b9b0346683e1'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:30.551285 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 886/1745] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 19 10:27:30 2022] DELETE /identity/v3/users/204ec2e4c24b43299099b9b0346683e1 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:27:30.551285 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4c5322-2d25-46de-bf24-394ed0ae8a08 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:30.551285 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4c5322-2d25-46de-bf24-394ed0ae8a08 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:30.551285 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4c5322-2d25-46de-bf24-394ed0ae8a08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:30.553126 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:27:30.604671 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-7b4c5322-2d25-46de-bf24-394ed0ae8a08 None None] MFA Rules not processed for user `46b78120cac64f09bd0f4cdc42424163`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:27:30.608750 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-7b4c5322-2d25-46de-bf24-394ed0ae8a08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:30.661343 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0d4563-80d1-4060-90a6-e1c5d66a014a admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:30.860987 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 887/1746] 10.222.0.66 () {58 vars in 1058 bytes} [Mon Sep 19 10:27:30 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:27:30.875999 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9298df84-25d7-470a-8356-6a66691592cd None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:30.875999 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9298df84-25d7-470a-8356-6a66691592cd None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:30.878919 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9298df84-25d7-470a-8356-6a66691592cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:30.905222 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1719cf8d-287f-4026-85f9-0a810226c3a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:30.907028 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1719cf8d-287f-4026-85f9-0a810226c3a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:30.907319 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1719cf8d-287f-4026-85f9-0a810226c3a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:30.907598 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1719cf8d-287f-4026-85f9-0a810226c3a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:30.910666 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1719cf8d-287f-4026-85f9-0a810226c3a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:30.918407 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1719cf8d-287f-4026-85f9-0a810226c3a6 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:30.924763 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-9298df84-25d7-470a-8356-6a66691592cd None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:27:30.926299 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-9298df84-25d7-470a-8356-6a66691592cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:30.939388 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 888/1747] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:27:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:27:30.940721 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc12706-b62d-4ddf-b2c0-b1f23d961030 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:30.941011 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc12706-b62d-4ddf-b2c0-b1f23d961030 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:30.943443 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc12706-b62d-4ddf-b2c0-b1f23d961030 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:30.960368 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 860/1748] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:27:30 2022] GET /identity/v3/roles => generated 1420 bytes in 636 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 10:27:30.977836 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24521ca6-8476-47c2-b71a-1a71b6038147 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:30.978235 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24521ca6-8476-47c2-b71a-1a71b6038147 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:30.978441 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24521ca6-8476-47c2-b71a-1a71b6038147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:30.991827 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-3bc12706-b62d-4ddf-b2c0-b1f23d961030 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:27:31.006634 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-3bc12706-b62d-4ddf-b2c0-b1f23d961030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:31.012238 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-24521ca6-8476-47c2-b71a-1a71b6038147 None None] MFA Rules not processed for user `e62a6e400ad7425f9217164bc9190a21`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:27:31.013899 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-24521ca6-8476-47c2-b71a-1a71b6038147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:31.030174 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 889/1749] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:27:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:27:31.031082 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc12706-b62d-4ddf-b2c0-b1f23d961030 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:31.067956 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc12706-b62d-4ddf-b2c0-b1f23d961030 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:31.077860 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb5b149-6dbf-42aa-8092-1842abeb7890 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46b78120cac64f09bd0f4cdc42424163', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:31.078857 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb5b149-6dbf-42aa-8092-1842abeb7890 service placement] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:31.078857 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb5b149-6dbf-42aa-8092-1842abeb7890 service placement] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:31.079088 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb5b149-6dbf-42aa-8092-1842abeb7890 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:31.087741 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-fcb5b149-6dbf-42aa-8092-1842abeb7890 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:31.115003 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb5b149-6dbf-42aa-8092-1842abeb7890 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:31.129063 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb5b149-6dbf-42aa-8092-1842abeb7890 service placement] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:31.155512 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 890/1750] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:27:31 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:27:31.157129 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 861/1751] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:27:30 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:27:31.158448 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24521ca6-8476-47c2-b71a-1a71b6038147 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:31.179662 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-24521ca6-8476-47c2-b71a-1a71b6038147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:31.184302 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb5b149-6dbf-42aa-8092-1842abeb7890 service placement] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:31.188422 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-fcb5b149-6dbf-42aa-8092-1842abeb7890 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:31.248838 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24521ca6-8476-47c2-b71a-1a71b6038147 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:31.275718 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525935e2-6e95-4c97-81d1-0868872ceb8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:31.280649 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525935e2-6e95-4c97-81d1-0868872ceb8d admin admin] REQUEST_METHOD: `PUT` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:31.280649 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525935e2-6e95-4c97-81d1-0868872ceb8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:31.282082 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525935e2-6e95-4c97-81d1-0868872ceb8d admin admin] PATH_INFO: `/v3/projects/0d3d99db253b4c6aa5b62e1b08c3e0e6/users/db0511f828504cf18c5865a253e498b8/roles/5c8b89fae4fa45bd944cbeaf442136e1` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:31.347629 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525935e2-6e95-4c97-81d1-0868872ceb8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d3d99db253b4c6aa5b62e1b08c3e0e6, user_id=db0511f828504cf18c5865a253e498b8, role_id=5c8b89fae4fa45bd944cbeaf442136e1)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:31.367648 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525935e2-6e95-4c97-81d1-0868872ceb8d admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:31.375724 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb5b149-6dbf-42aa-8092-1842abeb7890 service placement] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:31.397023 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912e5fed-5024-4431-8f9e-868ec509b8e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c1289b015854c6bb6aee8fed6b807db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:31.397931 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912e5fed-5024-4431-8f9e-868ec509b8e6 service neutron] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:31.399897 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912e5fed-5024-4431-8f9e-868ec509b8e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:31.400461 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912e5fed-5024-4431-8f9e-868ec509b8e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:31.424224 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 862/1752] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 19 10:27:31 2022] PUT /identity/v3/projects/0d3d99db253b4c6aa5b62e1b08c3e0e6/users/db0511f828504cf18c5865a253e498b8/roles/5c8b89fae4fa45bd944cbeaf442136e1 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:27:31.425965 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525935e2-6e95-4c97-81d1-0868872ceb8d admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:31.442391 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912e5fed-5024-4431-8f9e-868ec509b8e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:31.442564 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-525935e2-6e95-4c97-81d1-0868872ceb8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:31.446244 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912e5fed-5024-4431-8f9e-868ec509b8e6 service neutron] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:31.470972 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 891/1753] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:27:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:27:31.472142 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912e5fed-5024-4431-8f9e-868ec509b8e6 service neutron] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:31.495786 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912e5fed-5024-4431-8f9e-868ec509b8e6 service neutron] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:31.529596 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:27:31.654908 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab110230-210a-4b66-a7f4-ccdc79bfd3b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:31.656844 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab110230-210a-4b66-a7f4-ccdc79bfd3b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:31.657136 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab110230-210a-4b66-a7f4-ccdc79bfd3b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:31.659360 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab110230-210a-4b66-a7f4-ccdc79bfd3b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:31.661418 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab110230-210a-4b66-a7f4-ccdc79bfd3b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:31.673773 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab110230-210a-4b66-a7f4-ccdc79bfd3b3 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:31.721784 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 892/1754] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:27:31 2022] GET /identity/v3/roles => generated 1420 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 10:27:31.723074 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab110230-210a-4b66-a7f4-ccdc79bfd3b3 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:31.752067 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab110230-210a-4b66-a7f4-ccdc79bfd3b3 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:31.763784 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:27:31.771104 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76826c97-2e3d-47a5-bc99-001dab73a076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:31.773049 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76826c97-2e3d-47a5-bc99-001dab73a076 admin admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:31.774834 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76826c97-2e3d-47a5-bc99-001dab73a076 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:31.775786 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76826c97-2e3d-47a5-bc99-001dab73a076 admin admin] PATH_INFO: `/v3/projects/0d3d99db253b4c6aa5b62e1b08c3e0e6/users/db0511f828504cf18c5865a253e498b8/roles/5c8b89fae4fa45bd944cbeaf442136e1` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:31.790128 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525935e2-6e95-4c97-81d1-0868872ceb8d admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:31.794508 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76826c97-2e3d-47a5-bc99-001dab73a076 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d3d99db253b4c6aa5b62e1b08c3e0e6, user_id=db0511f828504cf18c5865a253e498b8, role_id=5c8b89fae4fa45bd944cbeaf442136e1)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:31.803355 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533f0529-9ab0-4448-b933-d6403cd58f64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c1289b015854c6bb6aee8fed6b807db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:31.804004 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533f0529-9ab0-4448-b933-d6403cd58f64 service neutron] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:31.804313 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533f0529-9ab0-4448-b933-d6403cd58f64 service neutron] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:31.804589 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533f0529-9ab0-4448-b933-d6403cd58f64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:31.811809 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76826c97-2e3d-47a5-bc99-001dab73a076 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:31.839092 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533f0529-9ab0-4448-b933-d6403cd58f64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:31.842411 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533f0529-9ab0-4448-b933-d6403cd58f64 service neutron] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:31.885203 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 863/1756] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:27:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:27:31.885693 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 893/1756] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 19 10:27:31 2022] PUT /identity/v3/projects/0d3d99db253b4c6aa5b62e1b08c3e0e6/users/db0511f828504cf18c5865a253e498b8/roles/5c8b89fae4fa45bd944cbeaf442136e1 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:27:31.886516 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6a464f-6440-4340-a5d9-a5c520289b74 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:31.886804 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6a464f-6440-4340-a5d9-a5c520289b74 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:31.887075 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6a464f-6440-4340-a5d9-a5c520289b74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:31.964978 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-9f6a464f-6440-4340-a5d9-a5c520289b74 None None] MFA Rules not processed for user `db0511f828504cf18c5865a253e498b8`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:27:31.966784 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-9f6a464f-6440-4340-a5d9-a5c520289b74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:32.196081 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 864/1757] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:27:31 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:27:32.208629 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76826c97-2e3d-47a5-bc99-001dab73a076 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:32.210521 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-76826c97-2e3d-47a5-bc99-001dab73a076 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:32.395656 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76826c97-2e3d-47a5-bc99-001dab73a076 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:32.407788 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f05a6a-26fd-4770-b74c-f75e17cf56ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa4d004fd44482cae761c4b3bdfab31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:32.408892 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f05a6a-26fd-4770-b74c-f75e17cf56ee service cinder] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:32.411465 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f05a6a-26fd-4770-b74c-f75e17cf56ee service cinder] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:32.411961 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f05a6a-26fd-4770-b74c-f75e17cf56ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:32.436582 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f05a6a-26fd-4770-b74c-f75e17cf56ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:32.439712 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f05a6a-26fd-4770-b74c-f75e17cf56ee service cinder] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:32.485558 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 894/1758] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:27:32 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:27:32.509235 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6a464f-6440-4340-a5d9-a5c520289b74 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:32.510754 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-9f6a464f-6440-4340-a5d9-a5c520289b74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:32.633313 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f05a6a-26fd-4770-b74c-f75e17cf56ee service cinder] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:32.634778 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-d4f05a6a-26fd-4770-b74c-f75e17cf56ee service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:32.718790 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6a464f-6440-4340-a5d9-a5c520289b74 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:32.732916 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f908221-a307-4310-8279-fc8905c84fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:32.734116 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f908221-a307-4310-8279-fc8905c84fac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:32.734618 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f908221-a307-4310-8279-fc8905c84fac admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:32.735353 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f908221-a307-4310-8279-fc8905c84fac admin admin] PATH_INFO: `/v3/projects/a29fc9cddbf54689a3111f26dd8051cb` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:32.738022 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f908221-a307-4310-8279-fc8905c84fac admin admin] RBAC: Authorizing `identity:delete_project(project_id=a29fc9cddbf54689a3111f26dd8051cb)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:32.740686 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f908221-a307-4310-8279-fc8905c84fac admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:32.848802 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f05a6a-26fd-4770-b74c-f75e17cf56ee service cinder] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:32.860248 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a44278-ff02-4941-b740-630d43a8df76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:32.861269 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a44278-ff02-4941-b740-630d43a8df76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:32.861560 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a44278-ff02-4941-b740-630d43a8df76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:32.861842 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a44278-ff02-4941-b740-630d43a8df76 admin admin] PATH_INFO: `/v3/users/c68b3b24dcb2428a8cb081863a83d8dd` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:32.868777 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a44278-ff02-4941-b740-630d43a8df76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c68b3b24dcb2428a8cb081863a83d8dd)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:32.870962 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a44278-ff02-4941-b740-630d43a8df76 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:32.946520 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-9f908221-a307-4310-8279-fc8905c84fac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a29fc9cddbf54689a3111f26dd8051cb', 'request_id': 'req-9f908221-a307-4310-8279-fc8905c84fac'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:32.973483 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-9f908221-a307-4310-8279-fc8905c84fac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a29fc9cddbf54689a3111f26dd8051cb', 'request_id': 'req-9f908221-a307-4310-8279-fc8905c84fac'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:33.008488 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-14a44278-ff02-4941-b740-630d43a8df76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c68b3b24dcb2428a8cb081863a83d8dd'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:33.012195 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-9f908221-a307-4310-8279-fc8905c84fac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a29fc9cddbf54689a3111f26dd8051cb', 'request_id': 'req-9f908221-a307-4310-8279-fc8905c84fac'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:33.013684 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:27:33.026265 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-14a44278-ff02-4941-b740-630d43a8df76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c68b3b24dcb2428a8cb081863a83d8dd'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:33.027144 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-14a44278-ff02-4941-b740-630d43a8df76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c68b3b24dcb2428a8cb081863a83d8dd'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:33.027798 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-14a44278-ff02-4941-b740-630d43a8df76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c68b3b24dcb2428a8cb081863a83d8dd'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:33.044659 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-9f908221-a307-4310-8279-fc8905c84fac admin admin] The token cache is being invalidate because project a29fc9cddbf54689a3111f26dd8051cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 10:27:33.044659 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-9f908221-a307-4310-8279-fc8905c84fac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:33.046165 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-14a44278-ff02-4941-b740-630d43a8df76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c68b3b24dcb2428a8cb081863a83d8dd'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:33.048096 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-9f908221-a307-4310-8279-fc8905c84fac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:33.050518 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 865/1759] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 19 10:27:32 2022] DELETE /identity/v3/projects/a29fc9cddbf54689a3111f26dd8051cb => generated 0 bytes in 542 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:27:33.054724 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f908221-a307-4310-8279-fc8905c84fac admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:33.054724 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-9f908221-a307-4310-8279-fc8905c84fac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:33.095044 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:27:33.107771 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 895/1760] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 19 10:27:32 2022] DELETE /identity/v3/users/c68b3b24dcb2428a8cb081863a83d8dd => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:27:33.112536 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a44278-ff02-4941-b740-630d43a8df76 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:33.124757 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-14a44278-ff02-4941-b740-630d43a8df76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:33.189758 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f908221-a307-4310-8279-fc8905c84fac admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:33.298551 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a44278-ff02-4941-b740-630d43a8df76 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:33.320300 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921ffc9a-af9f-4fcc-b9a4-1ff219da2282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:33.322292 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921ffc9a-af9f-4fcc-b9a4-1ff219da2282 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:33.324234 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921ffc9a-af9f-4fcc-b9a4-1ff219da2282 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:33.324538 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921ffc9a-af9f-4fcc-b9a4-1ff219da2282 admin admin] PATH_INFO: `/v3/users/2c3cd8f8cbb145f5bd2cb526ef150638` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:33.329129 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921ffc9a-af9f-4fcc-b9a4-1ff219da2282 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c3cd8f8cbb145f5bd2cb526ef150638)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:33.335644 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921ffc9a-af9f-4fcc-b9a4-1ff219da2282 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:33.337424 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1c5f6e-3cdb-46e9-a9fd-2f24eb452682 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa4d004fd44482cae761c4b3bdfab31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:33.339948 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1c5f6e-3cdb-46e9-a9fd-2f24eb452682 service cinder] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:33.340984 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1c5f6e-3cdb-46e9-a9fd-2f24eb452682 service cinder] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:33.341465 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1c5f6e-3cdb-46e9-a9fd-2f24eb452682 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:33.346467 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-9f1c5f6e-3cdb-46e9-a9fd-2f24eb452682 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:33.485417 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-921ffc9a-af9f-4fcc-b9a4-1ff219da2282 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c3cd8f8cbb145f5bd2cb526ef150638'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:33.486160 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1c5f6e-3cdb-46e9-a9fd-2f24eb452682 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:33.488324 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1c5f6e-3cdb-46e9-a9fd-2f24eb452682 service cinder] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:33.501944 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 866/1761] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:27:33 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:27:33.503002 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db99c966-4911-4c79-8166-7bcccf8035d2 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:33.503409 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db99c966-4911-4c79-8166-7bcccf8035d2 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:33.503754 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db99c966-4911-4c79-8166-7bcccf8035d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:33.508619 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-921ffc9a-af9f-4fcc-b9a4-1ff219da2282 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c3cd8f8cbb145f5bd2cb526ef150638'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:33.512099 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-921ffc9a-af9f-4fcc-b9a4-1ff219da2282 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c3cd8f8cbb145f5bd2cb526ef150638'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:33.513578 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-921ffc9a-af9f-4fcc-b9a4-1ff219da2282 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c3cd8f8cbb145f5bd2cb526ef150638'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:33.526461 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-db99c966-4911-4c79-8166-7bcccf8035d2 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:27:33.528661 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-db99c966-4911-4c79-8166-7bcccf8035d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:33.537689 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 867/1762] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:27:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:27:33.549015 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-921ffc9a-af9f-4fcc-b9a4-1ff219da2282 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c3cd8f8cbb145f5bd2cb526ef150638'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:33.550844 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db99c966-4911-4c79-8166-7bcccf8035d2 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:33.552893 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-db99c966-4911-4c79-8166-7bcccf8035d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:33.587538 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 896/1763] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 19 10:27:33 2022] DELETE /identity/v3/users/2c3cd8f8cbb145f5bd2cb526ef150638 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:27:33.675305 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db99c966-4911-4c79-8166-7bcccf8035d2 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:33.734640 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:27:33.788732 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadf5559-c410-4646-a32c-cadb476991ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c1289b015854c6bb6aee8fed6b807db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:33.789389 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadf5559-c410-4646-a32c-cadb476991ee service neutron] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:33.789667 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadf5559-c410-4646-a32c-cadb476991ee service neutron] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:33.789938 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadf5559-c410-4646-a32c-cadb476991ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:33.974956 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadf5559-c410-4646-a32c-cadb476991ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:33.976711 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadf5559-c410-4646-a32c-cadb476991ee service neutron] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:34.025395 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 868/1764] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:27:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 10:27:34.337330 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921ffc9a-af9f-4fcc-b9a4-1ff219da2282 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:34.338939 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-921ffc9a-af9f-4fcc-b9a4-1ff219da2282 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:34.363078 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921ffc9a-af9f-4fcc-b9a4-1ff219da2282 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:34.380990 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be882ee-5280-470d-9a51-62337cb96329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:34.383188 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be882ee-5280-470d-9a51-62337cb96329 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:34.383188 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be882ee-5280-470d-9a51-62337cb96329 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:34.383188 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be882ee-5280-470d-9a51-62337cb96329 admin admin] PATH_INFO: `/v3/projects/f2463dad7d57409aad467508aaa0be9f` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:34.397830 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be882ee-5280-470d-9a51-62337cb96329 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2463dad7d57409aad467508aaa0be9f)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:34.402407 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be882ee-5280-470d-9a51-62337cb96329 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:34.504734 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:DELETE=16,keystone:SELECT=83,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:27:34.530090 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-0be882ee-5280-470d-9a51-62337cb96329 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2463dad7d57409aad467508aaa0be9f', 'request_id': 'req-0be882ee-5280-470d-9a51-62337cb96329'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:34.546163 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-0be882ee-5280-470d-9a51-62337cb96329 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2463dad7d57409aad467508aaa0be9f', 'request_id': 'req-0be882ee-5280-470d-9a51-62337cb96329'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:34.578943 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-0be882ee-5280-470d-9a51-62337cb96329 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2463dad7d57409aad467508aaa0be9f', 'request_id': 'req-0be882ee-5280-470d-9a51-62337cb96329'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:34.612187 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-0be882ee-5280-470d-9a51-62337cb96329 admin admin] The token cache is being invalidate because project f2463dad7d57409aad467508aaa0be9f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 10:27:34.614612 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-0be882ee-5280-470d-9a51-62337cb96329 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:34.616992 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-0be882ee-5280-470d-9a51-62337cb96329 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:34.625554 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadf5559-c410-4646-a32c-cadb476991ee service neutron] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:34.626074 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 897/1765] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 19 10:27:34 2022] DELETE /identity/v3/projects/f2463dad7d57409aad467508aaa0be9f => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:27:34.643102 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadf5559-c410-4646-a32c-cadb476991ee service neutron] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:34.836767 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52797506-1e76-4e6d-936a-4571b74672fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:34.837700 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52797506-1e76-4e6d-936a-4571b74672fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:34.837917 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52797506-1e76-4e6d-936a-4571b74672fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:34.839524 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52797506-1e76-4e6d-936a-4571b74672fc admin admin] PATH_INFO: `/v3/users/b408912b9d4c4641b7bd80766661f6f5` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:34.842243 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52797506-1e76-4e6d-936a-4571b74672fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=b408912b9d4c4641b7bd80766661f6f5)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:34.846950 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52797506-1e76-4e6d-936a-4571b74672fc admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:34.947437 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-52797506-1e76-4e6d-936a-4571b74672fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b408912b9d4c4641b7bd80766661f6f5'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:34.964861 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-52797506-1e76-4e6d-936a-4571b74672fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b408912b9d4c4641b7bd80766661f6f5'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:34.966126 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-52797506-1e76-4e6d-936a-4571b74672fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b408912b9d4c4641b7bd80766661f6f5'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:34.967910 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-52797506-1e76-4e6d-936a-4571b74672fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b408912b9d4c4641b7bd80766661f6f5'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:34.988447 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-52797506-1e76-4e6d-936a-4571b74672fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b408912b9d4c4641b7bd80766661f6f5'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:35.009589 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:27:35.030795 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 869/1766] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 19 10:27:34 2022] DELETE /identity/v3/users/b408912b9d4c4641b7bd80766661f6f5 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:27:35.155021 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be882ee-5280-470d-9a51-62337cb96329 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:35.156943 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-0be882ee-5280-470d-9a51-62337cb96329 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:35.196548 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be882ee-5280-470d-9a51-62337cb96329 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:35.314534 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755364b4-0041-4608-a715-ea51355b3e0b None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:35.314943 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755364b4-0041-4608-a715-ea51355b3e0b None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:35.315359 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755364b4-0041-4608-a715-ea51355b3e0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:35.373830 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97d88d2-4d89-4f7f-bfe9-5559c46ff06a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:35.376300 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97d88d2-4d89-4f7f-bfe9-5559c46ff06a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:35.378667 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97d88d2-4d89-4f7f-bfe9-5559c46ff06a admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:35.382500 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97d88d2-4d89-4f7f-bfe9-5559c46ff06a admin admin] PATH_INFO: `/v3/projects/dd3e9e87e86a4ee5b41318e873af45d3` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:35.385031 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97d88d2-4d89-4f7f-bfe9-5559c46ff06a admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd3e9e87e86a4ee5b41318e873af45d3)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:35.393363 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97d88d2-4d89-4f7f-bfe9-5559c46ff06a admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:35.401982 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-755364b4-0041-4608-a715-ea51355b3e0b None None] MFA Rules not processed for user `e4d1160b71a84e2fa44a8ca6edf1846e`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:27:35.405084 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-755364b4-0041-4608-a715-ea51355b3e0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:35.504129 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-b97d88d2-4d89-4f7f-bfe9-5559c46ff06a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd3e9e87e86a4ee5b41318e873af45d3', 'request_id': 'req-b97d88d2-4d89-4f7f-bfe9-5559c46ff06a'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:35.519583 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-b97d88d2-4d89-4f7f-bfe9-5559c46ff06a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd3e9e87e86a4ee5b41318e873af45d3', 'request_id': 'req-b97d88d2-4d89-4f7f-bfe9-5559c46ff06a'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:35.550334 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-b97d88d2-4d89-4f7f-bfe9-5559c46ff06a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd3e9e87e86a4ee5b41318e873af45d3', 'request_id': 'req-b97d88d2-4d89-4f7f-bfe9-5559c46ff06a'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:35.571330 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-b97d88d2-4d89-4f7f-bfe9-5559c46ff06a admin admin] The token cache is being invalidate because project dd3e9e87e86a4ee5b41318e873af45d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 10:27:35.571742 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-b97d88d2-4d89-4f7f-bfe9-5559c46ff06a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:35.574096 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-b97d88d2-4d89-4f7f-bfe9-5559c46ff06a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:35.579650 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 898/1767] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 19 10:27:35 2022] DELETE /identity/v3/projects/dd3e9e87e86a4ee5b41318e873af45d3 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:27:35.581835 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97d88d2-4d89-4f7f-bfe9-5559c46ff06a admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:35.585124 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 870/1768] 10.222.0.66 () {58 vars in 1009 bytes} [Mon Sep 19 10:27:35 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 10:27:35.587031 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-b97d88d2-4d89-4f7f-bfe9-5559c46ff06a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:35.589392 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755364b4-0041-4608-a715-ea51355b3e0b None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:35.597589 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-755364b4-0041-4608-a715-ea51355b3e0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:35.647488 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755364b4-0041-4608-a715-ea51355b3e0b None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:35.783506 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58588a6d-0841-4a78-9c15-7c6bc5577c2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:35.784353 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58588a6d-0841-4a78-9c15-7c6bc5577c2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:35.784703 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58588a6d-0841-4a78-9c15-7c6bc5577c2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:35.785121 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58588a6d-0841-4a78-9c15-7c6bc5577c2c admin admin] PATH_INFO: `/v3/users/0c142ec9f59c49a98a983c00bc38b1e9` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:35.786372 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97d88d2-4d89-4f7f-bfe9-5559c46ff06a admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:35.786515 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58588a6d-0841-4a78-9c15-7c6bc5577c2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c142ec9f59c49a98a983c00bc38b1e9)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:35.789448 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58588a6d-0841-4a78-9c15-7c6bc5577c2c admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:35.813932 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b5c61a-789d-4f06-bc07-df391fe39b1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:35.817431 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b5c61a-789d-4f06-bc07-df391fe39b1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:35.818151 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b5c61a-789d-4f06-bc07-df391fe39b1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:35.818584 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b5c61a-789d-4f06-bc07-df391fe39b1b admin admin] PATH_INFO: `/v3/projects/8d2d9f5d04fa45e8a708037d9679df63` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:35.820689 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b5c61a-789d-4f06-bc07-df391fe39b1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d2d9f5d04fa45e8a708037d9679df63)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:35.823695 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b5c61a-789d-4f06-bc07-df391fe39b1b admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:35.826302 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:27:35.878053 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-58588a6d-0841-4a78-9c15-7c6bc5577c2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c142ec9f59c49a98a983c00bc38b1e9'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:35.889213 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-58588a6d-0841-4a78-9c15-7c6bc5577c2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c142ec9f59c49a98a983c00bc38b1e9'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:35.891371 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-58588a6d-0841-4a78-9c15-7c6bc5577c2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c142ec9f59c49a98a983c00bc38b1e9'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:35.892795 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-58588a6d-0841-4a78-9c15-7c6bc5577c2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c142ec9f59c49a98a983c00bc38b1e9'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:35.911170 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-58588a6d-0841-4a78-9c15-7c6bc5577c2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c142ec9f59c49a98a983c00bc38b1e9'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:35.919862 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:27:35.936783 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-e3b5c61a-789d-4f06-bc07-df391fe39b1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d2d9f5d04fa45e8a708037d9679df63', 'request_id': 'req-e3b5c61a-789d-4f06-bc07-df391fe39b1b'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:35.947233 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 871/1769] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 19 10:27:35 2022] DELETE /identity/v3/users/0c142ec9f59c49a98a983c00bc38b1e9 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:27:35.947233 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58588a6d-0841-4a78-9c15-7c6bc5577c2c admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:35.948024 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-58588a6d-0841-4a78-9c15-7c6bc5577c2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:35.954463 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-e3b5c61a-789d-4f06-bc07-df391fe39b1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d2d9f5d04fa45e8a708037d9679df63', 'request_id': 'req-e3b5c61a-789d-4f06-bc07-df391fe39b1b'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:35.976285 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-e3b5c61a-789d-4f06-bc07-df391fe39b1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d2d9f5d04fa45e8a708037d9679df63', 'request_id': 'req-e3b5c61a-789d-4f06-bc07-df391fe39b1b'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:35.990963 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-e3b5c61a-789d-4f06-bc07-df391fe39b1b admin admin] The token cache is being invalidate because project 8d2d9f5d04fa45e8a708037d9679df63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 10:27:35.991361 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-e3b5c61a-789d-4f06-bc07-df391fe39b1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:35.992390 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-e3b5c61a-789d-4f06-bc07-df391fe39b1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:35.994474 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 899/1770] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 19 10:27:35 2022] DELETE /identity/v3/projects/8d2d9f5d04fa45e8a708037d9679df63 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:27:36.001894 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064dc18c-238d-41f9-bd96-565b93b88339 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:36.007682 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064dc18c-238d-41f9-bd96-565b93b88339 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:36.008270 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064dc18c-238d-41f9-bd96-565b93b88339 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:36.042083 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-064dc18c-238d-41f9-bd96-565b93b88339 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:27:36.044236 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-064dc18c-238d-41f9-bd96-565b93b88339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:36.130432 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 900/1771] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:27:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 10:27:36.132400 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178107c3-dd0c-4a62-9e9b-08e75fc94dbd None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:36.132689 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178107c3-dd0c-4a62-9e9b-08e75fc94dbd None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:36.132970 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178107c3-dd0c-4a62-9e9b-08e75fc94dbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:36.161644 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-178107c3-dd0c-4a62-9e9b-08e75fc94dbd None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:27:36.162998 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-178107c3-dd0c-4a62-9e9b-08e75fc94dbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:36.175863 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 901/1772] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:27:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:27:36.180399 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178107c3-dd0c-4a62-9e9b-08e75fc94dbd None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:36.207776 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58588a6d-0841-4a78-9c15-7c6bc5577c2c admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:36.215412 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178107c3-dd0c-4a62-9e9b-08e75fc94dbd None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:36.223332 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc802be-5cc2-4b36-b845-4898a7c987c5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6677354e36614c9fb3d03413749be5ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:36.224363 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc802be-5cc2-4b36-b845-4898a7c987c5 service swift] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:36.225176 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc802be-5cc2-4b36-b845-4898a7c987c5 service swift] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:36.225552 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc802be-5cc2-4b36-b845-4898a7c987c5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:36.230841 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-5fc802be-5cc2-4b36-b845-4898a7c987c5 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:36.250148 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0846da-bacf-4db2-bbbb-88e17325539b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:36.254106 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0846da-bacf-4db2-bbbb-88e17325539b admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:36.254623 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0846da-bacf-4db2-bbbb-88e17325539b admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:36.254936 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0846da-bacf-4db2-bbbb-88e17325539b admin admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:36.255656 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0846da-bacf-4db2-bbbb-88e17325539b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:27:36.255969 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0846da-bacf-4db2-bbbb-88e17325539b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:36.261293 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0846da-bacf-4db2-bbbb-88e17325539b admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:36.290865 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 902/1773] 10.222.0.66 () {58 vars in 1153 bytes} [Mon Sep 19 10:27:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 10:27:36.296052 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0846da-bacf-4db2-bbbb-88e17325539b admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:36.317831 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0846da-bacf-4db2-bbbb-88e17325539b admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:36.331079 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c8f880-92f2-4700-aef4-bdbcf0d2242f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:36.332096 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c8f880-92f2-4700-aef4-bdbcf0d2242f admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:36.333861 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c8f880-92f2-4700-aef4-bdbcf0d2242f admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:36.336066 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c8f880-92f2-4700-aef4-bdbcf0d2242f admin admin] PATH_INFO: `/v3/projects` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:36.338672 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c8f880-92f2-4700-aef4-bdbcf0d2242f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:36.342015 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c8f880-92f2-4700-aef4-bdbcf0d2242f admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:36.374533 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc802be-5cc2-4b36-b845-4898a7c987c5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:36.378624 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc802be-5cc2-4b36-b845-4898a7c987c5 service swift] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:36.404556 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 872/1774] 10.222.0.66 () {60 vars in 1384 bytes} [Mon Sep 19 10:27:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 19 10:27:36.410433 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 903/1775] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 19 10:27:36 2022] POST /identity/v3/projects => generated 407 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:27:36.414826 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc802be-5cc2-4b36-b845-4898a7c987c5 service swift] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:36.454076 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc802be-5cc2-4b36-b845-4898a7c987c5 service swift] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:36.588926 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6f7f68-e180-4ccd-91ab-75c8eb098941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:36.589611 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6f7f68-e180-4ccd-91ab-75c8eb098941 admin admin] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:36.589890 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6f7f68-e180-4ccd-91ab-75c8eb098941 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:36.590207 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6f7f68-e180-4ccd-91ab-75c8eb098941 admin admin] PATH_INFO: `/v3/users` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:36.594577 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6f7f68-e180-4ccd-91ab-75c8eb098941 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:36.597473 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6f7f68-e180-4ccd-91ab-75c8eb098941 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:36.626128 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c8f880-92f2-4700-aef4-bdbcf0d2242f admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:36.628106 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-50c8f880-92f2-4700-aef4-bdbcf0d2242f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:36.656899 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c8f880-92f2-4700-aef4-bdbcf0d2242f admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:36.659798 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:27:36.674255 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 873/1776] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 19 10:27:36 2022] POST /identity/v3/users => generated 304 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:27:36.675663 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c33eb92-778a-436c-90e6-cbd366b67727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:36.676353 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c33eb92-778a-436c-90e6-cbd366b67727 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:36.676631 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c33eb92-778a-436c-90e6-cbd366b67727 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:36.676904 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c33eb92-778a-436c-90e6-cbd366b67727 admin admin] PATH_INFO: `/v3/projects/5cef41e3769a449cb29aa4460e87865e` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:36.683995 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c33eb92-778a-436c-90e6-cbd366b67727 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5cef41e3769a449cb29aa4460e87865e)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:36.688194 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6f7f68-e180-4ccd-91ab-75c8eb098941 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:36.688353 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c33eb92-778a-436c-90e6-cbd366b67727 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:36.714046 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6f7f68-e180-4ccd-91ab-75c8eb098941 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:36.733987 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a289721-d355-4475-b111-e0077bb3513c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:36.735738 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a289721-d355-4475-b111-e0077bb3513c admin admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:36.735999 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a289721-d355-4475-b111-e0077bb3513c admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:36.740153 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a289721-d355-4475-b111-e0077bb3513c admin admin] PATH_INFO: `/v3/roles` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:36.740990 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a289721-d355-4475-b111-e0077bb3513c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:36.742610 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a289721-d355-4475-b111-e0077bb3513c admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:36.793276 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 874/1777] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:27:36 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 10:27:36.795300 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a289721-d355-4475-b111-e0077bb3513c admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:36.838392 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a289721-d355-4475-b111-e0077bb3513c admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:36.873123 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:27:36.896964 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-8c33eb92-778a-436c-90e6-cbd366b67727 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5cef41e3769a449cb29aa4460e87865e', 'request_id': 'req-8c33eb92-778a-436c-90e6-cbd366b67727'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:36.931538 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-8c33eb92-778a-436c-90e6-cbd366b67727 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5cef41e3769a449cb29aa4460e87865e', 'request_id': 'req-8c33eb92-778a-436c-90e6-cbd366b67727'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:36.971902 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-8c33eb92-778a-436c-90e6-cbd366b67727 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5cef41e3769a449cb29aa4460e87865e', 'request_id': 'req-8c33eb92-778a-436c-90e6-cbd366b67727'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:37.026517 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-8c33eb92-778a-436c-90e6-cbd366b67727 admin admin] The token cache is being invalidate because project 5cef41e3769a449cb29aa4460e87865e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 10:27:37.026813 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-8c33eb92-778a-436c-90e6-cbd366b67727 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:37.032752 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-8c33eb92-778a-436c-90e6-cbd366b67727 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:37.038209 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 904/1778] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 19 10:27:36 2022] DELETE /identity/v3/projects/5cef41e3769a449cb29aa4460e87865e => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:27:37.056231 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df23812-3307-4da7-93b9-989293510e92 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:37.056582 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df23812-3307-4da7-93b9-989293510e92 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:37.057472 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df23812-3307-4da7-93b9-989293510e92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:37.150620 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-6df23812-3307-4da7-93b9-989293510e92 None None] MFA Rules not processed for user `d37107a7553248409c6cd63406c3ddef`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:27:37.164193 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-6df23812-3307-4da7-93b9-989293510e92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:37.183887 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b768987b-6b6e-4c3e-a0ef-22b8f20f4cc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:37.185043 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b768987b-6b6e-4c3e-a0ef-22b8f20f4cc7 admin admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:37.185559 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b768987b-6b6e-4c3e-a0ef-22b8f20f4cc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:37.186075 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b768987b-6b6e-4c3e-a0ef-22b8f20f4cc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:37.186954 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b768987b-6b6e-4c3e-a0ef-22b8f20f4cc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:37.189544 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b768987b-6b6e-4c3e-a0ef-22b8f20f4cc7 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:37.204894 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 875/1779] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:27:36 2022] GET /identity/v3/roles => generated 1420 bytes in 411 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 10:27:37.206688 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2de9249-401d-4deb-9d06-f6e4db4760d4 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:37.207194 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2de9249-401d-4deb-9d06-f6e4db4760d4 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:37.207746 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2de9249-401d-4deb-9d06-f6e4db4760d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:37.242696 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-e2de9249-401d-4deb-9d06-f6e4db4760d4 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:27:37.247446 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-e2de9249-401d-4deb-9d06-f6e4db4760d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:37.283279 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 876/1780] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:27:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:27:37.284426 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2de9249-401d-4deb-9d06-f6e4db4760d4 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:37.288860 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-e2de9249-401d-4deb-9d06-f6e4db4760d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:37.318356 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2de9249-401d-4deb-9d06-f6e4db4760d4 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:37.333380 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10548ac9-13e8-4427-9a92-05b8e5ef5601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:37.334223 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10548ac9-13e8-4427-9a92-05b8e5ef5601 admin admin] REQUEST_METHOD: `PUT` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:37.334705 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 905/1781] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:27:37 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:27:37.336096 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a852201-a7d4-4758-96c5-187bd8c6fa96 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:37.336623 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10548ac9-13e8-4427-9a92-05b8e5ef5601 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:37.336947 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10548ac9-13e8-4427-9a92-05b8e5ef5601 admin admin] PATH_INFO: `/v3/projects/fbbc2f38fb614d738c915a6dc8ca8410/users/0524275bcfd348f694cde07ee4357f45/roles/cd5b42ed3b754b58817a62bbe74651b4` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:37.337867 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a852201-a7d4-4758-96c5-187bd8c6fa96 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:37.338641 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a852201-a7d4-4758-96c5-187bd8c6fa96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:37.374798 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10548ac9-13e8-4427-9a92-05b8e5ef5601 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbbc2f38fb614d738c915a6dc8ca8410, user_id=0524275bcfd348f694cde07ee4357f45, role_id=cd5b42ed3b754b58817a62bbe74651b4)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:37.382141 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10548ac9-13e8-4427-9a92-05b8e5ef5601 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:37.390952 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-8a852201-a7d4-4758-96c5-187bd8c6fa96 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:27:37.392878 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-8a852201-a7d4-4758-96c5-187bd8c6fa96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:37.418321 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 877/1782] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 19 10:27:37 2022] PUT /identity/v3/projects/fbbc2f38fb614d738c915a6dc8ca8410/users/0524275bcfd348f694cde07ee4357f45/roles/cd5b42ed3b754b58817a62bbe74651b4 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:27:37.420637 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8274451-002c-45b8-b8e8-954b5b0f6a4b None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:37.420924 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8274451-002c-45b8-b8e8-954b5b0f6a4b None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:37.421199 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8274451-002c-45b8-b8e8-954b5b0f6a4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:37.426971 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 906/1783] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:27:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:27:37.431063 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a852201-a7d4-4758-96c5-187bd8c6fa96 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:37.452499 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a852201-a7d4-4758-96c5-187bd8c6fa96 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:37.493797 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-a8274451-002c-45b8-b8e8-954b5b0f6a4b None None] MFA Rules not processed for user `0524275bcfd348f694cde07ee4357f45`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:27:37.496339 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-a8274451-002c-45b8-b8e8-954b5b0f6a4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:37.588396 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e27fcb-d306-4aba-b098-a3b2e87a9924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:37.588995 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e27fcb-d306-4aba-b098-a3b2e87a9924 admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:37.591204 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e27fcb-d306-4aba-b098-a3b2e87a9924 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:37.591517 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e27fcb-d306-4aba-b098-a3b2e87a9924 admin admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:37.592217 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e27fcb-d306-4aba-b098-a3b2e87a9924 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:27:37.592531 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e27fcb-d306-4aba-b098-a3b2e87a9924 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:37.598042 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e27fcb-d306-4aba-b098-a3b2e87a9924 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:37.646024 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 878/1784] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:27:37 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:27:37.647073 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8274451-002c-45b8-b8e8-954b5b0f6a4b None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:37.665459 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 907/1785] 10.222.0.66 () {58 vars in 1153 bytes} [Mon Sep 19 10:27:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 10:27:37.666641 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e27fcb-d306-4aba-b098-a3b2e87a9924 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:37.678587 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8274451-002c-45b8-b8e8-954b5b0f6a4b None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:37.704961 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e27fcb-d306-4aba-b098-a3b2e87a9924 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:37.712732 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c545e277-6d05-4099-ba6f-cb3c14f21f0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:37.713379 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c545e277-6d05-4099-ba6f-cb3c14f21f0b admin admin] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:37.713681 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c545e277-6d05-4099-ba6f-cb3c14f21f0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:37.713944 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c545e277-6d05-4099-ba6f-cb3c14f21f0b admin admin] PATH_INFO: `/v3/projects` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:37.714599 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c545e277-6d05-4099-ba6f-cb3c14f21f0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:37.717432 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c545e277-6d05-4099-ba6f-cb3c14f21f0b admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:37.736996 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08d7d76-8471-474a-93fd-4638d694a796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:37.737632 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08d7d76-8471-474a-93fd-4638d694a796 admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:37.741215 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08d7d76-8471-474a-93fd-4638d694a796 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:37.741550 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08d7d76-8471-474a-93fd-4638d694a796 admin admin] PATH_INFO: `/v3/projects` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:37.742299 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08d7d76-8471-474a-93fd-4638d694a796 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:37.754878 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08d7d76-8471-474a-93fd-4638d694a796 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:37.790328 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 879/1786] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 19 10:27:37 2022] POST /identity/v3/projects => generated 409 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:27:37.796240 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c545e277-6d05-4099-ba6f-cb3c14f21f0b admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:37.813890 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-c545e277-6d05-4099-ba6f-cb3c14f21f0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:37.835579 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 908/1787] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 19 10:27:37 2022] POST /identity/v3/projects => generated 381 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:27:37.836844 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08d7d76-8471-474a-93fd-4638d694a796 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:37.862600 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:27:37.938835 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:27:37.995342 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08d7d76-8471-474a-93fd-4638d694a796 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:38.012068 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf58e21-a366-4c2b-909e-7ec776d4a28d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:38.022511 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf58e21-a366-4c2b-909e-7ec776d4a28d admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:38.022639 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c545e277-6d05-4099-ba6f-cb3c14f21f0b admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:38.022744 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf58e21-a366-4c2b-909e-7ec776d4a28d admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:38.022744 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf58e21-a366-4c2b-909e-7ec776d4a28d admin admin] PATH_INFO: `/v3/users` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:38.033273 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf58e21-a366-4c2b-909e-7ec776d4a28d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:38.047279 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf58e21-a366-4c2b-909e-7ec776d4a28d admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:38.048936 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7223e19a-be5e-4fee-bb47-2113fbef82fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:38.049664 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7223e19a-be5e-4fee-bb47-2113fbef82fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:38.049955 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7223e19a-be5e-4fee-bb47-2113fbef82fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:38.050268 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7223e19a-be5e-4fee-bb47-2113fbef82fb admin admin] PATH_INFO: `/v3/projects/a36dedd2e2784d449e30fa4a49074a2e` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:38.055157 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7223e19a-be5e-4fee-bb47-2113fbef82fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=a36dedd2e2784d449e30fa4a49074a2e)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:38.057212 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7223e19a-be5e-4fee-bb47-2113fbef82fb admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:38.116983 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 909/1788] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 19 10:27:37 2022] POST /identity/v3/users => generated 311 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:27:38.120137 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf58e21-a366-4c2b-909e-7ec776d4a28d admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:38.149589 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf58e21-a366-4c2b-909e-7ec776d4a28d admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:38.171598 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27902528-ea5f-4a69-83f2-1380d2d51575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:38.174939 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27902528-ea5f-4a69-83f2-1380d2d51575 admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:38.176468 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27902528-ea5f-4a69-83f2-1380d2d51575 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:38.177202 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27902528-ea5f-4a69-83f2-1380d2d51575 admin admin] PATH_INFO: `/v3/users` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:38.179947 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27902528-ea5f-4a69-83f2-1380d2d51575 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:38.186750 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27902528-ea5f-4a69-83f2-1380d2d51575 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:38.197670 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-7223e19a-be5e-4fee-bb47-2113fbef82fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a36dedd2e2784d449e30fa4a49074a2e', 'request_id': 'req-7223e19a-be5e-4fee-bb47-2113fbef82fb'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:38.224612 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-7223e19a-be5e-4fee-bb47-2113fbef82fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a36dedd2e2784d449e30fa4a49074a2e', 'request_id': 'req-7223e19a-be5e-4fee-bb47-2113fbef82fb'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:38.241509 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-7223e19a-be5e-4fee-bb47-2113fbef82fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a36dedd2e2784d449e30fa4a49074a2e', 'request_id': 'req-7223e19a-be5e-4fee-bb47-2113fbef82fb'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:38.242720 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 910/1789] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 19 10:27:38 2022] POST /identity/v3/users => generated 291 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:27:38.243930 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27902528-ea5f-4a69-83f2-1380d2d51575 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:38.260976 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-7223e19a-be5e-4fee-bb47-2113fbef82fb admin admin] The token cache is being invalidate because project a36dedd2e2784d449e30fa4a49074a2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 10:27:38.260976 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-7223e19a-be5e-4fee-bb47-2113fbef82fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:38.264242 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-7223e19a-be5e-4fee-bb47-2113fbef82fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:38.269207 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 880/1790] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 19 10:27:37 2022] DELETE /identity/v3/projects/a36dedd2e2784d449e30fa4a49074a2e => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:27:38.270051 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7223e19a-be5e-4fee-bb47-2113fbef82fb admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:38.272461 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-7223e19a-be5e-4fee-bb47-2113fbef82fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:38.281391 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27902528-ea5f-4a69-83f2-1380d2d51575 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:38.473851 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19376593-a628-4bba-a559-7148fee437d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:38.474548 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19376593-a628-4bba-a559-7148fee437d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:38.474804 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19376593-a628-4bba-a559-7148fee437d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:38.475090 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19376593-a628-4bba-a559-7148fee437d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:38.475742 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19376593-a628-4bba-a559-7148fee437d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:38.477642 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19376593-a628-4bba-a559-7148fee437d4 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:38.487370 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7223e19a-be5e-4fee-bb47-2113fbef82fb admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:38.494370 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 911/1791] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:27:38 2022] GET /identity/v3/roles => generated 1420 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 10:27:38.495970 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cfde1c-7ede-4a67-b4f5-9f7a60573db8 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:38.496299 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cfde1c-7ede-4a67-b4f5-9f7a60573db8 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:38.496624 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cfde1c-7ede-4a67-b4f5-9f7a60573db8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:38.498193 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bda0799-821b-4aa4-b93c-6d98bffb0678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:38.499483 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bda0799-821b-4aa4-b93c-6d98bffb0678 admin admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:38.499811 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bda0799-821b-4aa4-b93c-6d98bffb0678 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:38.500230 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bda0799-821b-4aa4-b93c-6d98bffb0678 admin admin] PATH_INFO: `/v3/roles` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:38.501017 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bda0799-821b-4aa4-b93c-6d98bffb0678 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:38.502951 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bda0799-821b-4aa4-b93c-6d98bffb0678 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:38.523654 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-b6cfde1c-7ede-4a67-b4f5-9f7a60573db8 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:27:38.524228 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 881/1792] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:27:38 2022] GET /identity/v3/roles => generated 1420 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 10:27:38.525004 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-b6cfde1c-7ede-4a67-b4f5-9f7a60573db8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:38.525112 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bda0799-821b-4aa4-b93c-6d98bffb0678 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:38.526991 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-9bda0799-821b-4aa4-b93c-6d98bffb0678 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:38.540441 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 912/1793] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:27:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:27:38.540441 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cfde1c-7ede-4a67-b4f5-9f7a60573db8 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:38.550683 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cfde1c-7ede-4a67-b4f5-9f7a60573db8 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:38.556934 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bf8831-4a49-47e1-8690-c61a56b7ffbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:38.557604 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bf8831-4a49-47e1-8690-c61a56b7ffbd admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:38.558053 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bf8831-4a49-47e1-8690-c61a56b7ffbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:38.558351 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bf8831-4a49-47e1-8690-c61a56b7ffbd admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:38.559188 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bf8831-4a49-47e1-8690-c61a56b7ffbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:38.560950 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bda0799-821b-4aa4-b93c-6d98bffb0678 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:38.561103 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bf8831-4a49-47e1-8690-c61a56b7ffbd admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:38.575801 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 913/1794] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:27:38 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 10:27:38.577573 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1cea3a-15e9-46d1-871d-f2655c65617f None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:38.577908 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1cea3a-15e9-46d1-871d-f2655c65617f None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:38.578330 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1cea3a-15e9-46d1-871d-f2655c65617f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:38.584370 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2a79fc-6190-4f6b-9c21-f29f762f4ddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:38.585338 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2a79fc-6190-4f6b-9c21-f29f762f4ddb admin admin] REQUEST_METHOD: `PUT` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:38.586681 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2a79fc-6190-4f6b-9c21-f29f762f4ddb admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:38.587161 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2a79fc-6190-4f6b-9c21-f29f762f4ddb admin admin] PATH_INFO: `/v3/projects/d4eddb0af21c4467a66fef90aff07398/users/1dcb1f77e3b6467a8ed6cb60f44323d0/roles/5c8b89fae4fa45bd944cbeaf442136e1` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:38.609618 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-8b1cea3a-15e9-46d1-871d-f2655c65617f None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:27:38.611082 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-8b1cea3a-15e9-46d1-871d-f2655c65617f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:38.621482 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 914/1795] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:27:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:27:38.621885 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1cea3a-15e9-46d1-871d-f2655c65617f None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:38.648139 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2a79fc-6190-4f6b-9c21-f29f762f4ddb admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4eddb0af21c4467a66fef90aff07398, user_id=1dcb1f77e3b6467a8ed6cb60f44323d0, role_id=5c8b89fae4fa45bd944cbeaf442136e1)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:38.649482 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1cea3a-15e9-46d1-871d-f2655c65617f None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:38.656369 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9460e51b-d032-4f3a-ae41-aafa19d10744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:38.657243 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9460e51b-d032-4f3a-ae41-aafa19d10744 admin admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:38.657485 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9460e51b-d032-4f3a-ae41-aafa19d10744 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:38.657766 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9460e51b-d032-4f3a-ae41-aafa19d10744 admin admin] PATH_INFO: `/v3/projects/d79f9e6f880847f7a66a6aa89d31bc41/users/285cc1097dbb4c26aa7f1df77ff0b34f/roles/cd5b42ed3b754b58817a62bbe74651b4` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:38.658490 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2a79fc-6190-4f6b-9c21-f29f762f4ddb admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:38.677938 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9460e51b-d032-4f3a-ae41-aafa19d10744 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d79f9e6f880847f7a66a6aa89d31bc41, user_id=285cc1097dbb4c26aa7f1df77ff0b34f, role_id=cd5b42ed3b754b58817a62bbe74651b4)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:38.681072 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9460e51b-d032-4f3a-ae41-aafa19d10744 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:38.704082 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 882/1796] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 19 10:27:38 2022] PUT /identity/v3/projects/d4eddb0af21c4467a66fef90aff07398/users/1dcb1f77e3b6467a8ed6cb60f44323d0/roles/5c8b89fae4fa45bd944cbeaf442136e1 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:27:38.710196 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2a79fc-6190-4f6b-9c21-f29f762f4ddb admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:38.726367 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 915/1797] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 19 10:27:38 2022] PUT /identity/v3/projects/d79f9e6f880847f7a66a6aa89d31bc41/users/285cc1097dbb4c26aa7f1df77ff0b34f/roles/cd5b42ed3b754b58817a62bbe74651b4 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:27:38.726367 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9460e51b-d032-4f3a-ae41-aafa19d10744 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:38.792695 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:27:38.895388 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2a79fc-6190-4f6b-9c21-f29f762f4ddb admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:39.039777 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23a69d7-306b-4450-aa00-8480b365970f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:39.040577 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23a69d7-306b-4450-aa00-8480b365970f admin admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:39.040981 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23a69d7-306b-4450-aa00-8480b365970f admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:39.041333 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23a69d7-306b-4450-aa00-8480b365970f admin admin] PATH_INFO: `/v3/domains` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:39.042071 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23a69d7-306b-4450-aa00-8480b365970f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:27:39.042192 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9460e51b-d032-4f3a-ae41-aafa19d10744 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:39.042445 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23a69d7-306b-4450-aa00-8480b365970f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:39.046163 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23a69d7-306b-4450-aa00-8480b365970f admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:39.060402 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f722ddd-cc0d-45b7-bb3e-9706c53e9f52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:39.061039 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f722ddd-cc0d-45b7-bb3e-9706c53e9f52 admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:39.063531 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f722ddd-cc0d-45b7-bb3e-9706c53e9f52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:39.063816 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f722ddd-cc0d-45b7-bb3e-9706c53e9f52 admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:39.065781 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f722ddd-cc0d-45b7-bb3e-9706c53e9f52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:39.067407 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f722ddd-cc0d-45b7-bb3e-9706c53e9f52 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:39.068588 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 883/1798] 10.222.0.66 () {58 vars in 1153 bytes} [Mon Sep 19 10:27:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:27:39.070524 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d86c919-997e-41eb-a72e-fa12dc6e2adf None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:39.070736 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d86c919-997e-41eb-a72e-fa12dc6e2adf None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:39.071098 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d86c919-997e-41eb-a72e-fa12dc6e2adf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:39.076659 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:27:39.105759 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 916/1799] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:27:38 2022] GET /identity/v3/roles => generated 1420 bytes in 387 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 10:27:39.107299 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f722ddd-cc0d-45b7-bb3e-9706c53e9f52 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:39.118540 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-4d86c919-997e-41eb-a72e-fa12dc6e2adf None None] MFA Rules not processed for user `285cc1097dbb4c26aa7f1df77ff0b34f`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:27:39.118760 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f722ddd-cc0d-45b7-bb3e-9706c53e9f52 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:39.120078 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-4d86c919-997e-41eb-a72e-fa12dc6e2adf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:39.129948 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cf3a0b-238f-4877-8c34-4dab2a6bdd39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:39.130600 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cf3a0b-238f-4877-8c34-4dab2a6bdd39 admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:39.130874 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cf3a0b-238f-4877-8c34-4dab2a6bdd39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:39.131155 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cf3a0b-238f-4877-8c34-4dab2a6bdd39 admin admin] PATH_INFO: `/v3/projects` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:39.131925 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cf3a0b-238f-4877-8c34-4dab2a6bdd39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:39.133896 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cf3a0b-238f-4877-8c34-4dab2a6bdd39 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:39.212772 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 917/1800] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 19 10:27:39 2022] POST /identity/v3/projects => generated 385 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:27:39.215267 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cf3a0b-238f-4877-8c34-4dab2a6bdd39 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:39.228754 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 884/1801] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:27:39 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:27:39.234990 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d86c919-997e-41eb-a72e-fa12dc6e2adf None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:39.249076 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d86c919-997e-41eb-a72e-fa12dc6e2adf None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:39.372880 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:27:39.407686 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9828f945-215b-4e49-ab73-e0f7b02aeb93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:39.410699 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9828f945-215b-4e49-ab73-e0f7b02aeb93 admin admin] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:39.411002 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9828f945-215b-4e49-ab73-e0f7b02aeb93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:39.411336 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9828f945-215b-4e49-ab73-e0f7b02aeb93 admin admin] PATH_INFO: `/v3/users` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:39.414956 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9828f945-215b-4e49-ab73-e0f7b02aeb93 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:39.417835 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9828f945-215b-4e49-ab73-e0f7b02aeb93 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:39.473012 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cf3a0b-238f-4877-8c34-4dab2a6bdd39 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:39.497485 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 885/1802] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 19 10:27:39 2022] POST /identity/v3/users => generated 293 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:27:39.500417 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9828f945-215b-4e49-ab73-e0f7b02aeb93 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:39.500573 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19321f91-6716-42f2-a5fb-76d50f2de14f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:39.501215 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19321f91-6716-42f2-a5fb-76d50f2de14f admin admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:39.501515 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19321f91-6716-42f2-a5fb-76d50f2de14f admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:39.501790 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19321f91-6716-42f2-a5fb-76d50f2de14f admin admin] PATH_INFO: `/v3/projects/d4eddb0af21c4467a66fef90aff07398/users/1dcb1f77e3b6467a8ed6cb60f44323d0/roles/5c8b89fae4fa45bd944cbeaf442136e1` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:39.509632 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19321f91-6716-42f2-a5fb-76d50f2de14f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4eddb0af21c4467a66fef90aff07398, user_id=1dcb1f77e3b6467a8ed6cb60f44323d0, role_id=5c8b89fae4fa45bd944cbeaf442136e1)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:39.517125 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19321f91-6716-42f2-a5fb-76d50f2de14f admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:39.532639 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9828f945-215b-4e49-ab73-e0f7b02aeb93 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:39.556499 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 918/1803] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 19 10:27:39 2022] PUT /identity/v3/projects/d4eddb0af21c4467a66fef90aff07398/users/1dcb1f77e3b6467a8ed6cb60f44323d0/roles/5c8b89fae4fa45bd944cbeaf442136e1 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:27:39.570246 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19321f91-6716-42f2-a5fb-76d50f2de14f admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:39.688620 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f72789-8fe8-4f0c-bd03-c62a1ef6c650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:39.692374 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f72789-8fe8-4f0c-bd03-c62a1ef6c650 admin admin] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:39.692682 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f72789-8fe8-4f0c-bd03-c62a1ef6c650 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:39.692970 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f72789-8fe8-4f0c-bd03-c62a1ef6c650 admin admin] PATH_INFO: `/v3/projects` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:39.693645 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f72789-8fe8-4f0c-bd03-c62a1ef6c650 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:39.701960 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f72789-8fe8-4f0c-bd03-c62a1ef6c650 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:39.787926 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 886/1804] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 19 10:27:39 2022] POST /identity/v3/projects => generated 379 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:27:39.788958 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4fbac0-9e0d-4795-bf8c-560d2b5924a7 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:39.789251 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4fbac0-9e0d-4795-bf8c-560d2b5924a7 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:39.792216 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4fbac0-9e0d-4795-bf8c-560d2b5924a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:39.811878 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19321f91-6716-42f2-a5fb-76d50f2de14f admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:39.861692 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-0c4fbac0-9e0d-4795-bf8c-560d2b5924a7 None None] MFA Rules not processed for user `1dcb1f77e3b6467a8ed6cb60f44323d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:27:39.863001 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-0c4fbac0-9e0d-4795-bf8c-560d2b5924a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:40.061873 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680668d8-29fe-4b0a-b50b-1a0433fb99aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:40.063904 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680668d8-29fe-4b0a-b50b-1a0433fb99aa admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:40.066382 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680668d8-29fe-4b0a-b50b-1a0433fb99aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:40.066843 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680668d8-29fe-4b0a-b50b-1a0433fb99aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:40.067642 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680668d8-29fe-4b0a-b50b-1a0433fb99aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:40.072256 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680668d8-29fe-4b0a-b50b-1a0433fb99aa admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:40.115443 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 919/1805] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:27:39 2022] GET /identity/v3/roles => generated 1420 bytes in 558 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 10:27:40.123637 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db01eab-c24c-49f1-90eb-61718501b822 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:40.124099 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db01eab-c24c-49f1-90eb-61718501b822 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:40.124493 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db01eab-c24c-49f1-90eb-61718501b822 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:40.154470 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 887/1806] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:27:39 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 369 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:27:40.155552 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4fbac0-9e0d-4795-bf8c-560d2b5924a7 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:40.183616 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4fbac0-9e0d-4795-bf8c-560d2b5924a7 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:40.195781 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08a2d00-8922-4f34-ae32-a030b72d9adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:40.196499 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08a2d00-8922-4f34-ae32-a030b72d9adf admin admin] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:40.196782 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08a2d00-8922-4f34-ae32-a030b72d9adf admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:40.197082 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08a2d00-8922-4f34-ae32-a030b72d9adf admin admin] PATH_INFO: `/v3/users` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:40.197703 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08a2d00-8922-4f34-ae32-a030b72d9adf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:40.199070 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-8db01eab-c24c-49f1-90eb-61718501b822 None None] MFA Rules not processed for user `0c1289b015854c6bb6aee8fed6b807db`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:27:40.199843 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08a2d00-8922-4f34-ae32-a030b72d9adf admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:40.208919 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-8db01eab-c24c-49f1-90eb-61718501b822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:40.244700 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:27:40.304828 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 888/1807] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 19 10:27:40 2022] POST /identity/v3/users => generated 296 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:27:40.308095 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08a2d00-8922-4f34-ae32-a030b72d9adf admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:40.333399 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08a2d00-8922-4f34-ae32-a030b72d9adf admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:40.351292 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7950dbc-232b-48d7-b55f-2b64d0c1973c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:40.352227 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7950dbc-232b-48d7-b55f-2b64d0c1973c admin admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:40.352518 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7950dbc-232b-48d7-b55f-2b64d0c1973c admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:40.352787 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7950dbc-232b-48d7-b55f-2b64d0c1973c admin admin] PATH_INFO: `/v3/roles` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:40.353440 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7950dbc-232b-48d7-b55f-2b64d0c1973c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:40.355068 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7950dbc-232b-48d7-b55f-2b64d0c1973c admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:40.389376 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 889/1808] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:27:40 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 10:27:40.389376 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7950dbc-232b-48d7-b55f-2b64d0c1973c admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:40.392663 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-d7950dbc-232b-48d7-b55f-2b64d0c1973c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:40.425211 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 920/1809] 10.222.0.55 () {58 vars in 1015 bytes} [Mon Sep 19 10:27:40 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:27:40.427819 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db01eab-c24c-49f1-90eb-61718501b822 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:40.472872 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:27:40.475149 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db01eab-c24c-49f1-90eb-61718501b822 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:40.498583 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0bc33d-6493-41a3-ad06-9e37a6634b69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:40.499393 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0bc33d-6493-41a3-ad06-9e37a6634b69 admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:40.499744 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0bc33d-6493-41a3-ad06-9e37a6634b69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:40.500026 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0bc33d-6493-41a3-ad06-9e37a6634b69 admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:40.500826 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0bc33d-6493-41a3-ad06-9e37a6634b69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:40.504068 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0bc33d-6493-41a3-ad06-9e37a6634b69 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:40.525017 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 921/1810] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:27:40 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 10:27:40.526295 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0bc33d-6493-41a3-ad06-9e37a6634b69 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:40.543294 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0bc33d-6493-41a3-ad06-9e37a6634b69 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:40.547377 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7950dbc-232b-48d7-b55f-2b64d0c1973c admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:40.551174 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37f3282-d503-42cf-9056-f063f676cf1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:40.554365 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37f3282-d503-42cf-9056-f063f676cf1c admin admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:40.554670 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37f3282-d503-42cf-9056-f063f676cf1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:40.555194 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37f3282-d503-42cf-9056-f063f676cf1c admin admin] PATH_INFO: `/v3/projects/5f32fb4744344ee49d7404e58b8fa0f0/users/b34daa97664845eca03b7e19a4db4343/roles/cd5b42ed3b754b58817a62bbe74651b4` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:40.559574 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0eab35-c76a-4747-a230-71c87168f2a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa4d004fd44482cae761c4b3bdfab31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:40.560240 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0eab35-c76a-4747-a230-71c87168f2a5 service cinder] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:40.560522 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0eab35-c76a-4747-a230-71c87168f2a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:40.560798 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0eab35-c76a-4747-a230-71c87168f2a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:40.594620 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0eab35-c76a-4747-a230-71c87168f2a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:40.595880 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37f3282-d503-42cf-9056-f063f676cf1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f32fb4744344ee49d7404e58b8fa0f0, user_id=b34daa97664845eca03b7e19a4db4343, role_id=cd5b42ed3b754b58817a62bbe74651b4)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:40.596108 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0eab35-c76a-4747-a230-71c87168f2a5 service cinder] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:40.618915 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37f3282-d503-42cf-9056-f063f676cf1c admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:40.630512 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 890/1811] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:27:40 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:27:40.631412 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0eab35-c76a-4747-a230-71c87168f2a5 service cinder] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:40.633021 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-ae0eab35-c76a-4747-a230-71c87168f2a5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:40.666997 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0eab35-c76a-4747-a230-71c87168f2a5 service cinder] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:40.675065 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81d609a-d7d8-4592-bb82-57b58a2cd2f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c1289b015854c6bb6aee8fed6b807db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:40.675714 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81d609a-d7d8-4592-bb82-57b58a2cd2f7 service neutron] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:40.675999 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81d609a-d7d8-4592-bb82-57b58a2cd2f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:40.676303 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81d609a-d7d8-4592-bb82-57b58a2cd2f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:40.703076 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 922/1812] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 19 10:27:40 2022] PUT /identity/v3/projects/5f32fb4744344ee49d7404e58b8fa0f0/users/b34daa97664845eca03b7e19a4db4343/roles/cd5b42ed3b754b58817a62bbe74651b4 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:27:40.707108 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37f3282-d503-42cf-9056-f063f676cf1c admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:40.714930 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81d609a-d7d8-4592-bb82-57b58a2cd2f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:40.716522 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81d609a-d7d8-4592-bb82-57b58a2cd2f7 service neutron] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:40.743685 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 891/1813] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:27:40 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:27:40.745055 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4503c84-84b5-41fc-b34f-5bd2b6c4aede None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:40.745337 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4503c84-84b5-41fc-b34f-5bd2b6c4aede None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:40.745599 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4503c84-84b5-41fc-b34f-5bd2b6c4aede None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:40.859357 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-a4503c84-84b5-41fc-b34f-5bd2b6c4aede None None] MFA Rules not processed for user `b34daa97664845eca03b7e19a4db4343`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:27:40.860839 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-a4503c84-84b5-41fc-b34f-5bd2b6c4aede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:41.002860 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37f3282-d503-42cf-9056-f063f676cf1c admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:41.029444 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c623ec-2470-49c7-9c0f-32ecd0f2fc00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:41.031339 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c623ec-2470-49c7-9c0f-32ecd0f2fc00 admin admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:41.032263 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c623ec-2470-49c7-9c0f-32ecd0f2fc00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:41.053721 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c623ec-2470-49c7-9c0f-32ecd0f2fc00 admin admin] PATH_INFO: `/v3/projects/6e9df1574f964c0492499e191859a955/users/e20ce3e68c80452f843b0e50aad2f5f7/roles/5c8b89fae4fa45bd944cbeaf442136e1` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:41.076702 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 892/1814] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:27:40 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:27:41.077670 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4503c84-84b5-41fc-b34f-5bd2b6c4aede None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:41.096330 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c623ec-2470-49c7-9c0f-32ecd0f2fc00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e9df1574f964c0492499e191859a955, user_id=e20ce3e68c80452f843b0e50aad2f5f7, role_id=5c8b89fae4fa45bd944cbeaf442136e1)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:41.108609 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c623ec-2470-49c7-9c0f-32ecd0f2fc00 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:41.129252 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4503c84-84b5-41fc-b34f-5bd2b6c4aede None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:41.138889 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 923/1815] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 19 10:27:40 2022] PUT /identity/v3/projects/6e9df1574f964c0492499e191859a955/users/e20ce3e68c80452f843b0e50aad2f5f7/roles/5c8b89fae4fa45bd944cbeaf442136e1 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:27:41.143313 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c623ec-2470-49c7-9c0f-32ecd0f2fc00 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:41.313995 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a310e42-46d8-484c-be8d-b02211941833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:41.314492 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a310e42-46d8-484c-be8d-b02211941833 admin admin] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:41.314779 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a310e42-46d8-484c-be8d-b02211941833 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:41.315047 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a310e42-46d8-484c-be8d-b02211941833 admin admin] PATH_INFO: `/v3/projects` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:41.315690 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a310e42-46d8-484c-be8d-b02211941833 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:41.324609 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a310e42-46d8-484c-be8d-b02211941833 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:41.385881 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c623ec-2470-49c7-9c0f-32ecd0f2fc00 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:41.403134 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68751b9f-4cbd-4e62-846d-df87864e0d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:41.403776 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68751b9f-4cbd-4e62-846d-df87864e0d8b admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:41.404054 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68751b9f-4cbd-4e62-846d-df87864e0d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:41.404350 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68751b9f-4cbd-4e62-846d-df87864e0d8b admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:41.405003 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68751b9f-4cbd-4e62-846d-df87864e0d8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:41.406693 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68751b9f-4cbd-4e62-846d-df87864e0d8b admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:41.417759 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 893/1816] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 19 10:27:41 2022] POST /identity/v3/projects => generated 385 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:27:41.417759 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a310e42-46d8-484c-be8d-b02211941833 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:41.435769 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 924/1817] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:27:41 2022] GET /identity/v3/roles => generated 1420 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 10:27:41.436537 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68751b9f-4cbd-4e62-846d-df87864e0d8b admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:41.482656 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68751b9f-4cbd-4e62-846d-df87864e0d8b admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:41.489822 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:27:41.593247 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:27:41.688864 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a310e42-46d8-484c-be8d-b02211941833 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:41.717040 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba689d3-fba9-4393-9cf5-6d52cec340ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa4d004fd44482cae761c4b3bdfab31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:41.717708 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba689d3-fba9-4393-9cf5-6d52cec340ba service cinder] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:41.717990 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba689d3-fba9-4393-9cf5-6d52cec340ba service cinder] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:41.718263 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba689d3-fba9-4393-9cf5-6d52cec340ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:41.725447 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-7ba689d3-fba9-4393-9cf5-6d52cec340ba service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:41.727105 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4204514-ff38-488a-aa11-c34a9b4ff7a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:41.727875 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4204514-ff38-488a-aa11-c34a9b4ff7a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:41.728065 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4204514-ff38-488a-aa11-c34a9b4ff7a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:41.728429 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4204514-ff38-488a-aa11-c34a9b4ff7a2 admin admin] PATH_INFO: `/v3/users` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:41.728954 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4204514-ff38-488a-aa11-c34a9b4ff7a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:41.730934 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4204514-ff38-488a-aa11-c34a9b4ff7a2 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:41.826458 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 925/1818] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 19 10:27:41 2022] POST /identity/v3/users => generated 293 bytes in 388 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:27:41.826458 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4204514-ff38-488a-aa11-c34a9b4ff7a2 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:41.864368 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4204514-ff38-488a-aa11-c34a9b4ff7a2 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:41.882679 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f701a76-4fcb-4738-94eb-b7746e7ae465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:41.885149 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f701a76-4fcb-4738-94eb-b7746e7ae465 admin admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:41.886312 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f701a76-4fcb-4738-94eb-b7746e7ae465 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:41.887642 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f701a76-4fcb-4738-94eb-b7746e7ae465 admin admin] PATH_INFO: `/v3/projects/6e9df1574f964c0492499e191859a955/users/e20ce3e68c80452f843b0e50aad2f5f7/roles/5c8b89fae4fa45bd944cbeaf442136e1` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:41.892771 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f701a76-4fcb-4738-94eb-b7746e7ae465 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e9df1574f964c0492499e191859a955, user_id=e20ce3e68c80452f843b0e50aad2f5f7, role_id=5c8b89fae4fa45bd944cbeaf442136e1)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:41.905649 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f701a76-4fcb-4738-94eb-b7746e7ae465 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:41.906812 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba689d3-fba9-4393-9cf5-6d52cec340ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:41.909076 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba689d3-fba9-4393-9cf5-6d52cec340ba service cinder] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:41.932687 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 894/1819] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:27:41 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 517 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:27:41.933587 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba689d3-fba9-4393-9cf5-6d52cec340ba service cinder] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:41.951423 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 926/1820] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 19 10:27:41 2022] PUT /identity/v3/projects/6e9df1574f964c0492499e191859a955/users/e20ce3e68c80452f843b0e50aad2f5f7/roles/5c8b89fae4fa45bd944cbeaf442136e1 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:27:41.962801 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33a8eab-ab04-4ae7-a427-0db6311cbfe3 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:41.963091 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33a8eab-ab04-4ae7-a427-0db6311cbfe3 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:41.963369 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33a8eab-ab04-4ae7-a427-0db6311cbfe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:41.970891 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba689d3-fba9-4393-9cf5-6d52cec340ba service cinder] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:42.125175 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aebe992-b71f-4772-beb6-458ec7dd9686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:42.126136 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aebe992-b71f-4772-beb6-458ec7dd9686 admin admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:42.127700 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aebe992-b71f-4772-beb6-458ec7dd9686 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:42.128085 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aebe992-b71f-4772-beb6-458ec7dd9686 admin admin] PATH_INFO: `/v3/roles` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:42.130755 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aebe992-b71f-4772-beb6-458ec7dd9686 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:42.134734 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aebe992-b71f-4772-beb6-458ec7dd9686 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:42.139603 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-d33a8eab-ab04-4ae7-a427-0db6311cbfe3 None None] MFA Rules not processed for user `e20ce3e68c80452f843b0e50aad2f5f7`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:27:42.141452 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-d33a8eab-ab04-4ae7-a427-0db6311cbfe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:42.164628 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 895/1821] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:27:41 2022] GET /identity/v3/roles => generated 1420 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 10:27:42.166657 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aebe992-b71f-4772-beb6-458ec7dd9686 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:42.192123 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aebe992-b71f-4772-beb6-458ec7dd9686 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:42.209356 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68a7ebc-9bb0-4915-bf31-02136fb2e85e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:42.210682 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68a7ebc-9bb0-4915-bf31-02136fb2e85e admin admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:42.211447 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68a7ebc-9bb0-4915-bf31-02136fb2e85e admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:42.212353 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68a7ebc-9bb0-4915-bf31-02136fb2e85e admin admin] PATH_INFO: `/v3/roles` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:42.213345 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68a7ebc-9bb0-4915-bf31-02136fb2e85e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:42.215886 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68a7ebc-9bb0-4915-bf31-02136fb2e85e admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:42.244450 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 896/1822] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:27:42 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 10:27:42.245617 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68a7ebc-9bb0-4915-bf31-02136fb2e85e admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:42.279786 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68a7ebc-9bb0-4915-bf31-02136fb2e85e admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:42.279786 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716a6fa4-e1ba-434e-bd4f-ee6a937999f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:42.279786 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716a6fa4-e1ba-434e-bd4f-ee6a937999f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:42.279786 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716a6fa4-e1ba-434e-bd4f-ee6a937999f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:42.280154 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716a6fa4-e1ba-434e-bd4f-ee6a937999f4 admin admin] PATH_INFO: `/v3/projects/6c72b1cd08dd408fbda2cd108a5d4009/users/51b453e2b325451cb1d4fab6d7d658f5/roles/cd5b42ed3b754b58817a62bbe74651b4` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:42.321037 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716a6fa4-e1ba-434e-bd4f-ee6a937999f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c72b1cd08dd408fbda2cd108a5d4009, user_id=51b453e2b325451cb1d4fab6d7d658f5, role_id=cd5b42ed3b754b58817a62bbe74651b4)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:42.328509 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716a6fa4-e1ba-434e-bd4f-ee6a937999f4 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:42.361204 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 927/1823] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:27:41 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 400 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:27:42.379679 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33a8eab-ab04-4ae7-a427-0db6311cbfe3 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:42.381572 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-d33a8eab-ab04-4ae7-a427-0db6311cbfe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:42.387759 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 897/1824] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 19 10:27:42 2022] PUT /identity/v3/projects/6c72b1cd08dd408fbda2cd108a5d4009/users/51b453e2b325451cb1d4fab6d7d658f5/roles/cd5b42ed3b754b58817a62bbe74651b4 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:27:42.400967 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc32c476-14af-4093-baea-ef6cac0a0071 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:42.401605 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc32c476-14af-4093-baea-ef6cac0a0071 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:42.402233 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc32c476-14af-4093-baea-ef6cac0a0071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:42.480223 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-bc32c476-14af-4093-baea-ef6cac0a0071 None None] MFA Rules not processed for user `51b453e2b325451cb1d4fab6d7d658f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:27:42.482742 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-bc32c476-14af-4093-baea-ef6cac0a0071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:42.607657 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:27:42.642088 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33a8eab-ab04-4ae7-a427-0db6311cbfe3 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:42.761787 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:27:42.836115 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 898/1825] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:27:42 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 436 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 10:27:42.837115 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc32c476-14af-4093-baea-ef6cac0a0071 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:42.896977 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d2c458-6197-41bf-95cb-bdd85634896a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa4d004fd44482cae761c4b3bdfab31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:42.897625 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d2c458-6197-41bf-95cb-bdd85634896a service cinder] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:42.897902 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d2c458-6197-41bf-95cb-bdd85634896a service cinder] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:42.898212 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d2c458-6197-41bf-95cb-bdd85634896a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:43.141633 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc32c476-14af-4093-baea-ef6cac0a0071 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:43.154391 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550578ed-7164-4852-8b74-666601e6c281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:43.155332 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550578ed-7164-4852-8b74-666601e6c281 admin admin] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:43.160950 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550578ed-7164-4852-8b74-666601e6c281 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:43.160950 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550578ed-7164-4852-8b74-666601e6c281 admin admin] PATH_INFO: `/v3/projects` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:43.160950 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550578ed-7164-4852-8b74-666601e6c281 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:43.161322 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d2c458-6197-41bf-95cb-bdd85634896a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:43.161322 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d2c458-6197-41bf-95cb-bdd85634896a service cinder] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:43.164037 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550578ed-7164-4852-8b74-666601e6c281 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:43.202192 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 928/1826] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:27:42 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 823 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 10:27:43.343156 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 899/1827] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 19 10:27:42 2022] POST /identity/v3/projects => generated 385 bytes in 503 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:27:43.345659 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d2c458-6197-41bf-95cb-bdd85634896a service cinder] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:43.371345 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d2c458-6197-41bf-95cb-bdd85634896a service cinder] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:43.609407 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad861e7-9afa-4914-b391-0e64a61c010e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:43.610143 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad861e7-9afa-4914-b391-0e64a61c010e admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:43.610521 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad861e7-9afa-4914-b391-0e64a61c010e admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:43.610914 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad861e7-9afa-4914-b391-0e64a61c010e admin admin] PATH_INFO: `/v3/users` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:43.611659 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad861e7-9afa-4914-b391-0e64a61c010e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:43.617132 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad861e7-9afa-4914-b391-0e64a61c010e admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:43.704271 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 929/1828] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 19 10:27:43 2022] POST /identity/v3/users => generated 299 bytes in 359 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 10:27:43.708897 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550578ed-7164-4852-8b74-666601e6c281 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:43.722930 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550578ed-7164-4852-8b74-666601e6c281 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:43.736388 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a1a760-4f1b-4d03-aba4-65d9758519a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:43.738590 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a1a760-4f1b-4d03-aba4-65d9758519a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:43.739745 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a1a760-4f1b-4d03-aba4-65d9758519a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:43.740896 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a1a760-4f1b-4d03-aba4-65d9758519a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:43.741836 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a1a760-4f1b-4d03-aba4-65d9758519a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:43.745158 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a1a760-4f1b-4d03-aba4-65d9758519a5 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:43.773948 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad861e7-9afa-4914-b391-0e64a61c010e admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:43.787239 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 900/1829] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:27:43 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 10:27:43.790739 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad861e7-9afa-4914-b391-0e64a61c010e admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:43.801851 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539afd00-bc81-4ee8-901b-ec54307e445d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:43.802536 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539afd00-bc81-4ee8-901b-ec54307e445d admin admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:43.803082 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539afd00-bc81-4ee8-901b-ec54307e445d admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:43.803082 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539afd00-bc81-4ee8-901b-ec54307e445d admin admin] PATH_INFO: `/v3/projects/8bb153f886654c28913840c08750bff0/users/547534729dc14d3887ccd80d7870df24/roles/5c8b89fae4fa45bd944cbeaf442136e1` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:43.842686 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539afd00-bc81-4ee8-901b-ec54307e445d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bb153f886654c28913840c08750bff0, user_id=547534729dc14d3887ccd80d7870df24, role_id=5c8b89fae4fa45bd944cbeaf442136e1)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:43.845507 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539afd00-bc81-4ee8-901b-ec54307e445d admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:43.885884 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 930/1830] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 19 10:27:43 2022] PUT /identity/v3/projects/8bb153f886654c28913840c08750bff0/users/547534729dc14d3887ccd80d7870df24/roles/5c8b89fae4fa45bd944cbeaf442136e1 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 10:27:43.887290 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a1a760-4f1b-4d03-aba4-65d9758519a5 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:43.904578 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a1a760-4f1b-4d03-aba4-65d9758519a5 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:44.118902 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716727b0-f022-4a35-9dd2-ade1400d9449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:44.122713 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716727b0-f022-4a35-9dd2-ade1400d9449 admin admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:44.122713 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716727b0-f022-4a35-9dd2-ade1400d9449 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:44.122713 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716727b0-f022-4a35-9dd2-ade1400d9449 admin admin] PATH_INFO: `/v3/roles` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:44.123223 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716727b0-f022-4a35-9dd2-ade1400d9449 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:44.129293 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716727b0-f022-4a35-9dd2-ade1400d9449 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:44.181491 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539afd00-bc81-4ee8-901b-ec54307e445d admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:44.215644 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 901/1831] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:27:43 2022] GET /identity/v3/roles => generated 1420 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 10:27:44.221595 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539afd00-bc81-4ee8-901b-ec54307e445d admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:44.253920 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e3528b-d97c-46eb-84c3-f130b04ad123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:44.256119 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e3528b-d97c-46eb-84c3-f130b04ad123 admin admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:44.260730 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e3528b-d97c-46eb-84c3-f130b04ad123 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:44.261130 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e3528b-d97c-46eb-84c3-f130b04ad123 admin admin] PATH_INFO: `/v3/projects/8bb153f886654c28913840c08750bff0/users/547534729dc14d3887ccd80d7870df24/roles/5c8b89fae4fa45bd944cbeaf442136e1` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:44.270495 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e3528b-d97c-46eb-84c3-f130b04ad123 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bb153f886654c28913840c08750bff0, user_id=547534729dc14d3887ccd80d7870df24, role_id=5c8b89fae4fa45bd944cbeaf442136e1)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:44.281865 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e3528b-d97c-46eb-84c3-f130b04ad123 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:44.324231 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 931/1832] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 19 10:27:44 2022] PUT /identity/v3/projects/8bb153f886654c28913840c08750bff0/users/547534729dc14d3887ccd80d7870df24/roles/5c8b89fae4fa45bd944cbeaf442136e1 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:27:44.334234 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4ce3fd-6378-4df3-850f-0059cda6d81f None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:44.334659 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4ce3fd-6378-4df3-850f-0059cda6d81f None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:44.334870 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4ce3fd-6378-4df3-850f-0059cda6d81f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:44.445004 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e3528b-d97c-46eb-84c3-f130b04ad123 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:44.464607 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-0b4ce3fd-6378-4df3-850f-0059cda6d81f None None] MFA Rules not processed for user `547534729dc14d3887ccd80d7870df24`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:27:44.466431 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-0b4ce3fd-6378-4df3-850f-0059cda6d81f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:44.510434 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:27:44.565947 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:27:44.672729 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 902/1833] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:27:44 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:27:44.684516 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e3528b-d97c-46eb-84c3-f130b04ad123 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:44.701411 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de4094d-be95-47f2-9416-633670a6ba80 tempest-VolumeQuotaClassesTest-667001574 tempest-VolumeQuotaClassesTest-667001574-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e20ce3e68c80452f843b0e50aad2f5f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e9df1574f964c0492499e191859a955', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:44.707557 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de4094d-be95-47f2-9416-633670a6ba80 tempest-VolumeQuotaClassesTest-667001574 tempest-VolumeQuotaClassesTest-667001574-project-admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:44.708062 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de4094d-be95-47f2-9416-633670a6ba80 tempest-VolumeQuotaClassesTest-667001574 tempest-VolumeQuotaClassesTest-667001574-project-admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:44.710976 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de4094d-be95-47f2-9416-633670a6ba80 tempest-VolumeQuotaClassesTest-667001574 tempest-VolumeQuotaClassesTest-667001574-project-admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:44.711856 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de4094d-be95-47f2-9416-633670a6ba80 tempest-VolumeQuotaClassesTest-667001574 tempest-VolumeQuotaClassesTest-667001574-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:27:44.713016 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de4094d-be95-47f2-9416-633670a6ba80 tempest-VolumeQuotaClassesTest-667001574 tempest-VolumeQuotaClassesTest-667001574-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:44.721334 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de4094d-be95-47f2-9416-633670a6ba80 tempest-VolumeQuotaClassesTest-667001574 tempest-VolumeQuotaClassesTest-667001574-project-admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:44.767811 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4ce3fd-6378-4df3-850f-0059cda6d81f None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:44.769143 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 932/1834] 10.222.0.66 () {58 vars in 1153 bytes} [Mon Sep 19 10:27:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 10:27:44.791828 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4ce3fd-6378-4df3-850f-0059cda6d81f None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:44.803476 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2912fa5-26fe-4304-873e-511e2f994c42 tempest-VolumeQuotaClassesTest-667001574 tempest-VolumeQuotaClassesTest-667001574-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e20ce3e68c80452f843b0e50aad2f5f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e9df1574f964c0492499e191859a955', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:44.804310 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2912fa5-26fe-4304-873e-511e2f994c42 tempest-VolumeQuotaClassesTest-667001574 tempest-VolumeQuotaClassesTest-667001574-project-admin] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:44.805340 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2912fa5-26fe-4304-873e-511e2f994c42 tempest-VolumeQuotaClassesTest-667001574 tempest-VolumeQuotaClassesTest-667001574-project-admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:44.807929 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2912fa5-26fe-4304-873e-511e2f994c42 tempest-VolumeQuotaClassesTest-667001574 tempest-VolumeQuotaClassesTest-667001574-project-admin] PATH_INFO: `/v3/projects` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:44.809345 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2912fa5-26fe-4304-873e-511e2f994c42 tempest-VolumeQuotaClassesTest-667001574 tempest-VolumeQuotaClassesTest-667001574-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:44.823343 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2912fa5-26fe-4304-873e-511e2f994c42 tempest-VolumeQuotaClassesTest-667001574 tempest-VolumeQuotaClassesTest-667001574-project-admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:44.833097 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de4094d-be95-47f2-9416-633670a6ba80 tempest-VolumeQuotaClassesTest-667001574 tempest-VolumeQuotaClassesTest-667001574-project-admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:44.915924 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 903/1835] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 19 10:27:44 2022] POST /identity/v3/projects => generated 354 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 10:27:44.921358 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2912fa5-26fe-4304-873e-511e2f994c42 tempest-VolumeQuotaClassesTest-667001574 tempest-VolumeQuotaClassesTest-667001574-project-admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:44.993001 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de4094d-be95-47f2-9416-633670a6ba80 tempest-VolumeQuotaClassesTest-667001574 tempest-VolumeQuotaClassesTest-667001574-project-admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:45.075373 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2912fa5-26fe-4304-873e-511e2f994c42 tempest-VolumeQuotaClassesTest-667001574 tempest-VolumeQuotaClassesTest-667001574-project-admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:45.080469 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3da981e-c925-4a6a-abf1-46fb758ae1e5 tempest-VolumeQuotaClassesTest-667001574 tempest-VolumeQuotaClassesTest-667001574-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e20ce3e68c80452f843b0e50aad2f5f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e9df1574f964c0492499e191859a955', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:45.081253 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3da981e-c925-4a6a-abf1-46fb758ae1e5 tempest-VolumeQuotaClassesTest-667001574 tempest-VolumeQuotaClassesTest-667001574-project-admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:45.081641 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3da981e-c925-4a6a-abf1-46fb758ae1e5 tempest-VolumeQuotaClassesTest-667001574 tempest-VolumeQuotaClassesTest-667001574-project-admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:45.082021 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3da981e-c925-4a6a-abf1-46fb758ae1e5 tempest-VolumeQuotaClassesTest-667001574 tempest-VolumeQuotaClassesTest-667001574-project-admin] PATH_INFO: `/v3/domains` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:45.082858 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3da981e-c925-4a6a-abf1-46fb758ae1e5 tempest-VolumeQuotaClassesTest-667001574 tempest-VolumeQuotaClassesTest-667001574-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:27:45.083323 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3da981e-c925-4a6a-abf1-46fb758ae1e5 tempest-VolumeQuotaClassesTest-667001574 tempest-VolumeQuotaClassesTest-667001574-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:45.085102 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3da981e-c925-4a6a-abf1-46fb758ae1e5 tempest-VolumeQuotaClassesTest-667001574 tempest-VolumeQuotaClassesTest-667001574-project-admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:45.108778 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e166a5eb-4be4-4149-bb22-dcc550b21283 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa4d004fd44482cae761c4b3bdfab31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:45.109411 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e166a5eb-4be4-4149-bb22-dcc550b21283 service cinder] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:45.109713 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e166a5eb-4be4-4149-bb22-dcc550b21283 service cinder] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:45.109958 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e166a5eb-4be4-4149-bb22-dcc550b21283 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:45.131699 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 904/1836] 10.222.0.66 () {58 vars in 1153 bytes} [Mon Sep 19 10:27:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:27:45.209367 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e166a5eb-4be4-4149-bb22-dcc550b21283 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:45.211236 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e166a5eb-4be4-4149-bb22-dcc550b21283 service cinder] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:45.250411 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 933/1837] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:27:44 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:27:45.276784 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3da981e-c925-4a6a-abf1-46fb758ae1e5 tempest-VolumeQuotaClassesTest-667001574 tempest-VolumeQuotaClassesTest-667001574-project-admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:45.295951 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3da981e-c925-4a6a-abf1-46fb758ae1e5 tempest-VolumeQuotaClassesTest-667001574 tempest-VolumeQuotaClassesTest-667001574-project-admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:45.330091 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b8691f-e8bf-44d4-926b-7c752853769a tempest-VolumeQuotaClassesTest-667001574 tempest-VolumeQuotaClassesTest-667001574-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e20ce3e68c80452f843b0e50aad2f5f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e9df1574f964c0492499e191859a955', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:45.332449 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b8691f-e8bf-44d4-926b-7c752853769a tempest-VolumeQuotaClassesTest-667001574 tempest-VolumeQuotaClassesTest-667001574-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:45.336579 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b8691f-e8bf-44d4-926b-7c752853769a tempest-VolumeQuotaClassesTest-667001574 tempest-VolumeQuotaClassesTest-667001574-project-admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:45.337153 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b8691f-e8bf-44d4-926b-7c752853769a tempest-VolumeQuotaClassesTest-667001574 tempest-VolumeQuotaClassesTest-667001574-project-admin] PATH_INFO: `/v3/projects/08e52b1d57c34b29b20caf09d0d168a8` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:45.342346 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b8691f-e8bf-44d4-926b-7c752853769a tempest-VolumeQuotaClassesTest-667001574 tempest-VolumeQuotaClassesTest-667001574-project-admin] RBAC: Authorizing `identity:delete_project(project_id=08e52b1d57c34b29b20caf09d0d168a8)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:45.345647 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b8691f-e8bf-44d4-926b-7c752853769a tempest-VolumeQuotaClassesTest-667001574 tempest-VolumeQuotaClassesTest-667001574-project-admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:45.461555 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-13b8691f-e8bf-44d4-926b-7c752853769a tempest-VolumeQuotaClassesTest-667001574 tempest-VolumeQuotaClassesTest-667001574-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08e52b1d57c34b29b20caf09d0d168a8', 'request_id': 'req-13b8691f-e8bf-44d4-926b-7c752853769a'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:45.486503 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-13b8691f-e8bf-44d4-926b-7c752853769a tempest-VolumeQuotaClassesTest-667001574 tempest-VolumeQuotaClassesTest-667001574-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08e52b1d57c34b29b20caf09d0d168a8', 'request_id': 'req-13b8691f-e8bf-44d4-926b-7c752853769a'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:45.510235 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-13b8691f-e8bf-44d4-926b-7c752853769a tempest-VolumeQuotaClassesTest-667001574 tempest-VolumeQuotaClassesTest-667001574-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08e52b1d57c34b29b20caf09d0d168a8', 'request_id': 'req-13b8691f-e8bf-44d4-926b-7c752853769a'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:45.534269 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-13b8691f-e8bf-44d4-926b-7c752853769a tempest-VolumeQuotaClassesTest-667001574 tempest-VolumeQuotaClassesTest-667001574-project-admin] The token cache is being invalidate because project 08e52b1d57c34b29b20caf09d0d168a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 10:27:45.534606 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-13b8691f-e8bf-44d4-926b-7c752853769a tempest-VolumeQuotaClassesTest-667001574 tempest-VolumeQuotaClassesTest-667001574-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:45.535323 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-13b8691f-e8bf-44d4-926b-7c752853769a tempest-VolumeQuotaClassesTest-667001574 tempest-VolumeQuotaClassesTest-667001574-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:45.542004 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 905/1838] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 19 10:27:45 2022] DELETE /identity/v3/projects/08e52b1d57c34b29b20caf09d0d168a8 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:27:46.169406 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e166a5eb-4be4-4149-bb22-dcc550b21283 service cinder] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:46.238524 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e840bf97-1dba-4236-a0a2-20161763c190 None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:46.238963 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e840bf97-1dba-4236-a0a2-20161763c190 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:46.239311 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e840bf97-1dba-4236-a0a2-20161763c190 None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:46.241005 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 906/1839] 10.222.0.66 () {54 vars in 921 bytes} [Mon Sep 19 10:27:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:27:46.248775 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:27:46.314144 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfb643a-2223-42cc-b8fb-c9e057346650 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:46.315240 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfb643a-2223-42cc-b8fb-c9e057346650 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:46.315240 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfb643a-2223-42cc-b8fb-c9e057346650 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:46.352727 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e166a5eb-4be4-4149-bb22-dcc550b21283 service cinder] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:46.379036 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-9bfb643a-2223-42cc-b8fb-c9e057346650 None None] MFA Rules not processed for user `15c70bfb085a44e9b84942b480ff22f1`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:27:46.385116 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-9bfb643a-2223-42cc-b8fb-c9e057346650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:46.473289 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:27:46.602765 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acf28f2-e861-419c-bc93-0c2c5841b404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:46.607062 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acf28f2-e861-419c-bc93-0c2c5841b404 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:46.610561 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acf28f2-e861-419c-bc93-0c2c5841b404 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:46.611591 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acf28f2-e861-419c-bc93-0c2c5841b404 admin admin] PATH_INFO: `/v3/users/285cc1097dbb4c26aa7f1df77ff0b34f` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:46.617339 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acf28f2-e861-419c-bc93-0c2c5841b404 admin admin] RBAC: Authorizing `identity:delete_user(user_id=285cc1097dbb4c26aa7f1df77ff0b34f)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:46.628752 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acf28f2-e861-419c-bc93-0c2c5841b404 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:46.665786 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 907/1840] 10.222.0.66 () {58 vars in 1018 bytes} [Mon Sep 19 10:27:46 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 354 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 10:27:46.800408 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-1acf28f2-e861-419c-bc93-0c2c5841b404 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '285cc1097dbb4c26aa7f1df77ff0b34f'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:46.819111 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-1acf28f2-e861-419c-bc93-0c2c5841b404 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '285cc1097dbb4c26aa7f1df77ff0b34f'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:46.820150 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-1acf28f2-e861-419c-bc93-0c2c5841b404 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '285cc1097dbb4c26aa7f1df77ff0b34f'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:46.820810 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-1acf28f2-e861-419c-bc93-0c2c5841b404 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '285cc1097dbb4c26aa7f1df77ff0b34f'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:46.843061 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-1acf28f2-e861-419c-bc93-0c2c5841b404 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '285cc1097dbb4c26aa7f1df77ff0b34f'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:46.899189 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 934/1841] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 19 10:27:46 2022] DELETE /identity/v3/users/285cc1097dbb4c26aa7f1df77ff0b34f => generated 0 bytes in 730 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:27:46.901025 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d12a2ad-e315-4e94-81b1-52adb76e4c35 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:46.901438 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d12a2ad-e315-4e94-81b1-52adb76e4c35 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:46.901818 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d12a2ad-e315-4e94-81b1-52adb76e4c35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:46.938661 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-6d12a2ad-e315-4e94-81b1-52adb76e4c35 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:27:46.940027 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-6d12a2ad-e315-4e94-81b1-52adb76e4c35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:47.055359 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 908/1842] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:27:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:27:47.156236 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acf28f2-e861-419c-bc93-0c2c5841b404 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:47.157828 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-1acf28f2-e861-419c-bc93-0c2c5841b404 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:47.329828 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acf28f2-e861-419c-bc93-0c2c5841b404 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:47.337206 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28badb52-785c-4f94-8dde-4a8a4241cd84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c1289b015854c6bb6aee8fed6b807db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:47.337847 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28badb52-785c-4f94-8dde-4a8a4241cd84 service neutron] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:47.338129 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28badb52-785c-4f94-8dde-4a8a4241cd84 service neutron] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:47.338405 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28badb52-785c-4f94-8dde-4a8a4241cd84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:47.357025 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:27:47.360436 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28badb52-785c-4f94-8dde-4a8a4241cd84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:47.361972 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28badb52-785c-4f94-8dde-4a8a4241cd84 service neutron] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:47.394149 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 935/1843] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:27:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:27:47.475235 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d12a2ad-e315-4e94-81b1-52adb76e4c35 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:47.477350 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-6d12a2ad-e315-4e94-81b1-52adb76e4c35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:47.663755 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d12a2ad-e315-4e94-81b1-52adb76e4c35 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:47.676309 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d926588e-715d-4752-a218-e6c4d7fc76af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa4d004fd44482cae761c4b3bdfab31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:47.677335 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d926588e-715d-4752-a218-e6c4d7fc76af service cinder] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:47.677777 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d926588e-715d-4752-a218-e6c4d7fc76af service cinder] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:47.678262 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d926588e-715d-4752-a218-e6c4d7fc76af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:47.680893 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-d926588e-715d-4752-a218-e6c4d7fc76af service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:47.762352 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28badb52-785c-4f94-8dde-4a8a4241cd84 service neutron] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:47.769037 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-28badb52-785c-4f94-8dde-4a8a4241cd84 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:47.823655 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d926588e-715d-4752-a218-e6c4d7fc76af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:47.826145 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d926588e-715d-4752-a218-e6c4d7fc76af service cinder] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:47.855435 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 909/1844] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:27:47 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:27:47.939697 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28badb52-785c-4f94-8dde-4a8a4241cd84 service neutron] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:47.952456 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2650417-75bc-4b8e-8d76-64f2a69eb62f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15c70bfb085a44e9b84942b480ff22f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:47.953532 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2650417-75bc-4b8e-8d76-64f2a69eb62f service nova] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:47.954051 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2650417-75bc-4b8e-8d76-64f2a69eb62f service nova] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:47.954480 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2650417-75bc-4b8e-8d76-64f2a69eb62f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:47.957259 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-a2650417-75bc-4b8e-8d76-64f2a69eb62f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:47.982447 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2650417-75bc-4b8e-8d76-64f2a69eb62f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:47.985526 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2650417-75bc-4b8e-8d76-64f2a69eb62f service nova] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:48.013285 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 936/1845] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:27:47 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:27:48.753530 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d926588e-715d-4752-a218-e6c4d7fc76af service cinder] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:48.756991 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-d926588e-715d-4752-a218-e6c4d7fc76af service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:48.787891 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d926588e-715d-4752-a218-e6c4d7fc76af service cinder] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:48.802941 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafd222d-ffd5-4e64-8713-84a523172193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:48.804254 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafd222d-ffd5-4e64-8713-84a523172193 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:48.804708 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafd222d-ffd5-4e64-8713-84a523172193 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:48.809652 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafd222d-ffd5-4e64-8713-84a523172193 admin admin] PATH_INFO: `/v3/projects/d79f9e6f880847f7a66a6aa89d31bc41` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:48.811359 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafd222d-ffd5-4e64-8713-84a523172193 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d79f9e6f880847f7a66a6aa89d31bc41)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:48.813581 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafd222d-ffd5-4e64-8713-84a523172193 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:48.821861 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:27:48.897224 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-eafd222d-ffd5-4e64-8713-84a523172193 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd79f9e6f880847f7a66a6aa89d31bc41', 'request_id': 'req-eafd222d-ffd5-4e64-8713-84a523172193'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:48.915174 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3143b2a3-9391-4b28-bb56-18acd58529dc None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:48.916527 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3143b2a3-9391-4b28-bb56-18acd58529dc None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:48.917112 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3143b2a3-9391-4b28-bb56-18acd58529dc None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:48.921892 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 937/1846] 10.222.0.66 () {54 vars in 921 bytes} [Mon Sep 19 10:27:48 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:27:48.923396 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-eafd222d-ffd5-4e64-8713-84a523172193 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd79f9e6f880847f7a66a6aa89d31bc41', 'request_id': 'req-eafd222d-ffd5-4e64-8713-84a523172193'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:48.951422 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-eafd222d-ffd5-4e64-8713-84a523172193 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd79f9e6f880847f7a66a6aa89d31bc41', 'request_id': 'req-eafd222d-ffd5-4e64-8713-84a523172193'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:48.975112 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-eafd222d-ffd5-4e64-8713-84a523172193 admin admin] The token cache is being invalidate because project d79f9e6f880847f7a66a6aa89d31bc41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 10:27:48.975740 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-eafd222d-ffd5-4e64-8713-84a523172193 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:48.982221 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-eafd222d-ffd5-4e64-8713-84a523172193 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:48.984189 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a664d4b4-979c-450a-9ccb-2247b0bcb3fa None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:48.984463 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a664d4b4-979c-450a-9ccb-2247b0bcb3fa None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:48.985282 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a664d4b4-979c-450a-9ccb-2247b0bcb3fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:48.993523 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 910/1847] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 19 10:27:48 2022] DELETE /identity/v3/projects/d79f9e6f880847f7a66a6aa89d31bc41 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:27:49.005503 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafd222d-ffd5-4e64-8713-84a523172193 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:49.007534 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-eafd222d-ffd5-4e64-8713-84a523172193 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:49.024869 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-a664d4b4-979c-450a-9ccb-2247b0bcb3fa None None] MFA Rules not processed for user `15c70bfb085a44e9b84942b480ff22f1`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:27:49.028447 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-a664d4b4-979c-450a-9ccb-2247b0bcb3fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:49.204965 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 938/1848] 10.222.0.66 () {58 vars in 1018 bytes} [Mon Sep 19 10:27:48 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:27:49.230254 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafd222d-ffd5-4e64-8713-84a523172193 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:49.257577 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2dc878-bd8e-4b82-a9ff-5a0aaef87a37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:49.258410 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2dc878-bd8e-4b82-a9ff-5a0aaef87a37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:49.258783 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2dc878-bd8e-4b82-a9ff-5a0aaef87a37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:49.260239 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2dc878-bd8e-4b82-a9ff-5a0aaef87a37 admin admin] PATH_INFO: `/v3/users/e20ce3e68c80452f843b0e50aad2f5f7` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:49.261738 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2dc878-bd8e-4b82-a9ff-5a0aaef87a37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e20ce3e68c80452f843b0e50aad2f5f7)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:49.271827 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a664d4b4-979c-450a-9ccb-2247b0bcb3fa None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:49.274562 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2dc878-bd8e-4b82-a9ff-5a0aaef87a37 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:49.276300 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-a664d4b4-979c-450a-9ccb-2247b0bcb3fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:49.350997 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a664d4b4-979c-450a-9ccb-2247b0bcb3fa None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:49.370535 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77cc5d3-1c79-43e8-a3b9-cce9645ee4e7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15c70bfb085a44e9b84942b480ff22f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:49.371370 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77cc5d3-1c79-43e8-a3b9-cce9645ee4e7 service nova] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:49.373907 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77cc5d3-1c79-43e8-a3b9-cce9645ee4e7 service nova] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:49.374228 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77cc5d3-1c79-43e8-a3b9-cce9645ee4e7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:49.393377 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77cc5d3-1c79-43e8-a3b9-cce9645ee4e7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:49.393913 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-5d2dc878-bd8e-4b82-a9ff-5a0aaef87a37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e20ce3e68c80452f843b0e50aad2f5f7'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:49.410758 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77cc5d3-1c79-43e8-a3b9-cce9645ee4e7 service nova] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:49.415134 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-5d2dc878-bd8e-4b82-a9ff-5a0aaef87a37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e20ce3e68c80452f843b0e50aad2f5f7'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:49.415831 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-5d2dc878-bd8e-4b82-a9ff-5a0aaef87a37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e20ce3e68c80452f843b0e50aad2f5f7'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:49.419796 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-5d2dc878-bd8e-4b82-a9ff-5a0aaef87a37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e20ce3e68c80452f843b0e50aad2f5f7'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:49.450436 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 939/1849] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:27:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:27:49.457071 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-5d2dc878-bd8e-4b82-a9ff-5a0aaef87a37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e20ce3e68c80452f843b0e50aad2f5f7'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:49.521045 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 911/1850] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 19 10:27:49 2022] DELETE /identity/v3/users/e20ce3e68c80452f843b0e50aad2f5f7 => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:27:50.079754 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77cc5d3-1c79-43e8-a3b9-cce9645ee4e7 service nova] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:50.081687 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-b77cc5d3-1c79-43e8-a3b9-cce9645ee4e7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:50.104578 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77cc5d3-1c79-43e8-a3b9-cce9645ee4e7 service nova] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:50.138251 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2dc878-bd8e-4b82-a9ff-5a0aaef87a37 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:50.141289 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-5d2dc878-bd8e-4b82-a9ff-5a0aaef87a37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:50.226247 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:27:50.272076 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57ea76b-0856-4f26-8364-9dc20a9964d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:50.272954 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57ea76b-0856-4f26-8364-9dc20a9964d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:50.273244 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57ea76b-0856-4f26-8364-9dc20a9964d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:50.273560 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57ea76b-0856-4f26-8364-9dc20a9964d5 admin admin] PATH_INFO: `/v3/users/0524275bcfd348f694cde07ee4357f45` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:50.274855 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57ea76b-0856-4f26-8364-9dc20a9964d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0524275bcfd348f694cde07ee4357f45)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:50.289559 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57ea76b-0856-4f26-8364-9dc20a9964d5 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:50.291415 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:27:50.317942 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2dc878-bd8e-4b82-a9ff-5a0aaef87a37 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:50.324206 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f72cdd3-a6c4-4179-bac9-dfc9a84fd454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:50.325469 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f72cdd3-a6c4-4179-bac9-dfc9a84fd454 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:50.325720 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f72cdd3-a6c4-4179-bac9-dfc9a84fd454 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:50.326048 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f72cdd3-a6c4-4179-bac9-dfc9a84fd454 admin admin] PATH_INFO: `/v3/projects/6e9df1574f964c0492499e191859a955` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:50.327328 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f72cdd3-a6c4-4179-bac9-dfc9a84fd454 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e9df1574f964c0492499e191859a955)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:50.329528 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f72cdd3-a6c4-4179-bac9-dfc9a84fd454 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:50.355070 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-e57ea76b-0856-4f26-8364-9dc20a9964d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0524275bcfd348f694cde07ee4357f45'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:50.364077 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-e57ea76b-0856-4f26-8364-9dc20a9964d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0524275bcfd348f694cde07ee4357f45'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:50.365709 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-e57ea76b-0856-4f26-8364-9dc20a9964d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0524275bcfd348f694cde07ee4357f45'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:50.368304 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-e57ea76b-0856-4f26-8364-9dc20a9964d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0524275bcfd348f694cde07ee4357f45'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:50.381090 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-e57ea76b-0856-4f26-8364-9dc20a9964d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0524275bcfd348f694cde07ee4357f45'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:50.411937 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-8f72cdd3-a6c4-4179-bac9-dfc9a84fd454 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e9df1574f964c0492499e191859a955', 'request_id': 'req-8f72cdd3-a6c4-4179-bac9-dfc9a84fd454'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:50.421140 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-8f72cdd3-a6c4-4179-bac9-dfc9a84fd454 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e9df1574f964c0492499e191859a955', 'request_id': 'req-8f72cdd3-a6c4-4179-bac9-dfc9a84fd454'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:50.424926 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 940/1851] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 19 10:27:50 2022] DELETE /identity/v3/users/0524275bcfd348f694cde07ee4357f45 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:27:50.430445 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-8f72cdd3-a6c4-4179-bac9-dfc9a84fd454 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e9df1574f964c0492499e191859a955', 'request_id': 'req-8f72cdd3-a6c4-4179-bac9-dfc9a84fd454'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:50.441063 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44619597-1777-4f25-8a00-9a8c708601cd None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:50.441737 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44619597-1777-4f25-8a00-9a8c708601cd None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:50.442241 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44619597-1777-4f25-8a00-9a8c708601cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:50.445393 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-8f72cdd3-a6c4-4179-bac9-dfc9a84fd454 admin admin] The token cache is being invalidate because project 6e9df1574f964c0492499e191859a955 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 10:27:50.445754 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-8f72cdd3-a6c4-4179-bac9-dfc9a84fd454 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:50.447098 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-8f72cdd3-a6c4-4179-bac9-dfc9a84fd454 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:50.452392 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 912/1852] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 19 10:27:50 2022] DELETE /identity/v3/projects/6e9df1574f964c0492499e191859a955 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:27:50.453789 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91f1b2f-4d84-4b87-b0ab-b5ebea3565cb None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:50.454075 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91f1b2f-4d84-4b87-b0ab-b5ebea3565cb None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:50.454403 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91f1b2f-4d84-4b87-b0ab-b5ebea3565cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:50.470139 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-44619597-1777-4f25-8a00-9a8c708601cd None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:27:50.473184 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-44619597-1777-4f25-8a00-9a8c708601cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:50.477904 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-a91f1b2f-4d84-4b87-b0ab-b5ebea3565cb None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:27:50.479384 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-a91f1b2f-4d84-4b87-b0ab-b5ebea3565cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:50.550385 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 941/1853] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:27:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 10:27:50.556121 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 913/1854] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:27:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:27:50.561244 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44619597-1777-4f25-8a00-9a8c708601cd None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:50.563038 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-44619597-1777-4f25-8a00-9a8c708601cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:50.565133 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76143f88-50f4-40f3-88cd-d69cdff3877c None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:50.565481 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76143f88-50f4-40f3-88cd-d69cdff3877c None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:50.565794 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76143f88-50f4-40f3-88cd-d69cdff3877c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:50.586728 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-76143f88-50f4-40f3-88cd-d69cdff3877c None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:27:50.588019 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-76143f88-50f4-40f3-88cd-d69cdff3877c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:50.599366 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 914/1855] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:27:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:27:50.600739 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76143f88-50f4-40f3-88cd-d69cdff3877c None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:50.612400 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76143f88-50f4-40f3-88cd-d69cdff3877c None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:50.617764 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f763111-5826-46e7-a862-cce9456b74c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:50.618388 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f763111-5826-46e7-a862-cce9456b74c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:50.618678 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f763111-5826-46e7-a862-cce9456b74c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:50.618950 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f763111-5826-46e7-a862-cce9456b74c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:50.619593 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f763111-5826-46e7-a862-cce9456b74c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:27:50.619897 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f763111-5826-46e7-a862-cce9456b74c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:50.623011 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f763111-5826-46e7-a862-cce9456b74c6 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:50.626028 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44619597-1777-4f25-8a00-9a8c708601cd None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:50.629684 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7261b9-936f-4fec-8cd3-14553f9c4347 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c1289b015854c6bb6aee8fed6b807db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:50.630445 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7261b9-936f-4fec-8cd3-14553f9c4347 service neutron] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:50.630897 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7261b9-936f-4fec-8cd3-14553f9c4347 service neutron] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:50.631397 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7261b9-936f-4fec-8cd3-14553f9c4347 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:50.640815 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 915/1856] 10.222.0.66 () {58 vars in 1153 bytes} [Mon Sep 19 10:27:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 10:27:50.641789 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f763111-5826-46e7-a862-cce9456b74c6 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:50.645380 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7261b9-936f-4fec-8cd3-14553f9c4347 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:50.647204 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7261b9-936f-4fec-8cd3-14553f9c4347 service neutron] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:50.652799 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f763111-5826-46e7-a862-cce9456b74c6 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:50.657231 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8e94a5-9c01-43bd-90ae-a9c75065a893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:50.657835 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8e94a5-9c01-43bd-90ae-a9c75065a893 admin admin] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:50.658125 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8e94a5-9c01-43bd-90ae-a9c75065a893 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:50.658386 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8e94a5-9c01-43bd-90ae-a9c75065a893 admin admin] PATH_INFO: `/v3/projects` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:50.659012 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8e94a5-9c01-43bd-90ae-a9c75065a893 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:50.660981 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8e94a5-9c01-43bd-90ae-a9c75065a893 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:50.661106 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 942/1857] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:27:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:27:50.700207 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 916/1858] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 19 10:27:50 2022] POST /identity/v3/projects => generated 389 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 10:27:50.703354 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7261b9-936f-4fec-8cd3-14553f9c4347 service neutron] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:50.713273 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7261b9-936f-4fec-8cd3-14553f9c4347 service neutron] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:50.734056 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:27:50.783833 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adf22a3-dec6-4f4b-b6d6-58520676c15c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:50.784845 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adf22a3-dec6-4f4b-b6d6-58520676c15c admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:50.785201 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adf22a3-dec6-4f4b-b6d6-58520676c15c admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:50.785550 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adf22a3-dec6-4f4b-b6d6-58520676c15c admin admin] PATH_INFO: `/v3/users` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:50.786286 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adf22a3-dec6-4f4b-b6d6-58520676c15c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:50.789005 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adf22a3-dec6-4f4b-b6d6-58520676c15c admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:50.818013 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 943/1859] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 19 10:27:50 2022] POST /identity/v3/users => generated 295 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:27:50.820511 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8e94a5-9c01-43bd-90ae-a9c75065a893 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:50.827679 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:27:50.847943 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8e94a5-9c01-43bd-90ae-a9c75065a893 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:50.854769 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7aad170-8b8d-4c68-ad31-e85317c24ff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:50.855471 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aad170-8b8d-4c68-ad31-e85317c24ff3 admin admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:50.856288 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aad170-8b8d-4c68-ad31-e85317c24ff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:50.856570 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aad170-8b8d-4c68-ad31-e85317c24ff3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:50.857469 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7aad170-8b8d-4c68-ad31-e85317c24ff3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:50.859092 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7aad170-8b8d-4c68-ad31-e85317c24ff3 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:50.870827 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 917/1860] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:27:50 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 10:27:50.874704 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adf22a3-dec6-4f4b-b6d6-58520676c15c admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:50.891386 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adf22a3-dec6-4f4b-b6d6-58520676c15c admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:50.904872 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d31b7f-045d-4800-ad92-809f1317cc5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:50.905956 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d31b7f-045d-4800-ad92-809f1317cc5e admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:50.905956 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d31b7f-045d-4800-ad92-809f1317cc5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:50.906153 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d31b7f-045d-4800-ad92-809f1317cc5e admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:50.906665 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d31b7f-045d-4800-ad92-809f1317cc5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:50.908292 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d31b7f-045d-4800-ad92-809f1317cc5e admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:50.946075 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7aad170-8b8d-4c68-ad31-e85317c24ff3 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:50.946401 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 944/1861] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:27:50 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 10:27:50.959018 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7aad170-8b8d-4c68-ad31-e85317c24ff3 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:50.974565 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17819e12-a3f2-4382-b0a3-ffa6b60ed0ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:50.975210 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17819e12-a3f2-4382-b0a3-ffa6b60ed0ee admin admin] REQUEST_METHOD: `PUT` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:50.975488 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17819e12-a3f2-4382-b0a3-ffa6b60ed0ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:50.975769 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17819e12-a3f2-4382-b0a3-ffa6b60ed0ee admin admin] PATH_INFO: `/v3/projects/d99e742b50044a9b9983670daff4980b/users/09fde2d43a654f58933f1cdd96f1ebc3/roles/cd5b42ed3b754b58817a62bbe74651b4` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:51.031186 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17819e12-a3f2-4382-b0a3-ffa6b60ed0ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=d99e742b50044a9b9983670daff4980b, user_id=09fde2d43a654f58933f1cdd96f1ebc3, role_id=cd5b42ed3b754b58817a62bbe74651b4)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:51.037507 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17819e12-a3f2-4382-b0a3-ffa6b60ed0ee admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:51.065506 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 918/1862] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 19 10:27:50 2022] PUT /identity/v3/projects/d99e742b50044a9b9983670daff4980b/users/09fde2d43a654f58933f1cdd96f1ebc3/roles/cd5b42ed3b754b58817a62bbe74651b4 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:27:51.072454 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f86710-adc0-48c8-b6cb-3ac78ac9f139 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:51.072739 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f86710-adc0-48c8-b6cb-3ac78ac9f139 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:51.073038 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f86710-adc0-48c8-b6cb-3ac78ac9f139 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:51.119503 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-07f86710-adc0-48c8-b6cb-3ac78ac9f139 None None] MFA Rules not processed for user `09fde2d43a654f58933f1cdd96f1ebc3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:27:51.121395 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-07f86710-adc0-48c8-b6cb-3ac78ac9f139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:51.145950 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17819e12-a3f2-4382-b0a3-ffa6b60ed0ee admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:51.148155 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-17819e12-a3f2-4382-b0a3-ffa6b60ed0ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:51.282556 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 945/1863] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:27:51 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:27:51.286915 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f86710-adc0-48c8-b6cb-3ac78ac9f139 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:51.317577 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17819e12-a3f2-4382-b0a3-ffa6b60ed0ee admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:51.319563 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f86710-adc0-48c8-b6cb-3ac78ac9f139 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:51.327062 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04194d8-bc46-4115-8364-f09ee042b7ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:51.327844 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04194d8-bc46-4115-8364-f09ee042b7ea admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:51.328270 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04194d8-bc46-4115-8364-f09ee042b7ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:51.328650 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04194d8-bc46-4115-8364-f09ee042b7ea admin admin] PATH_INFO: `/v3/projects` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:51.329390 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04194d8-bc46-4115-8364-f09ee042b7ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:51.332116 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04194d8-bc46-4115-8364-f09ee042b7ea admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:51.339097 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7a4ee7-8b8d-4958-982b-b23dad6bc1d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:51.339896 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7a4ee7-8b8d-4958-982b-b23dad6bc1d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:51.340720 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7a4ee7-8b8d-4958-982b-b23dad6bc1d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:51.341044 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7a4ee7-8b8d-4958-982b-b23dad6bc1d8 admin admin] PATH_INFO: `/v3/projects/fbbc2f38fb614d738c915a6dc8ca8410` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:51.342452 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7a4ee7-8b8d-4958-982b-b23dad6bc1d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fbbc2f38fb614d738c915a6dc8ca8410)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:51.344670 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7a4ee7-8b8d-4958-982b-b23dad6bc1d8 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:51.386109 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 946/1864] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 19 10:27:51 2022] POST /identity/v3/projects => generated 389 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:27:51.389010 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04194d8-bc46-4115-8364-f09ee042b7ea admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:51.411939 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-ad7a4ee7-8b8d-4958-982b-b23dad6bc1d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fbbc2f38fb614d738c915a6dc8ca8410', 'request_id': 'req-ad7a4ee7-8b8d-4958-982b-b23dad6bc1d8'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:51.418887 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-ad7a4ee7-8b8d-4958-982b-b23dad6bc1d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fbbc2f38fb614d738c915a6dc8ca8410', 'request_id': 'req-ad7a4ee7-8b8d-4958-982b-b23dad6bc1d8'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:51.429104 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-ad7a4ee7-8b8d-4958-982b-b23dad6bc1d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fbbc2f38fb614d738c915a6dc8ca8410', 'request_id': 'req-ad7a4ee7-8b8d-4958-982b-b23dad6bc1d8'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:51.443803 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-ad7a4ee7-8b8d-4958-982b-b23dad6bc1d8 admin admin] The token cache is being invalidate because project fbbc2f38fb614d738c915a6dc8ca8410 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 10:27:51.444141 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-ad7a4ee7-8b8d-4958-982b-b23dad6bc1d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:51.444876 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-ad7a4ee7-8b8d-4958-982b-b23dad6bc1d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:51.448482 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 919/1865] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 19 10:27:51 2022] DELETE /identity/v3/projects/fbbc2f38fb614d738c915a6dc8ca8410 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:27:51.452117 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7a4ee7-8b8d-4958-982b-b23dad6bc1d8 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:51.455585 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-ad7a4ee7-8b8d-4958-982b-b23dad6bc1d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:51.491774 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04194d8-bc46-4115-8364-f09ee042b7ea admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:51.508248 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:27:51.531852 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:27:51.536299 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7a4ee7-8b8d-4958-982b-b23dad6bc1d8 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:51.547614 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0452439d-4824-409b-94eb-3ca99e47a49f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:51.548330 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0452439d-4824-409b-94eb-3ca99e47a49f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:51.548612 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0452439d-4824-409b-94eb-3ca99e47a49f admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:51.548883 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0452439d-4824-409b-94eb-3ca99e47a49f admin admin] PATH_INFO: `/v3/users/1dcb1f77e3b6467a8ed6cb60f44323d0` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:51.550043 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0452439d-4824-409b-94eb-3ca99e47a49f admin admin] RBAC: Authorizing `identity:delete_user(user_id=1dcb1f77e3b6467a8ed6cb60f44323d0)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:51.552055 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0452439d-4824-409b-94eb-3ca99e47a49f admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:51.569307 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d732de-23bb-4dbc-b6de-8521a3d17ab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:51.570471 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d732de-23bb-4dbc-b6de-8521a3d17ab0 admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:51.571174 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d732de-23bb-4dbc-b6de-8521a3d17ab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:51.571552 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d732de-23bb-4dbc-b6de-8521a3d17ab0 admin admin] PATH_INFO: `/v3/users` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:51.572334 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d732de-23bb-4dbc-b6de-8521a3d17ab0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:51.576001 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d732de-23bb-4dbc-b6de-8521a3d17ab0 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:51.601482 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 947/1866] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 19 10:27:51 2022] POST /identity/v3/users => generated 301 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:27:51.605286 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d732de-23bb-4dbc-b6de-8521a3d17ab0 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:51.607265 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-53d732de-23bb-4dbc-b6de-8521a3d17ab0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:51.623416 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d732de-23bb-4dbc-b6de-8521a3d17ab0 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:51.626813 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-0452439d-4824-409b-94eb-3ca99e47a49f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1dcb1f77e3b6467a8ed6cb60f44323d0'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:51.630267 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8957d302-fcac-418b-aa62-84606ce6f02b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:51.631155 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8957d302-fcac-418b-aa62-84606ce6f02b admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:51.631577 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8957d302-fcac-418b-aa62-84606ce6f02b admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:51.632008 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8957d302-fcac-418b-aa62-84606ce6f02b admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:51.632791 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8957d302-fcac-418b-aa62-84606ce6f02b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:51.635945 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8957d302-fcac-418b-aa62-84606ce6f02b admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:51.640697 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-0452439d-4824-409b-94eb-3ca99e47a49f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1dcb1f77e3b6467a8ed6cb60f44323d0'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:51.641658 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-0452439d-4824-409b-94eb-3ca99e47a49f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1dcb1f77e3b6467a8ed6cb60f44323d0'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:51.642661 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-0452439d-4824-409b-94eb-3ca99e47a49f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1dcb1f77e3b6467a8ed6cb60f44323d0'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:51.650486 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 948/1867] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:27:51 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 10:27:51.655087 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8957d302-fcac-418b-aa62-84606ce6f02b admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:51.656895 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-0452439d-4824-409b-94eb-3ca99e47a49f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1dcb1f77e3b6467a8ed6cb60f44323d0'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:51.658114 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-8957d302-fcac-418b-aa62-84606ce6f02b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:51.676930 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8957d302-fcac-418b-aa62-84606ce6f02b admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:51.683986 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5804cc6c-a4f7-440e-b902-c75e5b84b929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:51.687496 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5804cc6c-a4f7-440e-b902-c75e5b84b929 admin admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:51.687496 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5804cc6c-a4f7-440e-b902-c75e5b84b929 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:51.687496 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5804cc6c-a4f7-440e-b902-c75e5b84b929 admin admin] PATH_INFO: `/v3/projects/dfafabc8683549f0bcc4d5f8f7d60d45/users/0854e9e563ab45f9bbfae24d3972af0c/roles/5c8b89fae4fa45bd944cbeaf442136e1` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:51.689992 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 920/1868] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 19 10:27:51 2022] DELETE /identity/v3/users/1dcb1f77e3b6467a8ed6cb60f44323d0 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:27:51.709816 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5804cc6c-a4f7-440e-b902-c75e5b84b929 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfafabc8683549f0bcc4d5f8f7d60d45, user_id=0854e9e563ab45f9bbfae24d3972af0c, role_id=5c8b89fae4fa45bd944cbeaf442136e1)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:51.712899 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5804cc6c-a4f7-440e-b902-c75e5b84b929 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:51.733248 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 949/1869] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 19 10:27:51 2022] PUT /identity/v3/projects/dfafabc8683549f0bcc4d5f8f7d60d45/users/0854e9e563ab45f9bbfae24d3972af0c/roles/5c8b89fae4fa45bd944cbeaf442136e1 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 10:27:51.737895 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0452439d-4824-409b-94eb-3ca99e47a49f admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:51.820308 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0452439d-4824-409b-94eb-3ca99e47a49f admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:51.896977 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1874c2e2-45a6-48d1-8f83-4100cfe0dea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:51.897615 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1874c2e2-45a6-48d1-8f83-4100cfe0dea7 admin admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:51.898024 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1874c2e2-45a6-48d1-8f83-4100cfe0dea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:51.898210 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1874c2e2-45a6-48d1-8f83-4100cfe0dea7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:51.899013 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1874c2e2-45a6-48d1-8f83-4100cfe0dea7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:51.900670 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1874c2e2-45a6-48d1-8f83-4100cfe0dea7 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:51.912328 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 921/1870] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:27:51 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 10:27:51.916015 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5804cc6c-a4f7-440e-b902-c75e5b84b929 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:51.927452 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5804cc6c-a4f7-440e-b902-c75e5b84b929 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:51.932859 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1936901-4012-43d7-8c41-707b100281ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:51.934195 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1936901-4012-43d7-8c41-707b100281ba admin admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:51.934602 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1936901-4012-43d7-8c41-707b100281ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:51.935042 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1936901-4012-43d7-8c41-707b100281ba admin admin] PATH_INFO: `/v3/projects/dfafabc8683549f0bcc4d5f8f7d60d45/users/0854e9e563ab45f9bbfae24d3972af0c/roles/5c8b89fae4fa45bd944cbeaf442136e1` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:51.937955 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1936901-4012-43d7-8c41-707b100281ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfafabc8683549f0bcc4d5f8f7d60d45, user_id=0854e9e563ab45f9bbfae24d3972af0c, role_id=5c8b89fae4fa45bd944cbeaf442136e1)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:51.940865 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1936901-4012-43d7-8c41-707b100281ba admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:51.953465 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 950/1871] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 19 10:27:51 2022] PUT /identity/v3/projects/dfafabc8683549f0bcc4d5f8f7d60d45/users/0854e9e563ab45f9bbfae24d3972af0c/roles/5c8b89fae4fa45bd944cbeaf442136e1 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:27:51.965177 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0849d1-a56f-429c-bc88-e50e815a5d44 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:51.965729 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0849d1-a56f-429c-bc88-e50e815a5d44 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:51.966034 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0849d1-a56f-429c-bc88-e50e815a5d44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:52.009697 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-4e0849d1-a56f-429c-bc88-e50e815a5d44 None None] MFA Rules not processed for user `0854e9e563ab45f9bbfae24d3972af0c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:27:52.011881 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-4e0849d1-a56f-429c-bc88-e50e815a5d44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:52.025083 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:27:52.144210 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 922/1872] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:27:51 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:27:52.157464 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1936901-4012-43d7-8c41-707b100281ba admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:52.161724 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-b1936901-4012-43d7-8c41-707b100281ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:52.236184 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1936901-4012-43d7-8c41-707b100281ba admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:52.244228 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e36433-0de0-416e-81d7-af5af8c2032f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa4d004fd44482cae761c4b3bdfab31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:52.245013 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e36433-0de0-416e-81d7-af5af8c2032f service cinder] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:52.245664 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e36433-0de0-416e-81d7-af5af8c2032f service cinder] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:52.245664 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e36433-0de0-416e-81d7-af5af8c2032f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:52.258023 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e36433-0de0-416e-81d7-af5af8c2032f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:52.259627 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e36433-0de0-416e-81d7-af5af8c2032f service cinder] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:52.272608 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 951/1873] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:27:52 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:27:52.454102 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0849d1-a56f-429c-bc88-e50e815a5d44 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:52.584467 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0849d1-a56f-429c-bc88-e50e815a5d44 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:52.598348 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cfd3f3-f513-4d4f-bc53-85190337c1ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:52.599004 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cfd3f3-f513-4d4f-bc53-85190337c1ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:52.599290 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cfd3f3-f513-4d4f-bc53-85190337c1ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:52.599566 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cfd3f3-f513-4d4f-bc53-85190337c1ba admin admin] PATH_INFO: `/v3/users/09fde2d43a654f58933f1cdd96f1ebc3` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:52.601473 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cfd3f3-f513-4d4f-bc53-85190337c1ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=09fde2d43a654f58933f1cdd96f1ebc3)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:52.604108 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cfd3f3-f513-4d4f-bc53-85190337c1ba admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:52.695064 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-34cfd3f3-f513-4d4f-bc53-85190337c1ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09fde2d43a654f58933f1cdd96f1ebc3'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:52.708624 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-34cfd3f3-f513-4d4f-bc53-85190337c1ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09fde2d43a654f58933f1cdd96f1ebc3'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:52.710588 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-34cfd3f3-f513-4d4f-bc53-85190337c1ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09fde2d43a654f58933f1cdd96f1ebc3'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:52.711877 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-34cfd3f3-f513-4d4f-bc53-85190337c1ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09fde2d43a654f58933f1cdd96f1ebc3'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:52.731663 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-34cfd3f3-f513-4d4f-bc53-85190337c1ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09fde2d43a654f58933f1cdd96f1ebc3'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:52.776748 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 923/1874] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 19 10:27:52 2022] DELETE /identity/v3/users/09fde2d43a654f58933f1cdd96f1ebc3 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:27:52.776852 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a707ef1-793b-40ad-88a3-97dc36c55019 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:52.776852 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a707ef1-793b-40ad-88a3-97dc36c55019 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:52.776852 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a707ef1-793b-40ad-88a3-97dc36c55019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:52.784918 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cfd3f3-f513-4d4f-bc53-85190337c1ba admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:52.787361 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-34cfd3f3-f513-4d4f-bc53-85190337c1ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:52.804242 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-2a707ef1-793b-40ad-88a3-97dc36c55019 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:27:52.808911 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-2a707ef1-793b-40ad-88a3-97dc36c55019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:52.838765 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:27:52.894802 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cfd3f3-f513-4d4f-bc53-85190337c1ba admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:52.902208 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bdfe03-c927-4746-9836-f12151b8c46d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa4d004fd44482cae761c4b3bdfab31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:52.903465 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bdfe03-c927-4746-9836-f12151b8c46d service cinder] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:52.904002 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bdfe03-c927-4746-9836-f12151b8c46d service cinder] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:52.905765 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bdfe03-c927-4746-9836-f12151b8c46d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:52.907873 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:27:52.908801 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-a7bdfe03-c927-4746-9836-f12151b8c46d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:52.924459 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 952/1875] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:27:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 10:27:52.962278 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a707ef1-793b-40ad-88a3-97dc36c55019 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:52.967505 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-2a707ef1-793b-40ad-88a3-97dc36c55019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:52.984780 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bdfe03-c927-4746-9836-f12151b8c46d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:52.986311 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bdfe03-c927-4746-9836-f12151b8c46d service cinder] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:53.000151 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 924/1876] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:27:52 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:27:53.065426 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a707ef1-793b-40ad-88a3-97dc36c55019 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:53.069651 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a75c275-c048-4579-bac3-6275c1d98ec2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c1289b015854c6bb6aee8fed6b807db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:53.070306 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a75c275-c048-4579-bac3-6275c1d98ec2 service neutron] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:53.070582 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a75c275-c048-4579-bac3-6275c1d98ec2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:53.070857 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a75c275-c048-4579-bac3-6275c1d98ec2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:53.086923 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a75c275-c048-4579-bac3-6275c1d98ec2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:53.089194 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a75c275-c048-4579-bac3-6275c1d98ec2 service neutron] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:53.106174 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 953/1877] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:27:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 10:27:53.476810 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bdfe03-c927-4746-9836-f12151b8c46d service cinder] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:53.479352 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-a7bdfe03-c927-4746-9836-f12151b8c46d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:53.494535 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bdfe03-c927-4746-9836-f12151b8c46d service cinder] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:53.499998 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e72267-e502-429d-9149-a3d403dcf785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:53.501234 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e72267-e502-429d-9149-a3d403dcf785 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:53.501544 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e72267-e502-429d-9149-a3d403dcf785 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:53.501988 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e72267-e502-429d-9149-a3d403dcf785 admin admin] PATH_INFO: `/v3/projects/d4eddb0af21c4467a66fef90aff07398` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:53.503023 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e72267-e502-429d-9149-a3d403dcf785 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4eddb0af21c4467a66fef90aff07398)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:53.505187 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e72267-e502-429d-9149-a3d403dcf785 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:53.565047 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-85e72267-e502-429d-9149-a3d403dcf785 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4eddb0af21c4467a66fef90aff07398', 'request_id': 'req-85e72267-e502-429d-9149-a3d403dcf785'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:53.571834 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-85e72267-e502-429d-9149-a3d403dcf785 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4eddb0af21c4467a66fef90aff07398', 'request_id': 'req-85e72267-e502-429d-9149-a3d403dcf785'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:53.585721 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-85e72267-e502-429d-9149-a3d403dcf785 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4eddb0af21c4467a66fef90aff07398', 'request_id': 'req-85e72267-e502-429d-9149-a3d403dcf785'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:53.624184 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-85e72267-e502-429d-9149-a3d403dcf785 admin admin] The token cache is being invalidate because project d4eddb0af21c4467a66fef90aff07398 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 10:27:53.624642 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-85e72267-e502-429d-9149-a3d403dcf785 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:53.625699 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-85e72267-e502-429d-9149-a3d403dcf785 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:53.631058 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 925/1878] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 19 10:27:53 2022] DELETE /identity/v3/projects/d4eddb0af21c4467a66fef90aff07398 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:27:53.633306 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d2a31c-5254-42d6-ab74-e63b4d3d6b44 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:53.633828 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d2a31c-5254-42d6-ab74-e63b4d3d6b44 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:53.634067 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d2a31c-5254-42d6-ab74-e63b4d3d6b44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:53.715241 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-75d2a31c-5254-42d6-ab74-e63b4d3d6b44 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:27:53.721084 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-75d2a31c-5254-42d6-ab74-e63b4d3d6b44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:53.789855 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e72267-e502-429d-9149-a3d403dcf785 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:53.792644 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-85e72267-e502-429d-9149-a3d403dcf785 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:53.871550 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 954/1879] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:27:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:27:53.880244 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af39a641-44d2-4acf-9367-3989880305a8 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:53.880612 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af39a641-44d2-4acf-9367-3989880305a8 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:53.881094 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af39a641-44d2-4acf-9367-3989880305a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:53.918834 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-af39a641-44d2-4acf-9367-3989880305a8 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:27:53.921313 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-af39a641-44d2-4acf-9367-3989880305a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:53.921785 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e72267-e502-429d-9149-a3d403dcf785 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:53.931631 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5796e437-0f83-4eb0-afa2-b054e102197c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:53.931631 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5796e437-0f83-4eb0-afa2-b054e102197c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:53.931631 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5796e437-0f83-4eb0-afa2-b054e102197c admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:53.931631 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5796e437-0f83-4eb0-afa2-b054e102197c admin admin] PATH_INFO: `/v3/projects/d99e742b50044a9b9983670daff4980b` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:53.932009 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5796e437-0f83-4eb0-afa2-b054e102197c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d99e742b50044a9b9983670daff4980b)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:53.934000 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5796e437-0f83-4eb0-afa2-b054e102197c admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:53.935532 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 955/1880] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:27:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:27:53.937619 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:27:53.940283 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af39a641-44d2-4acf-9367-3989880305a8 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:53.950457 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af39a641-44d2-4acf-9367-3989880305a8 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:53.962232 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39570b1b-d0c3-414f-b912-9687260439c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:53.962852 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39570b1b-d0c3-414f-b912-9687260439c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:53.963129 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39570b1b-d0c3-414f-b912-9687260439c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:53.963395 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39570b1b-d0c3-414f-b912-9687260439c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:53.964047 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39570b1b-d0c3-414f-b912-9687260439c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:27:53.964422 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39570b1b-d0c3-414f-b912-9687260439c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:53.966101 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39570b1b-d0c3-414f-b912-9687260439c2 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:53.995260 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 956/1881] 10.222.0.66 () {58 vars in 1153 bytes} [Mon Sep 19 10:27:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:27:53.997610 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39570b1b-d0c3-414f-b912-9687260439c2 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:54.010684 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39570b1b-d0c3-414f-b912-9687260439c2 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:54.013022 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-5796e437-0f83-4eb0-afa2-b054e102197c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd99e742b50044a9b9983670daff4980b', 'request_id': 'req-5796e437-0f83-4eb0-afa2-b054e102197c'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:54.019813 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-5796e437-0f83-4eb0-afa2-b054e102197c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd99e742b50044a9b9983670daff4980b', 'request_id': 'req-5796e437-0f83-4eb0-afa2-b054e102197c'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:54.026910 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-5796e437-0f83-4eb0-afa2-b054e102197c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd99e742b50044a9b9983670daff4980b', 'request_id': 'req-5796e437-0f83-4eb0-afa2-b054e102197c'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:54.039067 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-5796e437-0f83-4eb0-afa2-b054e102197c admin admin] The token cache is being invalidate because project d99e742b50044a9b9983670daff4980b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 10:27:54.039358 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-5796e437-0f83-4eb0-afa2-b054e102197c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:54.040015 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-5796e437-0f83-4eb0-afa2-b054e102197c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:54.041839 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 926/1882] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 19 10:27:53 2022] DELETE /identity/v3/projects/d99e742b50044a9b9983670daff4980b => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 10:27:54.046649 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5796e437-0f83-4eb0-afa2-b054e102197c admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:54.048360 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-5796e437-0f83-4eb0-afa2-b054e102197c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:54.078412 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1032cc1b-1f80-4008-b99b-bbf6b20b4a15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:54.079407 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1032cc1b-1f80-4008-b99b-bbf6b20b4a15 admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:54.079911 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1032cc1b-1f80-4008-b99b-bbf6b20b4a15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:54.080472 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1032cc1b-1f80-4008-b99b-bbf6b20b4a15 admin admin] PATH_INFO: `/v3/projects` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:54.081251 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1032cc1b-1f80-4008-b99b-bbf6b20b4a15 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:54.084330 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1032cc1b-1f80-4008-b99b-bbf6b20b4a15 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:54.124198 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 957/1883] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 19 10:27:53 2022] POST /identity/v3/projects => generated 379 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:27:54.127728 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1032cc1b-1f80-4008-b99b-bbf6b20b4a15 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:54.129803 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-1032cc1b-1f80-4008-b99b-bbf6b20b4a15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:54.140731 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:27:54.145337 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5796e437-0f83-4eb0-afa2-b054e102197c admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:54.224393 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1032cc1b-1f80-4008-b99b-bbf6b20b4a15 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:54.225560 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cb3185-bf4d-4a17-a8d3-271b39ec2f1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:54.226323 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cb3185-bf4d-4a17-a8d3-271b39ec2f1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:54.226676 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cb3185-bf4d-4a17-a8d3-271b39ec2f1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:54.227111 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cb3185-bf4d-4a17-a8d3-271b39ec2f1d admin admin] PATH_INFO: `/v3/users/0854e9e563ab45f9bbfae24d3972af0c` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:54.228670 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cb3185-bf4d-4a17-a8d3-271b39ec2f1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=0854e9e563ab45f9bbfae24d3972af0c)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:54.232625 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cb3185-bf4d-4a17-a8d3-271b39ec2f1d admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:54.238257 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d31a98d-9abc-4b6e-bead-a230c1a6f645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:54.239773 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d31a98d-9abc-4b6e-bead-a230c1a6f645 admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:54.240376 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d31a98d-9abc-4b6e-bead-a230c1a6f645 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:54.241017 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d31a98d-9abc-4b6e-bead-a230c1a6f645 admin admin] PATH_INFO: `/v3/users` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:54.243086 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d31a98d-9abc-4b6e-bead-a230c1a6f645 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:54.245409 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d31a98d-9abc-4b6e-bead-a230c1a6f645 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:54.285883 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 958/1884] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 19 10:27:54 2022] POST /identity/v3/users => generated 290 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:27:54.290428 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d31a98d-9abc-4b6e-bead-a230c1a6f645 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:54.294458 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:27:54.305679 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-a8cb3185-bf4d-4a17-a8d3-271b39ec2f1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0854e9e563ab45f9bbfae24d3972af0c'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:54.317134 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d31a98d-9abc-4b6e-bead-a230c1a6f645 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:54.317370 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-a8cb3185-bf4d-4a17-a8d3-271b39ec2f1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0854e9e563ab45f9bbfae24d3972af0c'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:54.317949 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-a8cb3185-bf4d-4a17-a8d3-271b39ec2f1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0854e9e563ab45f9bbfae24d3972af0c'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:54.318639 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-a8cb3185-bf4d-4a17-a8d3-271b39ec2f1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0854e9e563ab45f9bbfae24d3972af0c'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:54.326099 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b87ccc-c714-4920-a48c-aca38e6a3ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:54.327317 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b87ccc-c714-4920-a48c-aca38e6a3ad5 admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:54.327679 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b87ccc-c714-4920-a48c-aca38e6a3ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:54.328030 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b87ccc-c714-4920-a48c-aca38e6a3ad5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:54.328939 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b87ccc-c714-4920-a48c-aca38e6a3ad5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:54.330958 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b87ccc-c714-4920-a48c-aca38e6a3ad5 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:54.332148 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-a8cb3185-bf4d-4a17-a8d3-271b39ec2f1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0854e9e563ab45f9bbfae24d3972af0c'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:54.348924 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 959/1885] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:27:54 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 10:27:54.351004 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b87ccc-c714-4920-a48c-aca38e6a3ad5 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:54.353943 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-83b87ccc-c714-4920-a48c-aca38e6a3ad5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:54.363479 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 927/1886] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 19 10:27:54 2022] DELETE /identity/v3/users/0854e9e563ab45f9bbfae24d3972af0c => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 10:27:54.379239 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b87ccc-c714-4920-a48c-aca38e6a3ad5 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:54.462325 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee844c1-d47c-4c50-8398-1b4b6d449762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:54.463020 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee844c1-d47c-4c50-8398-1b4b6d449762 admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:54.463536 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee844c1-d47c-4c50-8398-1b4b6d449762 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:54.463935 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee844c1-d47c-4c50-8398-1b4b6d449762 admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:54.464817 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee844c1-d47c-4c50-8398-1b4b6d449762 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:54.467196 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee844c1-d47c-4c50-8398-1b4b6d449762 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:54.487155 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 960/1887] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:27:54 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 10:27:54.492748 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cb3185-bf4d-4a17-a8d3-271b39ec2f1d admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:54.519306 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cb3185-bf4d-4a17-a8d3-271b39ec2f1d admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:54.528872 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5468c6cb-0e2d-415b-b8dd-37735d85db71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:54.530037 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5468c6cb-0e2d-415b-b8dd-37735d85db71 admin admin] REQUEST_METHOD: `PUT` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:54.530527 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5468c6cb-0e2d-415b-b8dd-37735d85db71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:54.531080 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5468c6cb-0e2d-415b-b8dd-37735d85db71 admin admin] PATH_INFO: `/v3/projects/e2b72ca3d97f4348a450d5f76aa7a05c/users/2d71cb1a3b2c4e55974e934f7e65963a/roles/cd5b42ed3b754b58817a62bbe74651b4` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:54.563007 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5468c6cb-0e2d-415b-b8dd-37735d85db71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2b72ca3d97f4348a450d5f76aa7a05c, user_id=2d71cb1a3b2c4e55974e934f7e65963a, role_id=cd5b42ed3b754b58817a62bbe74651b4)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:54.568475 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5468c6cb-0e2d-415b-b8dd-37735d85db71 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:54.587871 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 928/1888] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 19 10:27:54 2022] PUT /identity/v3/projects/e2b72ca3d97f4348a450d5f76aa7a05c/users/2d71cb1a3b2c4e55974e934f7e65963a/roles/cd5b42ed3b754b58817a62bbe74651b4 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:27:54.599743 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9a16a2-8124-45ee-8d8a-eb8883229daf None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:54.600035 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9a16a2-8124-45ee-8d8a-eb8883229daf None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:54.600899 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9a16a2-8124-45ee-8d8a-eb8883229daf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:54.633714 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-dc9a16a2-8124-45ee-8d8a-eb8883229daf None None] MFA Rules not processed for user `2d71cb1a3b2c4e55974e934f7e65963a`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:27:54.635350 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-dc9a16a2-8124-45ee-8d8a-eb8883229daf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:54.737760 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 961/1889] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:27:54 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:27:54.742334 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5468c6cb-0e2d-415b-b8dd-37735d85db71 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:54.817165 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5468c6cb-0e2d-415b-b8dd-37735d85db71 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:54.818164 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9a16a2-8124-45ee-8d8a-eb8883229daf None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:54.821307 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-dc9a16a2-8124-45ee-8d8a-eb8883229daf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:54.823581 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213161b8-e60c-4da8-88f5-7f3d618e176b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:54.824364 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213161b8-e60c-4da8-88f5-7f3d618e176b admin admin] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:54.824750 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213161b8-e60c-4da8-88f5-7f3d618e176b admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:54.825098 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213161b8-e60c-4da8-88f5-7f3d618e176b admin admin] PATH_INFO: `/v3/projects` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:54.825887 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213161b8-e60c-4da8-88f5-7f3d618e176b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:54.828200 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213161b8-e60c-4da8-88f5-7f3d618e176b admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:54.875401 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9a16a2-8124-45ee-8d8a-eb8883229daf None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:54.883627 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 929/1890] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 19 10:27:54 2022] POST /identity/v3/projects => generated 375 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 10:27:54.885000 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213161b8-e60c-4da8-88f5-7f3d618e176b admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:54.886289 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b430af39-ac9d-46f2-abd4-76dd54346b63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:54.887475 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b430af39-ac9d-46f2-abd4-76dd54346b63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:54.887475 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b430af39-ac9d-46f2-abd4-76dd54346b63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:54.887753 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b430af39-ac9d-46f2-abd4-76dd54346b63 admin admin] PATH_INFO: `/v3/projects/dfafabc8683549f0bcc4d5f8f7d60d45` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:54.888891 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b430af39-ac9d-46f2-abd4-76dd54346b63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dfafabc8683549f0bcc4d5f8f7d60d45)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:54.891038 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b430af39-ac9d-46f2-abd4-76dd54346b63 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:54.901305 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:27:54.958640 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-b430af39-ac9d-46f2-abd4-76dd54346b63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dfafabc8683549f0bcc4d5f8f7d60d45', 'request_id': 'req-b430af39-ac9d-46f2-abd4-76dd54346b63'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:54.967635 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-b430af39-ac9d-46f2-abd4-76dd54346b63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dfafabc8683549f0bcc4d5f8f7d60d45', 'request_id': 'req-b430af39-ac9d-46f2-abd4-76dd54346b63'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:54.973944 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213161b8-e60c-4da8-88f5-7f3d618e176b admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:54.985505 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-b430af39-ac9d-46f2-abd4-76dd54346b63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dfafabc8683549f0bcc4d5f8f7d60d45', 'request_id': 'req-b430af39-ac9d-46f2-abd4-76dd54346b63'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:54.999613 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-b430af39-ac9d-46f2-abd4-76dd54346b63 admin admin] The token cache is being invalidate because project dfafabc8683549f0bcc4d5f8f7d60d45 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 10:27:54.999905 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-b430af39-ac9d-46f2-abd4-76dd54346b63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:55.000679 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-b430af39-ac9d-46f2-abd4-76dd54346b63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:55.002786 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 962/1891] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 19 10:27:54 2022] DELETE /identity/v3/projects/dfafabc8683549f0bcc4d5f8f7d60d45 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:27:55.005809 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:27:55.008469 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a7ea7b-8a69-43f2-a5f8-a8ebf00dda86 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:55.008754 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a7ea7b-8a69-43f2-a5f8-a8ebf00dda86 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:55.009029 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a7ea7b-8a69-43f2-a5f8-a8ebf00dda86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:55.036376 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-d7a7ea7b-8a69-43f2-a5f8-a8ebf00dda86 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:27:55.039252 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-d7a7ea7b-8a69-43f2-a5f8-a8ebf00dda86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:55.081577 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1777589c-c530-4402-bd4b-baec55441d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:55.082284 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1777589c-c530-4402-bd4b-baec55441d01 admin admin] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:55.082571 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1777589c-c530-4402-bd4b-baec55441d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:55.082927 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1777589c-c530-4402-bd4b-baec55441d01 admin admin] PATH_INFO: `/v3/users` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:55.083488 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1777589c-c530-4402-bd4b-baec55441d01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:55.085512 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1777589c-c530-4402-bd4b-baec55441d01 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:55.132520 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 930/1892] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 19 10:27:54 2022] POST /identity/v3/users => generated 288 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 10:27:55.134348 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1777589c-c530-4402-bd4b-baec55441d01 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:55.140435 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-1777589c-c530-4402-bd4b-baec55441d01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:55.160008 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 963/1893] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:27:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:27:55.163808 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1777589c-c530-4402-bd4b-baec55441d01 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:55.171862 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd4efeb-defd-4814-9402-26018fb41e98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:55.172618 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd4efeb-defd-4814-9402-26018fb41e98 admin admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:55.172913 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd4efeb-defd-4814-9402-26018fb41e98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:55.173168 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd4efeb-defd-4814-9402-26018fb41e98 admin admin] PATH_INFO: `/v3/roles` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:55.173842 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd4efeb-defd-4814-9402-26018fb41e98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:55.175465 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd4efeb-defd-4814-9402-26018fb41e98 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:55.177275 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b729a8-0a13-4d99-b775-48d0a197137c None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:55.180462 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b729a8-0a13-4d99-b775-48d0a197137c None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:55.181510 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b729a8-0a13-4d99-b775-48d0a197137c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:55.190879 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 931/1894] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:27:55 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 10:27:55.195182 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd4efeb-defd-4814-9402-26018fb41e98 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:55.212530 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-71b729a8-0a13-4d99-b775-48d0a197137c None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:27:55.213776 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-71b729a8-0a13-4d99-b775-48d0a197137c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:55.215706 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd4efeb-defd-4814-9402-26018fb41e98 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:55.223267 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 964/1895] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:27:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:27:55.229010 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b729a8-0a13-4d99-b775-48d0a197137c None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:55.231541 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b277625-34b9-41bd-a15f-a26193d01496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:55.232158 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b277625-34b9-41bd-a15f-a26193d01496 admin admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:55.232454 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b277625-34b9-41bd-a15f-a26193d01496 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:55.232870 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b277625-34b9-41bd-a15f-a26193d01496 admin admin] PATH_INFO: `/v3/roles` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:55.233517 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b277625-34b9-41bd-a15f-a26193d01496 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:55.237015 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b277625-34b9-41bd-a15f-a26193d01496 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:55.245586 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b729a8-0a13-4d99-b775-48d0a197137c None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:55.252574 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 932/1896] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:27:55 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 10:27:55.253806 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4101d7e6-7c92-40ee-96ee-5572682b6998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:55.254972 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4101d7e6-7c92-40ee-96ee-5572682b6998 admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:55.255255 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4101d7e6-7c92-40ee-96ee-5572682b6998 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:55.255822 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4101d7e6-7c92-40ee-96ee-5572682b6998 admin admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:55.256251 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4101d7e6-7c92-40ee-96ee-5572682b6998 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:27:55.256559 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4101d7e6-7c92-40ee-96ee-5572682b6998 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:55.257398 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b277625-34b9-41bd-a15f-a26193d01496 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:55.258493 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4101d7e6-7c92-40ee-96ee-5572682b6998 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:55.271623 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b277625-34b9-41bd-a15f-a26193d01496 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:55.273693 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 965/1897] 10.222.0.66 () {58 vars in 1153 bytes} [Mon Sep 19 10:27:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:27:55.279480 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4101d7e6-7c92-40ee-96ee-5572682b6998 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:55.281127 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e8cad0-23ea-48bc-a99c-2c996c272629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:55.281806 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e8cad0-23ea-48bc-a99c-2c996c272629 admin admin] REQUEST_METHOD: `PUT` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:55.282090 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e8cad0-23ea-48bc-a99c-2c996c272629 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:55.282368 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e8cad0-23ea-48bc-a99c-2c996c272629 admin admin] PATH_INFO: `/v3/projects/717105ff34924c32a74c8a00eef52830/users/523825454a4a48fcb17b3ea39fae0ce0/roles/cd5b42ed3b754b58817a62bbe74651b4` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:55.294138 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4101d7e6-7c92-40ee-96ee-5572682b6998 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:55.303294 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e8cad0-23ea-48bc-a99c-2c996c272629 admin admin] RBAC: Authorizing `identity:create_grant(project_id=717105ff34924c32a74c8a00eef52830, user_id=523825454a4a48fcb17b3ea39fae0ce0, role_id=cd5b42ed3b754b58817a62bbe74651b4)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:55.307051 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e8cad0-23ea-48bc-a99c-2c996c272629 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:55.316831 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1f2835-6c83-42f7-b40c-d8a242ce23d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:55.317549 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1f2835-6c83-42f7-b40c-d8a242ce23d3 admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:55.317859 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1f2835-6c83-42f7-b40c-d8a242ce23d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:55.318144 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1f2835-6c83-42f7-b40c-d8a242ce23d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:55.318840 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1f2835-6c83-42f7-b40c-d8a242ce23d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:55.320976 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1f2835-6c83-42f7-b40c-d8a242ce23d3 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:55.438251 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 933/1898] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 19 10:27:55 2022] PUT /identity/v3/projects/717105ff34924c32a74c8a00eef52830/users/523825454a4a48fcb17b3ea39fae0ce0/roles/cd5b42ed3b754b58817a62bbe74651b4 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:27:55.450407 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec53c55-a3ec-468a-aa92-3eacbda2559c None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:55.450977 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec53c55-a3ec-468a-aa92-3eacbda2559c None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:55.451075 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec53c55-a3ec-468a-aa92-3eacbda2559c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:55.466912 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 966/1899] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 19 10:27:55 2022] POST /identity/v3/projects => generated 371 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:27:55.469529 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1f2835-6c83-42f7-b40c-d8a242ce23d3 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:55.523921 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-3ec53c55-a3ec-468a-aa92-3eacbda2559c None None] MFA Rules not processed for user `523825454a4a48fcb17b3ea39fae0ce0`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:27:55.525238 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-3ec53c55-a3ec-468a-aa92-3eacbda2559c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:55.555453 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:27:55.576707 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1f2835-6c83-42f7-b40c-d8a242ce23d3 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:55.590683 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f89da89-6982-4592-b0a0-a181a76ab065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:55.591794 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f89da89-6982-4592-b0a0-a181a76ab065 admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:55.592095 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f89da89-6982-4592-b0a0-a181a76ab065 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:55.595215 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f89da89-6982-4592-b0a0-a181a76ab065 admin admin] PATH_INFO: `/v3/users` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:55.596548 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f89da89-6982-4592-b0a0-a181a76ab065 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:55.602033 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f89da89-6982-4592-b0a0-a181a76ab065 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:55.653307 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 967/1900] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 19 10:27:55 2022] POST /identity/v3/users => generated 286 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:27:55.657592 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f89da89-6982-4592-b0a0-a181a76ab065 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:55.694272 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f89da89-6982-4592-b0a0-a181a76ab065 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:55.734003 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68249d56-81f6-40bf-a750-d2382d8bc373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:55.735078 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68249d56-81f6-40bf-a750-d2382d8bc373 admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:55.735373 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68249d56-81f6-40bf-a750-d2382d8bc373 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:55.735657 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68249d56-81f6-40bf-a750-d2382d8bc373 admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:55.738407 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68249d56-81f6-40bf-a750-d2382d8bc373 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:55.745369 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68249d56-81f6-40bf-a750-d2382d8bc373 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:55.749136 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 934/1901] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:27:55 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:27:55.753144 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec53c55-a3ec-468a-aa92-3eacbda2559c None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:55.780139 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec53c55-a3ec-468a-aa92-3eacbda2559c None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:55.792508 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 968/1902] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:27:55 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 10:27:55.796886 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0b4003-ec80-4333-98fa-adc8939a07cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:55.797865 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0b4003-ec80-4333-98fa-adc8939a07cd admin admin] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:55.798830 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0b4003-ec80-4333-98fa-adc8939a07cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:55.799346 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0b4003-ec80-4333-98fa-adc8939a07cd admin admin] PATH_INFO: `/v3/projects` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:55.800550 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0b4003-ec80-4333-98fa-adc8939a07cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:55.802860 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0b4003-ec80-4333-98fa-adc8939a07cd admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:55.804921 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68249d56-81f6-40bf-a750-d2382d8bc373 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:55.822693 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68249d56-81f6-40bf-a750-d2382d8bc373 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:55.832560 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1b56a1-eb17-4f90-92c4-ba4d78085fc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:55.833248 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1b56a1-eb17-4f90-92c4-ba4d78085fc9 admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:55.833538 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1b56a1-eb17-4f90-92c4-ba4d78085fc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:55.833863 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1b56a1-eb17-4f90-92c4-ba4d78085fc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:55.836233 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1b56a1-eb17-4f90-92c4-ba4d78085fc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:55.839077 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1b56a1-eb17-4f90-92c4-ba4d78085fc9 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:55.870032 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 969/1903] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:27:55 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 10:27:55.870218 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 935/1904] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 19 10:27:55 2022] POST /identity/v3/projects => generated 379 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:27:55.873316 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1b56a1-eb17-4f90-92c4-ba4d78085fc9 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:55.888040 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0b4003-ec80-4333-98fa-adc8939a07cd admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:55.911652 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1b56a1-eb17-4f90-92c4-ba4d78085fc9 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:55.983231 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:27:56.019114 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b8f465-a12d-4532-92a7-0764cacf5db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:56.020072 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b8f465-a12d-4532-92a7-0764cacf5db1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:56.020764 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b8f465-a12d-4532-92a7-0764cacf5db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:56.021007 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0b4003-ec80-4333-98fa-adc8939a07cd admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:56.021462 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b8f465-a12d-4532-92a7-0764cacf5db1 admin admin] PATH_INFO: `/v3/projects/6d83db18609043d19731ebe8449be882/users/a4a0499e64d1434095a19ffda1cba58a/roles/cd5b42ed3b754b58817a62bbe74651b4` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:56.039931 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63811dd0-456f-489c-93a9-7b6e858a164a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:56.040718 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63811dd0-456f-489c-93a9-7b6e858a164a admin admin] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:56.041095 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63811dd0-456f-489c-93a9-7b6e858a164a admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:56.041443 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63811dd0-456f-489c-93a9-7b6e858a164a admin admin] PATH_INFO: `/v3/users` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:56.042162 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63811dd0-456f-489c-93a9-7b6e858a164a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:56.045254 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63811dd0-456f-489c-93a9-7b6e858a164a admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:56.050585 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b8f465-a12d-4532-92a7-0764cacf5db1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d83db18609043d19731ebe8449be882, user_id=a4a0499e64d1434095a19ffda1cba58a, role_id=cd5b42ed3b754b58817a62bbe74651b4)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:56.055112 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b8f465-a12d-4532-92a7-0764cacf5db1 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:56.070930 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 936/1905] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 19 10:27:55 2022] POST /identity/v3/users => generated 296 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:27:56.070930 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63811dd0-456f-489c-93a9-7b6e858a164a admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:56.071231 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-63811dd0-456f-489c-93a9-7b6e858a164a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:56.075103 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 970/1906] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 19 10:27:55 2022] PUT /identity/v3/projects/6d83db18609043d19731ebe8449be882/users/a4a0499e64d1434095a19ffda1cba58a/roles/cd5b42ed3b754b58817a62bbe74651b4 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:27:56.076106 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b8f465-a12d-4532-92a7-0764cacf5db1 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:56.083938 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63811dd0-456f-489c-93a9-7b6e858a164a admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:56.157860 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47222ca-06f1-45d4-9325-6eb8d3d0ea86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:56.158855 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47222ca-06f1-45d4-9325-6eb8d3d0ea86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:56.159144 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47222ca-06f1-45d4-9325-6eb8d3d0ea86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:56.159424 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47222ca-06f1-45d4-9325-6eb8d3d0ea86 admin admin] PATH_INFO: `/v3/users/b34daa97664845eca03b7e19a4db4343` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:56.160931 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47222ca-06f1-45d4-9325-6eb8d3d0ea86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b34daa97664845eca03b7e19a4db4343)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:56.163678 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47222ca-06f1-45d4-9325-6eb8d3d0ea86 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:56.176981 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b8f465-a12d-4532-92a7-0764cacf5db1 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:56.192020 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24a0ad5-a675-4568-b20a-daa2e66b8073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:56.193003 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24a0ad5-a675-4568-b20a-daa2e66b8073 admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:56.193518 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24a0ad5-a675-4568-b20a-daa2e66b8073 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:56.193987 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24a0ad5-a675-4568-b20a-daa2e66b8073 admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:56.194912 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24a0ad5-a675-4568-b20a-daa2e66b8073 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:56.200511 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24a0ad5-a675-4568-b20a-daa2e66b8073 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:56.213874 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 971/1907] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:27:56 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 10:27:56.215920 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a0c7a3-bef5-4ec7-9df6-2b87201ae114 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:56.216453 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a0c7a3-bef5-4ec7-9df6-2b87201ae114 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:56.216964 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a0c7a3-bef5-4ec7-9df6-2b87201ae114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:56.246546 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-b6a0c7a3-bef5-4ec7-9df6-2b87201ae114 None None] MFA Rules not processed for user `a4a0499e64d1434095a19ffda1cba58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:27:56.246754 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-f47222ca-06f1-45d4-9325-6eb8d3d0ea86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b34daa97664845eca03b7e19a4db4343'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:56.247788 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-b6a0c7a3-bef5-4ec7-9df6-2b87201ae114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:56.255307 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-f47222ca-06f1-45d4-9325-6eb8d3d0ea86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b34daa97664845eca03b7e19a4db4343'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:56.256003 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-f47222ca-06f1-45d4-9325-6eb8d3d0ea86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b34daa97664845eca03b7e19a4db4343'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:56.256665 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-f47222ca-06f1-45d4-9325-6eb8d3d0ea86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b34daa97664845eca03b7e19a4db4343'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:56.264885 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-f47222ca-06f1-45d4-9325-6eb8d3d0ea86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b34daa97664845eca03b7e19a4db4343'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:56.286699 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 937/1908] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 19 10:27:56 2022] DELETE /identity/v3/users/b34daa97664845eca03b7e19a4db4343 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:27:56.286921 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:27:56.287036 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47222ca-06f1-45d4-9325-6eb8d3d0ea86 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:56.287867 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-f47222ca-06f1-45d4-9325-6eb8d3d0ea86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:56.346100 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 972/1909] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:27:56 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:27:56.347803 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603b0539-b0e3-4473-b2d0-f0cb194a4ba1 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:56.349240 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603b0539-b0e3-4473-b2d0-f0cb194a4ba1 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:56.349893 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603b0539-b0e3-4473-b2d0-f0cb194a4ba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:56.360052 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:27:56.377810 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-603b0539-b0e3-4473-b2d0-f0cb194a4ba1 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:27:56.378708 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47222ca-06f1-45d4-9325-6eb8d3d0ea86 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:56.379047 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-603b0539-b0e3-4473-b2d0-f0cb194a4ba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:56.384874 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5fea47-6c71-489b-a201-41d9b58912b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:56.385562 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5fea47-6c71-489b-a201-41d9b58912b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:56.385864 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5fea47-6c71-489b-a201-41d9b58912b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:56.386135 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5fea47-6c71-489b-a201-41d9b58912b9 admin admin] PATH_INFO: `/v3/projects/383080a987164aa2b0db26916dc767cb/users/ba309ee5a1c74f0b86c3e5ea0ee471bd/roles/5c8b89fae4fa45bd944cbeaf442136e1` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:56.388607 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 973/1910] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:27:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:27:56.389421 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603b0539-b0e3-4473-b2d0-f0cb194a4ba1 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:56.390707 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-603b0539-b0e3-4473-b2d0-f0cb194a4ba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:56.406214 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5fea47-6c71-489b-a201-41d9b58912b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=383080a987164aa2b0db26916dc767cb, user_id=ba309ee5a1c74f0b86c3e5ea0ee471bd, role_id=5c8b89fae4fa45bd944cbeaf442136e1)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:56.408955 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5fea47-6c71-489b-a201-41d9b58912b9 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:56.423254 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 938/1911] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 19 10:27:56 2022] PUT /identity/v3/projects/383080a987164aa2b0db26916dc767cb/users/ba309ee5a1c74f0b86c3e5ea0ee471bd/roles/5c8b89fae4fa45bd944cbeaf442136e1 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:27:56.424103 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5fea47-6c71-489b-a201-41d9b58912b9 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:56.425740 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-be5fea47-6c71-489b-a201-41d9b58912b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:56.460497 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603b0539-b0e3-4473-b2d0-f0cb194a4ba1 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:56.490259 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5fea47-6c71-489b-a201-41d9b58912b9 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:56.494040 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a6040e-d01c-4e3b-91a7-65afef1de300 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c1289b015854c6bb6aee8fed6b807db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:56.494663 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a6040e-d01c-4e3b-91a7-65afef1de300 service neutron] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:56.494945 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a6040e-d01c-4e3b-91a7-65afef1de300 service neutron] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:56.495216 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a6040e-d01c-4e3b-91a7-65afef1de300 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:56.513692 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bc8026-c454-4831-9076-2ba880860961 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa4d004fd44482cae761c4b3bdfab31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:56.514334 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bc8026-c454-4831-9076-2ba880860961 service cinder] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:56.514596 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bc8026-c454-4831-9076-2ba880860961 service cinder] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:56.514868 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bc8026-c454-4831-9076-2ba880860961 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:56.559224 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a6040e-d01c-4e3b-91a7-65afef1de300 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:56.560730 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a6040e-d01c-4e3b-91a7-65afef1de300 service neutron] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:56.570724 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 939/1912] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:27:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:27:56.571561 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a6040e-d01c-4e3b-91a7-65afef1de300 service neutron] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:56.581498 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a6040e-d01c-4e3b-91a7-65afef1de300 service neutron] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:56.582049 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bc8026-c454-4831-9076-2ba880860961 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:56.584244 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bc8026-c454-4831-9076-2ba880860961 service cinder] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:56.586746 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046a2872-fb1d-4d0d-a711-9e7b6b71bf3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:56.587250 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046a2872-fb1d-4d0d-a711-9e7b6b71bf3b admin admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:56.587521 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046a2872-fb1d-4d0d-a711-9e7b6b71bf3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:56.588306 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046a2872-fb1d-4d0d-a711-9e7b6b71bf3b admin admin] PATH_INFO: `/v3/roles` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:56.588539 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046a2872-fb1d-4d0d-a711-9e7b6b71bf3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:56.590235 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046a2872-fb1d-4d0d-a711-9e7b6b71bf3b admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:56.599395 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 974/1913] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:27:56 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:27:56.601487 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 940/1914] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:27:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 10:27:56.606372 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bc8026-c454-4831-9076-2ba880860961 service cinder] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:56.622062 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bc8026-c454-4831-9076-2ba880860961 service cinder] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:56.625723 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046a2872-fb1d-4d0d-a711-9e7b6b71bf3b admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:56.626162 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf273ad-3691-42d3-8be5-e08031232e02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:56.627777 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-046a2872-fb1d-4d0d-a711-9e7b6b71bf3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:56.628007 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf273ad-3691-42d3-8be5-e08031232e02 admin admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:56.628328 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf273ad-3691-42d3-8be5-e08031232e02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:56.628611 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf273ad-3691-42d3-8be5-e08031232e02 admin admin] PATH_INFO: `/v3/projects/383080a987164aa2b0db26916dc767cb/users/ba309ee5a1c74f0b86c3e5ea0ee471bd/roles/5c8b89fae4fa45bd944cbeaf442136e1` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:56.637883 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf273ad-3691-42d3-8be5-e08031232e02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=383080a987164aa2b0db26916dc767cb, user_id=ba309ee5a1c74f0b86c3e5ea0ee471bd, role_id=5c8b89fae4fa45bd944cbeaf442136e1)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:56.641931 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046a2872-fb1d-4d0d-a711-9e7b6b71bf3b admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:56.642261 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf273ad-3691-42d3-8be5-e08031232e02 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:56.647616 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8488fa5c-295f-49be-819a-de8744ad9846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:56.648308 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8488fa5c-295f-49be-819a-de8744ad9846 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:56.648611 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8488fa5c-295f-49be-819a-de8744ad9846 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:56.648881 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8488fa5c-295f-49be-819a-de8744ad9846 admin admin] PATH_INFO: `/v3/users/a4a0499e64d1434095a19ffda1cba58a` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:56.651753 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8488fa5c-295f-49be-819a-de8744ad9846 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4a0499e64d1434095a19ffda1cba58a)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:56.654103 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8488fa5c-295f-49be-819a-de8744ad9846 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:56.658301 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 975/1915] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 19 10:27:56 2022] PUT /identity/v3/projects/383080a987164aa2b0db26916dc767cb/users/ba309ee5a1c74f0b86c3e5ea0ee471bd/roles/5c8b89fae4fa45bd944cbeaf442136e1 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 10:27:56.670414 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ad2419-78c8-4851-98d1-a20716d18baa None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:56.671600 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ad2419-78c8-4851-98d1-a20716d18baa None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:56.672620 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ad2419-78c8-4851-98d1-a20716d18baa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:56.716004 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-17ad2419-78c8-4851-98d1-a20716d18baa None None] MFA Rules not processed for user `ba309ee5a1c74f0b86c3e5ea0ee471bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:27:56.717524 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-17ad2419-78c8-4851-98d1-a20716d18baa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:56.749542 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:27:56.791389 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-8488fa5c-295f-49be-819a-de8744ad9846 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4a0499e64d1434095a19ffda1cba58a'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:56.810947 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-8488fa5c-295f-49be-819a-de8744ad9846 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4a0499e64d1434095a19ffda1cba58a'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:56.812257 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-8488fa5c-295f-49be-819a-de8744ad9846 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4a0499e64d1434095a19ffda1cba58a'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:56.812960 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-8488fa5c-295f-49be-819a-de8744ad9846 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4a0499e64d1434095a19ffda1cba58a'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:56.829282 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-8488fa5c-295f-49be-819a-de8744ad9846 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4a0499e64d1434095a19ffda1cba58a'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:56.831376 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:27:56.876640 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 941/1916] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 19 10:27:56 2022] DELETE /identity/v3/users/a4a0499e64d1434095a19ffda1cba58a => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 10:27:56.882306 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e76d0a1-0f18-43f6-97f4-dae9d0b64626 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:56.882709 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e76d0a1-0f18-43f6-97f4-dae9d0b64626 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:56.883105 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e76d0a1-0f18-43f6-97f4-dae9d0b64626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:56.885227 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 976/1917] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:27:56 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:27:56.898726 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ad2419-78c8-4851-98d1-a20716d18baa None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:56.899573 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-17ad2419-78c8-4851-98d1-a20716d18baa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:56.923064 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-5e76d0a1-0f18-43f6-97f4-dae9d0b64626 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:27:56.925253 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-5e76d0a1-0f18-43f6-97f4-dae9d0b64626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:57.003968 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ad2419-78c8-4851-98d1-a20716d18baa None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:57.035797 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 942/1918] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:27:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:27:57.052869 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e76d0a1-0f18-43f6-97f4-dae9d0b64626 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:57.056048 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-5e76d0a1-0f18-43f6-97f4-dae9d0b64626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:57.128003 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb113a93-32c4-4147-a319-842020ceaaba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa4d004fd44482cae761c4b3bdfab31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:57.128758 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb113a93-32c4-4147-a319-842020ceaaba service cinder] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:57.130854 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb113a93-32c4-4147-a319-842020ceaaba service cinder] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:57.131377 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb113a93-32c4-4147-a319-842020ceaaba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:57.184687 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e76d0a1-0f18-43f6-97f4-dae9d0b64626 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:57.188540 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d127db-d0ae-4694-a3f5-037982ae00a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c1289b015854c6bb6aee8fed6b807db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:57.189171 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d127db-d0ae-4694-a3f5-037982ae00a0 service neutron] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:57.189450 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d127db-d0ae-4694-a3f5-037982ae00a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:57.189781 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d127db-d0ae-4694-a3f5-037982ae00a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:57.205099 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d127db-d0ae-4694-a3f5-037982ae00a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:57.206877 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d127db-d0ae-4694-a3f5-037982ae00a0 service neutron] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:57.220157 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 943/1919] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:27:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:27:57.221718 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d127db-d0ae-4694-a3f5-037982ae00a0 service neutron] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:57.224177 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-d9d127db-d0ae-4694-a3f5-037982ae00a0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:57.238107 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d127db-d0ae-4694-a3f5-037982ae00a0 service neutron] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:57.243379 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b897c4d-61c5-41c0-adf3-99977ab2272b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:57.244117 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b897c4d-61c5-41c0-adf3-99977ab2272b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:57.244433 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b897c4d-61c5-41c0-adf3-99977ab2272b admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:57.244710 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b897c4d-61c5-41c0-adf3-99977ab2272b admin admin] PATH_INFO: `/v3/projects/5f32fb4744344ee49d7404e58b8fa0f0` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:57.246240 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b897c4d-61c5-41c0-adf3-99977ab2272b admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f32fb4744344ee49d7404e58b8fa0f0)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:57.248639 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b897c4d-61c5-41c0-adf3-99977ab2272b admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:57.317849 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb113a93-32c4-4147-a319-842020ceaaba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:57.319830 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-7b897c4d-61c5-41c0-adf3-99977ab2272b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f32fb4744344ee49d7404e58b8fa0f0', 'request_id': 'req-7b897c4d-61c5-41c0-adf3-99977ab2272b'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:57.321488 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb113a93-32c4-4147-a319-842020ceaaba service cinder] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:57.329241 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-7b897c4d-61c5-41c0-adf3-99977ab2272b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f32fb4744344ee49d7404e58b8fa0f0', 'request_id': 'req-7b897c4d-61c5-41c0-adf3-99977ab2272b'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:57.338671 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-7b897c4d-61c5-41c0-adf3-99977ab2272b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f32fb4744344ee49d7404e58b8fa0f0', 'request_id': 'req-7b897c4d-61c5-41c0-adf3-99977ab2272b'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:57.351540 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 977/1920] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:27:56 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 10:27:57.358824 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-7b897c4d-61c5-41c0-adf3-99977ab2272b admin admin] The token cache is being invalidate because project 5f32fb4744344ee49d7404e58b8fa0f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 10:27:57.359266 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-7b897c4d-61c5-41c0-adf3-99977ab2272b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:57.359955 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-7b897c4d-61c5-41c0-adf3-99977ab2272b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:57.364731 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 944/1921] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 19 10:27:57 2022] DELETE /identity/v3/projects/5f32fb4744344ee49d7404e58b8fa0f0 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:27:57.365915 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb113a93-32c4-4147-a319-842020ceaaba service cinder] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:57.381764 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb113a93-32c4-4147-a319-842020ceaaba service cinder] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:57.396560 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:27:57.437039 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b897c4d-61c5-41c0-adf3-99977ab2272b admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:57.439328 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-7b897c4d-61c5-41c0-adf3-99977ab2272b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:57.461291 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:27:57.477302 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ee37f7-5429-42d9-b1c1-548e2ec1d6a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:57.478187 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ee37f7-5429-42d9-b1c1-548e2ec1d6a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:57.478661 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ee37f7-5429-42d9-b1c1-548e2ec1d6a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:57.479222 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ee37f7-5429-42d9-b1c1-548e2ec1d6a3 admin admin] PATH_INFO: `/v3/users/51b453e2b325451cb1d4fab6d7d658f5` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:57.481479 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ee37f7-5429-42d9-b1c1-548e2ec1d6a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=51b453e2b325451cb1d4fab6d7d658f5)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:57.484682 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ee37f7-5429-42d9-b1c1-548e2ec1d6a3 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:57.574913 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-19ee37f7-5429-42d9-b1c1-548e2ec1d6a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51b453e2b325451cb1d4fab6d7d658f5'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:57.592543 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b897c4d-61c5-41c0-adf3-99977ab2272b admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:57.595047 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-19ee37f7-5429-42d9-b1c1-548e2ec1d6a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51b453e2b325451cb1d4fab6d7d658f5'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:57.599540 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-19ee37f7-5429-42d9-b1c1-548e2ec1d6a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51b453e2b325451cb1d4fab6d7d658f5'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:57.600325 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-19ee37f7-5429-42d9-b1c1-548e2ec1d6a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51b453e2b325451cb1d4fab6d7d658f5'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:57.613949 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5f636f-eb2e-49fe-95b1-2d617d02cc2d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa4d004fd44482cae761c4b3bdfab31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:57.614878 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5f636f-eb2e-49fe-95b1-2d617d02cc2d service cinder] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:57.615166 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5f636f-eb2e-49fe-95b1-2d617d02cc2d service cinder] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:57.615511 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5f636f-eb2e-49fe-95b1-2d617d02cc2d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:57.619914 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-da5f636f-eb2e-49fe-95b1-2d617d02cc2d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:57.623516 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-19ee37f7-5429-42d9-b1c1-548e2ec1d6a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51b453e2b325451cb1d4fab6d7d658f5'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:57.649197 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 978/1922] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 19 10:27:57 2022] DELETE /identity/v3/users/51b453e2b325451cb1d4fab6d7d658f5 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 10:27:57.736850 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5f636f-eb2e-49fe-95b1-2d617d02cc2d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:57.738546 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5f636f-eb2e-49fe-95b1-2d617d02cc2d service cinder] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:57.755723 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 945/1923] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:27:57 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 10:27:57.902634 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ee37f7-5429-42d9-b1c1-548e2ec1d6a3 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:57.904901 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-19ee37f7-5429-42d9-b1c1-548e2ec1d6a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:58.004289 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5f636f-eb2e-49fe-95b1-2d617d02cc2d service cinder] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:58.005974 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-da5f636f-eb2e-49fe-95b1-2d617d02cc2d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:58.022470 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5f636f-eb2e-49fe-95b1-2d617d02cc2d service cinder] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:58.076605 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ee37f7-5429-42d9-b1c1-548e2ec1d6a3 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:58.090043 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0423c8d2-3a36-4a2b-8432-628431057872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:58.090710 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0423c8d2-3a36-4a2b-8432-628431057872 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:58.091134 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0423c8d2-3a36-4a2b-8432-628431057872 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:58.092446 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0423c8d2-3a36-4a2b-8432-628431057872 admin admin] PATH_INFO: `/v3/projects/6d83db18609043d19731ebe8449be882` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:58.093843 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0423c8d2-3a36-4a2b-8432-628431057872 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d83db18609043d19731ebe8449be882)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:58.095877 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0423c8d2-3a36-4a2b-8432-628431057872 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:58.166437 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:27:58.182043 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-0423c8d2-3a36-4a2b-8432-628431057872 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d83db18609043d19731ebe8449be882', 'request_id': 'req-0423c8d2-3a36-4a2b-8432-628431057872'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:58.185619 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaae88d-d21e-493d-bd60-ed29cb8a23a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:58.188718 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaae88d-d21e-493d-bd60-ed29cb8a23a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:58.189384 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaae88d-d21e-493d-bd60-ed29cb8a23a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:58.192242 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaae88d-d21e-493d-bd60-ed29cb8a23a3 admin admin] PATH_INFO: `/v3/projects/6c72b1cd08dd408fbda2cd108a5d4009` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:58.194928 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abaae88d-d21e-493d-bd60-ed29cb8a23a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c72b1cd08dd408fbda2cd108a5d4009)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:58.197435 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abaae88d-d21e-493d-bd60-ed29cb8a23a3 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:58.197551 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-0423c8d2-3a36-4a2b-8432-628431057872 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d83db18609043d19731ebe8449be882', 'request_id': 'req-0423c8d2-3a36-4a2b-8432-628431057872'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:58.211638 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-0423c8d2-3a36-4a2b-8432-628431057872 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d83db18609043d19731ebe8449be882', 'request_id': 'req-0423c8d2-3a36-4a2b-8432-628431057872'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:58.230805 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-0423c8d2-3a36-4a2b-8432-628431057872 admin admin] The token cache is being invalidate because project 6d83db18609043d19731ebe8449be882 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 10:27:58.231848 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-0423c8d2-3a36-4a2b-8432-628431057872 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:58.232735 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-0423c8d2-3a36-4a2b-8432-628431057872 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:58.234793 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 979/1924] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 19 10:27:57 2022] DELETE /identity/v3/projects/6d83db18609043d19731ebe8449be882 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:27:58.239741 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f9c079-2750-4439-bc80-aaae8384adcb None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:58.240030 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f9c079-2750-4439-bc80-aaae8384adcb None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:58.240392 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f9c079-2750-4439-bc80-aaae8384adcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:58.266190 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-41f9c079-2750-4439-bc80-aaae8384adcb None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:27:58.267586 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-41f9c079-2750-4439-bc80-aaae8384adcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:58.283160 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-abaae88d-d21e-493d-bd60-ed29cb8a23a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c72b1cd08dd408fbda2cd108a5d4009', 'request_id': 'req-abaae88d-d21e-493d-bd60-ed29cb8a23a3'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:58.290781 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-abaae88d-d21e-493d-bd60-ed29cb8a23a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c72b1cd08dd408fbda2cd108a5d4009', 'request_id': 'req-abaae88d-d21e-493d-bd60-ed29cb8a23a3'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:58.303342 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-abaae88d-d21e-493d-bd60-ed29cb8a23a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c72b1cd08dd408fbda2cd108a5d4009', 'request_id': 'req-abaae88d-d21e-493d-bd60-ed29cb8a23a3'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:58.307704 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:27:58.351853 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-abaae88d-d21e-493d-bd60-ed29cb8a23a3 admin admin] The token cache is being invalidate because project 6c72b1cd08dd408fbda2cd108a5d4009 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 10:27:58.352548 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-abaae88d-d21e-493d-bd60-ed29cb8a23a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:58.355064 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-abaae88d-d21e-493d-bd60-ed29cb8a23a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:58.361622 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 946/1925] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 19 10:27:58 2022] DELETE /identity/v3/projects/6c72b1cd08dd408fbda2cd108a5d4009 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:27:58.368283 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaae88d-d21e-493d-bd60-ed29cb8a23a3 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:58.371810 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-abaae88d-d21e-493d-bd60-ed29cb8a23a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:58.393832 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 980/1926] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:27:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:27:58.396766 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f774422c-bb2e-42c8-a0d2-4b9a74d1a2b2 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:58.397408 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f774422c-bb2e-42c8-a0d2-4b9a74d1a2b2 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:58.397813 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f774422c-bb2e-42c8-a0d2-4b9a74d1a2b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:58.424715 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-f774422c-bb2e-42c8-a0d2-4b9a74d1a2b2 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:27:58.426288 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-f774422c-bb2e-42c8-a0d2-4b9a74d1a2b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:58.447641 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 981/1927] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:27:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:27:58.461374 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f774422c-bb2e-42c8-a0d2-4b9a74d1a2b2 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:58.475824 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f774422c-bb2e-42c8-a0d2-4b9a74d1a2b2 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:58.485032 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d502c898-6aa9-4f6a-94e5-3e7fec93d6b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:58.487811 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d502c898-6aa9-4f6a-94e5-3e7fec93d6b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:58.488395 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d502c898-6aa9-4f6a-94e5-3e7fec93d6b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:58.489301 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d502c898-6aa9-4f6a-94e5-3e7fec93d6b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:58.490124 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d502c898-6aa9-4f6a-94e5-3e7fec93d6b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:27:58.490471 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d502c898-6aa9-4f6a-94e5-3e7fec93d6b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:58.492441 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d502c898-6aa9-4f6a-94e5-3e7fec93d6b1 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:58.509244 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 982/1928] 10.222.0.66 () {58 vars in 1153 bytes} [Mon Sep 19 10:27:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:27:58.510933 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d502c898-6aa9-4f6a-94e5-3e7fec93d6b1 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:58.525243 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d502c898-6aa9-4f6a-94e5-3e7fec93d6b1 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:58.529050 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaae88d-d21e-493d-bd60-ed29cb8a23a3 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:58.531394 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24688d3a-7416-464a-a389-0d88b025b4a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:58.532230 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24688d3a-7416-464a-a389-0d88b025b4a7 admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:58.532520 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24688d3a-7416-464a-a389-0d88b025b4a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:58.532795 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24688d3a-7416-464a-a389-0d88b025b4a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:58.533689 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24688d3a-7416-464a-a389-0d88b025b4a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:58.534606 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3eba14-ea82-4f4e-a3c0-5ba2e83b7b3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:58.535322 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3eba14-ea82-4f4e-a3c0-5ba2e83b7b3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:58.535615 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24688d3a-7416-464a-a389-0d88b025b4a7 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:58.535754 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3eba14-ea82-4f4e-a3c0-5ba2e83b7b3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:58.536144 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3eba14-ea82-4f4e-a3c0-5ba2e83b7b3c admin admin] PATH_INFO: `/v3/users/547534729dc14d3887ccd80d7870df24` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:58.537781 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3eba14-ea82-4f4e-a3c0-5ba2e83b7b3c admin admin] RBAC: Authorizing `identity:delete_user(user_id=547534729dc14d3887ccd80d7870df24)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:58.540058 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3eba14-ea82-4f4e-a3c0-5ba2e83b7b3c admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:58.611667 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 983/1929] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 19 10:27:58 2022] POST /identity/v3/projects => generated 377 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:27:58.616028 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24688d3a-7416-464a-a389-0d88b025b4a7 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:58.693661 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-cb3eba14-ea82-4f4e-a3c0-5ba2e83b7b3c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '547534729dc14d3887ccd80d7870df24'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:58.704585 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-cb3eba14-ea82-4f4e-a3c0-5ba2e83b7b3c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '547534729dc14d3887ccd80d7870df24'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:58.705298 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-cb3eba14-ea82-4f4e-a3c0-5ba2e83b7b3c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '547534729dc14d3887ccd80d7870df24'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:58.706051 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-cb3eba14-ea82-4f4e-a3c0-5ba2e83b7b3c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '547534729dc14d3887ccd80d7870df24'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:58.717397 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-cb3eba14-ea82-4f4e-a3c0-5ba2e83b7b3c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '547534729dc14d3887ccd80d7870df24'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:27:58.744795 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 947/1930] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 19 10:27:58 2022] DELETE /identity/v3/users/547534729dc14d3887ccd80d7870df24 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:27:58.787822 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24688d3a-7416-464a-a389-0d88b025b4a7 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:58.832398 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:DELETE=5,keystone:SELECT=93,keystone:INSERT=2 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:27:58.919380 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bc4caa-8579-4d1b-aa86-b8c8e365a785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:58.924820 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bc4caa-8579-4d1b-aa86-b8c8e365a785 admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:58.925107 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bc4caa-8579-4d1b-aa86-b8c8e365a785 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:58.925389 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bc4caa-8579-4d1b-aa86-b8c8e365a785 admin admin] PATH_INFO: `/v3/users` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:58.933120 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bc4caa-8579-4d1b-aa86-b8c8e365a785 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:58.938775 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bc4caa-8579-4d1b-aa86-b8c8e365a785 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:59.008509 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 984/1931] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 19 10:27:58 2022] POST /identity/v3/users => generated 289 bytes in 394 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:27:59.014402 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3eba14-ea82-4f4e-a3c0-5ba2e83b7b3c admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:59.017694 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-cb3eba14-ea82-4f4e-a3c0-5ba2e83b7b3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:59.048596 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3eba14-ea82-4f4e-a3c0-5ba2e83b7b3c admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:59.056968 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cedb83a-80aa-450b-927b-9429f4295a85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:59.057950 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cedb83a-80aa-450b-927b-9429f4295a85 admin admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:59.059138 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cedb83a-80aa-450b-927b-9429f4295a85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:59.059682 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cedb83a-80aa-450b-927b-9429f4295a85 admin admin] PATH_INFO: `/v3/roles` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:59.071036 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cedb83a-80aa-450b-927b-9429f4295a85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:59.077335 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cedb83a-80aa-450b-927b-9429f4295a85 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:59.107093 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bc4caa-8579-4d1b-aa86-b8c8e365a785 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:59.119004 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 948/1932] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:27:59 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 10:27:59.121746 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bc4caa-8579-4d1b-aa86-b8c8e365a785 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:59.139156 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12ccd24-b19c-4aaa-ab1c-299529cffc38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:59.139792 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12ccd24-b19c-4aaa-ab1c-299529cffc38 admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:59.140150 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12ccd24-b19c-4aaa-ab1c-299529cffc38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:59.140370 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12ccd24-b19c-4aaa-ab1c-299529cffc38 admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:59.141016 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12ccd24-b19c-4aaa-ab1c-299529cffc38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:59.142630 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12ccd24-b19c-4aaa-ab1c-299529cffc38 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:59.169752 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 985/1933] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:27:59 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 10:27:59.171673 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cedb83a-80aa-450b-927b-9429f4295a85 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:59.201327 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cedb83a-80aa-450b-927b-9429f4295a85 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:59.224883 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b75e94c-b112-4da9-bebc-e402e08f9363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:59.228261 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b75e94c-b112-4da9-bebc-e402e08f9363 admin admin] REQUEST_METHOD: `PUT` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:59.228555 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b75e94c-b112-4da9-bebc-e402e08f9363 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:59.228838 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b75e94c-b112-4da9-bebc-e402e08f9363 admin admin] PATH_INFO: `/v3/projects/ae01639234e24f4eb457a2e6087e2623/users/ce0dc2310b864d3b8e93e817f632a975/roles/cd5b42ed3b754b58817a62bbe74651b4` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:59.290717 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b75e94c-b112-4da9-bebc-e402e08f9363 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae01639234e24f4eb457a2e6087e2623, user_id=ce0dc2310b864d3b8e93e817f632a975, role_id=cd5b42ed3b754b58817a62bbe74651b4)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:59.303807 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b75e94c-b112-4da9-bebc-e402e08f9363 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:59.344200 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 949/1934] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 19 10:27:59 2022] PUT /identity/v3/projects/ae01639234e24f4eb457a2e6087e2623/users/ce0dc2310b864d3b8e93e817f632a975/roles/cd5b42ed3b754b58817a62bbe74651b4 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:27:59.348575 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fcc8ff-e0a0-4d68-b92e-ac67917462b1 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:59.349130 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fcc8ff-e0a0-4d68-b92e-ac67917462b1 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:59.349603 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fcc8ff-e0a0-4d68-b92e-ac67917462b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:59.395209 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-09fcc8ff-e0a0-4d68-b92e-ac67917462b1 None None] MFA Rules not processed for user `ce0dc2310b864d3b8e93e817f632a975`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:27:59.396693 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-09fcc8ff-e0a0-4d68-b92e-ac67917462b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:59.590152 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 986/1935] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:27:59 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:27:59.595900 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b75e94c-b112-4da9-bebc-e402e08f9363 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:59.597608 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-7b75e94c-b112-4da9-bebc-e402e08f9363 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:59.678566 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:27:59.746784 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fcc8ff-e0a0-4d68-b92e-ac67917462b1 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:27:59.748257 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-09fcc8ff-e0a0-4d68-b92e-ac67917462b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:27:59.756351 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b75e94c-b112-4da9-bebc-e402e08f9363 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:59.764656 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c461ae-29af-47a0-9a0a-6ed12de962a6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f95c0d9f2414f3ca2fa2d1546d47f1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:59.765604 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c461ae-29af-47a0-9a0a-6ed12de962a6 service glance] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:59.766316 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c461ae-29af-47a0-9a0a-6ed12de962a6 service glance] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:59.766722 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c461ae-29af-47a0-9a0a-6ed12de962a6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:59.786409 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c461ae-29af-47a0-9a0a-6ed12de962a6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:59.793067 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c461ae-29af-47a0-9a0a-6ed12de962a6 service glance] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:27:59.820130 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 950/1936] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:27:59 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:27:59.935540 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fcc8ff-e0a0-4d68-b92e-ac67917462b1 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:27:59.942463 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102dd803-0021-4a79-bfbc-6625abb03e57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:27:59.952655 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102dd803-0021-4a79-bfbc-6625abb03e57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:27:59.953172 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102dd803-0021-4a79-bfbc-6625abb03e57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:27:59.954240 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102dd803-0021-4a79-bfbc-6625abb03e57 admin admin] PATH_INFO: `/v3/projects/8bb153f886654c28913840c08750bff0` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:27:59.956360 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102dd803-0021-4a79-bfbc-6625abb03e57 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8bb153f886654c28913840c08750bff0)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:27:59.970844 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102dd803-0021-4a79-bfbc-6625abb03e57 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:00.093290 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:28:00.105208 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-102dd803-0021-4a79-bfbc-6625abb03e57 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8bb153f886654c28913840c08750bff0', 'request_id': 'req-102dd803-0021-4a79-bfbc-6625abb03e57'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:00.139647 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-102dd803-0021-4a79-bfbc-6625abb03e57 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8bb153f886654c28913840c08750bff0', 'request_id': 'req-102dd803-0021-4a79-bfbc-6625abb03e57'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:00.158202 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-102dd803-0021-4a79-bfbc-6625abb03e57 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8bb153f886654c28913840c08750bff0', 'request_id': 'req-102dd803-0021-4a79-bfbc-6625abb03e57'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:00.197750 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-102dd803-0021-4a79-bfbc-6625abb03e57 admin admin] The token cache is being invalidate because project 8bb153f886654c28913840c08750bff0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 10:28:00.198123 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-102dd803-0021-4a79-bfbc-6625abb03e57 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:00.200542 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-102dd803-0021-4a79-bfbc-6625abb03e57 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:00.211282 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d2e979-d84e-4d9a-ab6e-671e771797ca None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:00.211571 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d2e979-d84e-4d9a-ab6e-671e771797ca None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:00.211851 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d2e979-d84e-4d9a-ab6e-671e771797ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:00.214972 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 987/1937] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 19 10:27:59 2022] DELETE /identity/v3/projects/8bb153f886654c28913840c08750bff0 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:28:00.243747 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-c2d2e979-d84e-4d9a-ab6e-671e771797ca None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:28:00.246717 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-c2d2e979-d84e-4d9a-ab6e-671e771797ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:28:00.412755 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 951/1938] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:28:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:28:00.425377 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef58d03f-8526-4d72-a638-57cd7659b78a None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:00.425820 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef58d03f-8526-4d72-a638-57cd7659b78a None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:00.426919 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef58d03f-8526-4d72-a638-57cd7659b78a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:00.470005 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-ef58d03f-8526-4d72-a638-57cd7659b78a None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:28:00.471363 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-ef58d03f-8526-4d72-a638-57cd7659b78a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:28:00.484223 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 988/1939] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:28:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:28:00.488149 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d2e979-d84e-4d9a-ab6e-671e771797ca None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:00.511743 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d2e979-d84e-4d9a-ab6e-671e771797ca None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:00.525157 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db99c25-932b-43d4-bd1b-b5a6d88c1d0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:00.525831 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db99c25-932b-43d4-bd1b-b5a6d88c1d0c admin admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:00.526132 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db99c25-932b-43d4-bd1b-b5a6d88c1d0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:00.526428 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db99c25-932b-43d4-bd1b-b5a6d88c1d0c admin admin] PATH_INFO: `/v3/domains` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:00.527769 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db99c25-932b-43d4-bd1b-b5a6d88c1d0c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:28:00.533639 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db99c25-932b-43d4-bd1b-b5a6d88c1d0c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:00.536734 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db99c25-932b-43d4-bd1b-b5a6d88c1d0c admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:00.566607 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 952/1940] 10.222.0.66 () {58 vars in 1153 bytes} [Mon Sep 19 10:28:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:28:00.581699 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef58d03f-8526-4d72-a638-57cd7659b78a None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:00.599855 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef58d03f-8526-4d72-a638-57cd7659b78a None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:00.615893 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11665a36-6d06-475b-82b9-6dbae7ae4529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:00.616576 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11665a36-6d06-475b-82b9-6dbae7ae4529 admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:00.616846 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11665a36-6d06-475b-82b9-6dbae7ae4529 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:00.617119 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11665a36-6d06-475b-82b9-6dbae7ae4529 admin admin] PATH_INFO: `/v3/projects` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:00.617766 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11665a36-6d06-475b-82b9-6dbae7ae4529 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:00.619691 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11665a36-6d06-475b-82b9-6dbae7ae4529 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:00.696814 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db99c25-932b-43d4-bd1b-b5a6d88c1d0c admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:00.704325 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 989/1941] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 19 10:28:00 2022] POST /identity/v3/projects => generated 385 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:28:00.709735 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db99c25-932b-43d4-bd1b-b5a6d88c1d0c admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:00.787591 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa90dee2-7e0b-4fe5-8336-316887af8582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:00.789381 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa90dee2-7e0b-4fe5-8336-316887af8582 admin admin] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:00.789895 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa90dee2-7e0b-4fe5-8336-316887af8582 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:00.790404 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa90dee2-7e0b-4fe5-8336-316887af8582 admin admin] PATH_INFO: `/v3/users` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:00.792122 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa90dee2-7e0b-4fe5-8336-316887af8582 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:00.797737 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa90dee2-7e0b-4fe5-8336-316887af8582 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:00.849419 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 953/1942] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 19 10:28:00 2022] POST /identity/v3/users => generated 293 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:28:00.856117 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11665a36-6d06-475b-82b9-6dbae7ae4529 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:00.875762 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11665a36-6d06-475b-82b9-6dbae7ae4529 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:00.882774 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f91fee-fe16-4e54-8db9-700188361ae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:00.883698 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f91fee-fe16-4e54-8db9-700188361ae8 admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:00.884188 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f91fee-fe16-4e54-8db9-700188361ae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:00.884681 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f91fee-fe16-4e54-8db9-700188361ae8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:00.885565 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f91fee-fe16-4e54-8db9-700188361ae8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:00.889353 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f91fee-fe16-4e54-8db9-700188361ae8 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:00.903666 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 990/1943] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:28:00 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 10:28:00.908205 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa90dee2-7e0b-4fe5-8336-316887af8582 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:00.940409 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa90dee2-7e0b-4fe5-8336-316887af8582 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:00.951108 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5502a0-3281-47cf-ba20-ade3a621f8db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:00.952334 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5502a0-3281-47cf-ba20-ade3a621f8db admin admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:00.952878 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5502a0-3281-47cf-ba20-ade3a621f8db admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:00.953450 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5502a0-3281-47cf-ba20-ade3a621f8db admin admin] PATH_INFO: `/v3/roles` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:00.955153 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5502a0-3281-47cf-ba20-ade3a621f8db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:00.958485 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5502a0-3281-47cf-ba20-ade3a621f8db admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:00.980153 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 954/1944] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:28:00 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 10:28:00.984367 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f91fee-fe16-4e54-8db9-700188361ae8 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:01.001626 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f91fee-fe16-4e54-8db9-700188361ae8 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:01.012825 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20ab1bd-c4eb-465d-a3d7-644c792a4c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:01.013536 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20ab1bd-c4eb-465d-a3d7-644c792a4c58 admin admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:01.014153 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20ab1bd-c4eb-465d-a3d7-644c792a4c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:01.014153 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20ab1bd-c4eb-465d-a3d7-644c792a4c58 admin admin] PATH_INFO: `/v3/projects/71958d60e6104b25b68140f4732f0fc3/users/2b361041bc354fd8bbc10b8eee32efaf/roles/cd5b42ed3b754b58817a62bbe74651b4` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:01.052183 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20ab1bd-c4eb-465d-a3d7-644c792a4c58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71958d60e6104b25b68140f4732f0fc3, user_id=2b361041bc354fd8bbc10b8eee32efaf, role_id=cd5b42ed3b754b58817a62bbe74651b4)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:01.054971 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20ab1bd-c4eb-465d-a3d7-644c792a4c58 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:01.080227 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 991/1945] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 19 10:28:00 2022] PUT /identity/v3/projects/71958d60e6104b25b68140f4732f0fc3/users/2b361041bc354fd8bbc10b8eee32efaf/roles/cd5b42ed3b754b58817a62bbe74651b4 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:28:01.091447 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff38244e-abc5-4fa3-aad9-f880398db37b None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:01.091961 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff38244e-abc5-4fa3-aad9-f880398db37b None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:01.093824 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff38244e-abc5-4fa3-aad9-f880398db37b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:01.254371 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-ff38244e-abc5-4fa3-aad9-f880398db37b None None] MFA Rules not processed for user `2b361041bc354fd8bbc10b8eee32efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:28:01.259051 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-ff38244e-abc5-4fa3-aad9-f880398db37b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:28:01.360681 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:28:01.611385 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 955/1946] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:28:01 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 523 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 10:28:01.620490 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20ab1bd-c4eb-465d-a3d7-644c792a4c58 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:01.621419 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff38244e-abc5-4fa3-aad9-f880398db37b None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:01.622788 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-a20ab1bd-c4eb-465d-a3d7-644c792a4c58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:28:01.841507 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20ab1bd-c4eb-465d-a3d7-644c792a4c58 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:01.856599 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7c1c7c-12dc-4ac6-bf79-47dcbf71e69f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:01.857118 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff38244e-abc5-4fa3-aad9-f880398db37b None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:01.858121 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7c1c7c-12dc-4ac6-bf79-47dcbf71e69f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:01.858937 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7c1c7c-12dc-4ac6-bf79-47dcbf71e69f admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:01.866791 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7c1c7c-12dc-4ac6-bf79-47dcbf71e69f admin admin] PATH_INFO: `/v3/users/2d71cb1a3b2c4e55974e934f7e65963a` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:01.880924 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7c1c7c-12dc-4ac6-bf79-47dcbf71e69f admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d71cb1a3b2c4e55974e934f7e65963a)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:01.888634 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d658736a-0cd3-445e-9b0c-4f08fbc7e1f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:01.888944 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7c1c7c-12dc-4ac6-bf79-47dcbf71e69f admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:01.889281 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d658736a-0cd3-445e-9b0c-4f08fbc7e1f3 admin admin] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:01.889570 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d658736a-0cd3-445e-9b0c-4f08fbc7e1f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:01.889852 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d658736a-0cd3-445e-9b0c-4f08fbc7e1f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:01.890857 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d658736a-0cd3-445e-9b0c-4f08fbc7e1f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:01.893405 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d658736a-0cd3-445e-9b0c-4f08fbc7e1f3 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:01.944604 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 956/1947] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 19 10:28:01 2022] POST /identity/v3/projects => generated 383 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:28:01.947855 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b2115e-f82b-4aef-b88f-a106ad4ec453 None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:01.948158 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b2115e-f82b-4aef-b88f-a106ad4ec453 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:01.948467 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b2115e-f82b-4aef-b88f-a106ad4ec453 None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:01.959980 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 957/1948] 10.222.0.66 () {54 vars in 921 bytes} [Mon Sep 19 10:28:01 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:28:01.961325 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b2115e-f82b-4aef-b88f-a106ad4ec453 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:01.981877 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-cf7c1c7c-12dc-4ac6-bf79-47dcbf71e69f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d71cb1a3b2c4e55974e934f7e65963a'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:01.995017 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-cf7c1c7c-12dc-4ac6-bf79-47dcbf71e69f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d71cb1a3b2c4e55974e934f7e65963a'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:01.996671 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-cf7c1c7c-12dc-4ac6-bf79-47dcbf71e69f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d71cb1a3b2c4e55974e934f7e65963a'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:01.997287 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-cf7c1c7c-12dc-4ac6-bf79-47dcbf71e69f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d71cb1a3b2c4e55974e934f7e65963a'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:02.012711 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-cf7c1c7c-12dc-4ac6-bf79-47dcbf71e69f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d71cb1a3b2c4e55974e934f7e65963a'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:02.016113 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=84,keystone:DELETE=12,keystone:INSERT=4 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:28:02.044900 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 992/1949] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 19 10:28:01 2022] DELETE /identity/v3/users/2d71cb1a3b2c4e55974e934f7e65963a => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:28:02.046711 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36767b4c-295c-48b9-81f8-2dccbabd3720 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:02.047055 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36767b4c-295c-48b9-81f8-2dccbabd3720 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:02.047341 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36767b4c-295c-48b9-81f8-2dccbabd3720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:02.064383 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b2115e-f82b-4aef-b88f-a106ad4ec453 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:02.076158 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-36767b4c-295c-48b9-81f8-2dccbabd3720 None None] MFA Rules not processed for user `15c70bfb085a44e9b84942b480ff22f1`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:28:02.077521 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-36767b4c-295c-48b9-81f8-2dccbabd3720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:28:02.126230 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:28:02.150138 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbd53ec-409b-40c4-865b-ff234a4c99a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:02.150760 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbd53ec-409b-40c4-865b-ff234a4c99a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:02.151039 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbd53ec-409b-40c4-865b-ff234a4c99a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:02.151315 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbd53ec-409b-40c4-865b-ff234a4c99a4 admin admin] PATH_INFO: `/v3/users` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:02.152523 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbd53ec-409b-40c4-865b-ff234a4c99a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:02.155884 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbd53ec-409b-40c4-865b-ff234a4c99a4 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:02.183974 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 958/1950] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 19 10:28:01 2022] POST /identity/v3/users => generated 298 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:28:02.185467 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44164e69-5ef5-4595-a5e1-e9687c280dd4 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:02.185772 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44164e69-5ef5-4595-a5e1-e9687c280dd4 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:02.185879 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 993/1951] 10.222.0.66 () {58 vars in 1018 bytes} [Mon Sep 19 10:28:02 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:28:02.186071 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44164e69-5ef5-4595-a5e1-e9687c280dd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:02.188512 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36767b4c-295c-48b9-81f8-2dccbabd3720 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:02.190472 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-36767b4c-295c-48b9-81f8-2dccbabd3720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:28:02.208504 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-44164e69-5ef5-4595-a5e1-e9687c280dd4 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:28:02.209724 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-44164e69-5ef5-4595-a5e1-e9687c280dd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:28:02.209999 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36767b4c-295c-48b9-81f8-2dccbabd3720 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:02.214816 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084ded81-486b-4b9e-b093-32ad9c70bd8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:02.215449 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084ded81-486b-4b9e-b093-32ad9c70bd8a admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:02.215697 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084ded81-486b-4b9e-b093-32ad9c70bd8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:02.216009 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084ded81-486b-4b9e-b093-32ad9c70bd8a admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:02.216764 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084ded81-486b-4b9e-b093-32ad9c70bd8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:02.218220 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 959/1952] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:28:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:28:02.218384 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084ded81-486b-4b9e-b093-32ad9c70bd8a admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:02.219153 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44164e69-5ef5-4595-a5e1-e9687c280dd4 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:02.223567 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-44164e69-5ef5-4595-a5e1-e9687c280dd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:28:02.230448 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 994/1953] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:28:02 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 10:28:02.231320 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084ded81-486b-4b9e-b093-32ad9c70bd8a admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:02.235348 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-084ded81-486b-4b9e-b093-32ad9c70bd8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:28:02.246231 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44164e69-5ef5-4595-a5e1-e9687c280dd4 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:02.252137 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53b029c-da6d-43ae-9c8a-6f6cfb80a59b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15c70bfb085a44e9b84942b480ff22f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:02.252786 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53b029c-da6d-43ae-9c8a-6f6cfb80a59b service nova] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:02.253100 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53b029c-da6d-43ae-9c8a-6f6cfb80a59b service nova] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:02.253374 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53b029c-da6d-43ae-9c8a-6f6cfb80a59b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:02.263068 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53b029c-da6d-43ae-9c8a-6f6cfb80a59b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:02.264833 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53b029c-da6d-43ae-9c8a-6f6cfb80a59b service nova] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:02.275310 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 960/1954] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:28:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:28:02.276374 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53b029c-da6d-43ae-9c8a-6f6cfb80a59b service nova] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:02.287166 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53b029c-da6d-43ae-9c8a-6f6cfb80a59b service nova] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:02.292741 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647c81d4-8dba-415b-b010-bbb30860e0d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:02.293416 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647c81d4-8dba-415b-b010-bbb30860e0d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:02.293748 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647c81d4-8dba-415b-b010-bbb30860e0d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:02.294028 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647c81d4-8dba-415b-b010-bbb30860e0d3 admin admin] PATH_INFO: `/v3/projects/acdcde1d388b4c2fa748444a43d70cf0/users/ac4cac2627764eff96a62eefdce72904/roles/5c8b89fae4fa45bd944cbeaf442136e1` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:02.299623 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084ded81-486b-4b9e-b093-32ad9c70bd8a admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:02.304320 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c822cb-5e1b-4b47-9ec3-1f5a14ac8ae0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c1289b015854c6bb6aee8fed6b807db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:02.305019 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c822cb-5e1b-4b47-9ec3-1f5a14ac8ae0 service neutron] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:02.305367 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c822cb-5e1b-4b47-9ec3-1f5a14ac8ae0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:02.305709 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c822cb-5e1b-4b47-9ec3-1f5a14ac8ae0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:02.311792 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647c81d4-8dba-415b-b010-bbb30860e0d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=acdcde1d388b4c2fa748444a43d70cf0, user_id=ac4cac2627764eff96a62eefdce72904, role_id=5c8b89fae4fa45bd944cbeaf442136e1)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:02.315726 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647c81d4-8dba-415b-b010-bbb30860e0d3 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:02.316812 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c822cb-5e1b-4b47-9ec3-1f5a14ac8ae0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:02.318573 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c822cb-5e1b-4b47-9ec3-1f5a14ac8ae0 service neutron] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:02.329994 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 995/1955] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:28:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:28:02.335023 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 961/1956] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 19 10:28:02 2022] PUT /identity/v3/projects/acdcde1d388b4c2fa748444a43d70cf0/users/ac4cac2627764eff96a62eefdce72904/roles/5c8b89fae4fa45bd944cbeaf442136e1 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:28:02.339073 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c822cb-5e1b-4b47-9ec3-1f5a14ac8ae0 service neutron] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:02.350497 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c822cb-5e1b-4b47-9ec3-1f5a14ac8ae0 service neutron] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:02.451877 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46275529-ff37-469d-a640-47ee765d5976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:02.452540 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46275529-ff37-469d-a640-47ee765d5976 admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:02.452821 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46275529-ff37-469d-a640-47ee765d5976 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:02.453090 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46275529-ff37-469d-a640-47ee765d5976 admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:02.454245 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46275529-ff37-469d-a640-47ee765d5976 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:02.456360 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46275529-ff37-469d-a640-47ee765d5976 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:02.471474 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 996/1957] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:28:02 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 10:28:02.473568 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647c81d4-8dba-415b-b010-bbb30860e0d3 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:02.485331 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647c81d4-8dba-415b-b010-bbb30860e0d3 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:02.491016 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae631d89-1b83-40a1-8dcb-b878546ca25b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:02.492096 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae631d89-1b83-40a1-8dcb-b878546ca25b admin admin] REQUEST_METHOD: `PUT` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:02.492661 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae631d89-1b83-40a1-8dcb-b878546ca25b admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:02.493452 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae631d89-1b83-40a1-8dcb-b878546ca25b admin admin] PATH_INFO: `/v3/projects/acdcde1d388b4c2fa748444a43d70cf0/users/ac4cac2627764eff96a62eefdce72904/roles/5c8b89fae4fa45bd944cbeaf442136e1` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:02.496969 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae631d89-1b83-40a1-8dcb-b878546ca25b admin admin] RBAC: Authorizing `identity:create_grant(project_id=acdcde1d388b4c2fa748444a43d70cf0, user_id=ac4cac2627764eff96a62eefdce72904, role_id=5c8b89fae4fa45bd944cbeaf442136e1)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:02.499753 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae631d89-1b83-40a1-8dcb-b878546ca25b admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:02.511913 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 962/1958] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 19 10:28:02 2022] PUT /identity/v3/projects/acdcde1d388b4c2fa748444a43d70cf0/users/ac4cac2627764eff96a62eefdce72904/roles/5c8b89fae4fa45bd944cbeaf442136e1 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:28:02.522398 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61106dd5-5c3d-402b-aea4-c67fdb9cf8f2 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:02.522730 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61106dd5-5c3d-402b-aea4-c67fdb9cf8f2 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:02.522971 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61106dd5-5c3d-402b-aea4-c67fdb9cf8f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:02.539876 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:28:02.565269 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-61106dd5-5c3d-402b-aea4-c67fdb9cf8f2 None None] MFA Rules not processed for user `ac4cac2627764eff96a62eefdce72904`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:28:02.567739 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-61106dd5-5c3d-402b-aea4-c67fdb9cf8f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:28:02.680119 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 997/1959] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:28:02 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:28:02.701914 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae631d89-1b83-40a1-8dcb-b878546ca25b admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:02.703882 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-ae631d89-1b83-40a1-8dcb-b878546ca25b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:28:02.779112 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61106dd5-5c3d-402b-aea4-c67fdb9cf8f2 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:02.780854 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-61106dd5-5c3d-402b-aea4-c67fdb9cf8f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:28:02.808037 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae631d89-1b83-40a1-8dcb-b878546ca25b admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:02.817922 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f323a271-a240-43fc-88ef-c86b4157da9a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa4d004fd44482cae761c4b3bdfab31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:02.818718 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f323a271-a240-43fc-88ef-c86b4157da9a service cinder] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:02.819090 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f323a271-a240-43fc-88ef-c86b4157da9a service cinder] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:02.819463 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f323a271-a240-43fc-88ef-c86b4157da9a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:02.821643 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-f323a271-a240-43fc-88ef-c86b4157da9a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:28:02.887163 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61106dd5-5c3d-402b-aea4-c67fdb9cf8f2 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:02.893391 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e605bc-9e61-4a88-b3d3-f9e092c42ce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:02.894141 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e605bc-9e61-4a88-b3d3-f9e092c42ce8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:02.894550 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e605bc-9e61-4a88-b3d3-f9e092c42ce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:02.894897 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e605bc-9e61-4a88-b3d3-f9e092c42ce8 admin admin] PATH_INFO: `/v3/projects/e2b72ca3d97f4348a450d5f76aa7a05c` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:02.896152 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e605bc-9e61-4a88-b3d3-f9e092c42ce8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2b72ca3d97f4348a450d5f76aa7a05c)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:02.898913 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e605bc-9e61-4a88-b3d3-f9e092c42ce8 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:02.925401 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f323a271-a240-43fc-88ef-c86b4157da9a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:02.927316 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f323a271-a240-43fc-88ef-c86b4157da9a service cinder] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:02.938376 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 963/1960] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:28:02 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:28:02.970780 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-d6e605bc-9e61-4a88-b3d3-f9e092c42ce8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2b72ca3d97f4348a450d5f76aa7a05c', 'request_id': 'req-d6e605bc-9e61-4a88-b3d3-f9e092c42ce8'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:02.977289 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-d6e605bc-9e61-4a88-b3d3-f9e092c42ce8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2b72ca3d97f4348a450d5f76aa7a05c', 'request_id': 'req-d6e605bc-9e61-4a88-b3d3-f9e092c42ce8'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:02.986663 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-d6e605bc-9e61-4a88-b3d3-f9e092c42ce8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2b72ca3d97f4348a450d5f76aa7a05c', 'request_id': 'req-d6e605bc-9e61-4a88-b3d3-f9e092c42ce8'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:02.999726 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-d6e605bc-9e61-4a88-b3d3-f9e092c42ce8 admin admin] The token cache is being invalidate because project e2b72ca3d97f4348a450d5f76aa7a05c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 10:28:03.000342 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-d6e605bc-9e61-4a88-b3d3-f9e092c42ce8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:03.000705 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-d6e605bc-9e61-4a88-b3d3-f9e092c42ce8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:03.005256 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 998/1961] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 19 10:28:02 2022] DELETE /identity/v3/projects/e2b72ca3d97f4348a450d5f76aa7a05c => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:28:03.006265 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f323a271-a240-43fc-88ef-c86b4157da9a service cinder] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:03.017494 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f323a271-a240-43fc-88ef-c86b4157da9a service cinder] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:03.065784 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:28:03.115722 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ebd1a3-621f-45c8-b23f-9de926c2c540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:03.116599 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ebd1a3-621f-45c8-b23f-9de926c2c540 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:03.116930 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ebd1a3-621f-45c8-b23f-9de926c2c540 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:03.117465 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ebd1a3-621f-45c8-b23f-9de926c2c540 admin admin] PATH_INFO: `/v3/users/523825454a4a48fcb17b3ea39fae0ce0` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:03.120720 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ebd1a3-621f-45c8-b23f-9de926c2c540 admin admin] RBAC: Authorizing `identity:delete_user(user_id=523825454a4a48fcb17b3ea39fae0ce0)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:03.122737 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ebd1a3-621f-45c8-b23f-9de926c2c540 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:03.197875 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-c7ebd1a3-621f-45c8-b23f-9de926c2c540 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '523825454a4a48fcb17b3ea39fae0ce0'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:03.224665 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-c7ebd1a3-621f-45c8-b23f-9de926c2c540 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '523825454a4a48fcb17b3ea39fae0ce0'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:03.225782 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-c7ebd1a3-621f-45c8-b23f-9de926c2c540 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '523825454a4a48fcb17b3ea39fae0ce0'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:03.227488 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-c7ebd1a3-621f-45c8-b23f-9de926c2c540 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '523825454a4a48fcb17b3ea39fae0ce0'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:03.241270 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-c7ebd1a3-621f-45c8-b23f-9de926c2c540 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '523825454a4a48fcb17b3ea39fae0ce0'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:03.263986 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 964/1962] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 19 10:28:03 2022] DELETE /identity/v3/users/523825454a4a48fcb17b3ea39fae0ce0 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 10:28:03.575866 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e605bc-9e61-4a88-b3d3-f9e092c42ce8 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:03.577621 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-d6e605bc-9e61-4a88-b3d3-f9e092c42ce8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:28:03.602223 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e605bc-9e61-4a88-b3d3-f9e092c42ce8 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:03.619974 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:28:03.688134 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d899a22-0706-4bc2-b2a9-5ee3cf792567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:03.689094 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d899a22-0706-4bc2-b2a9-5ee3cf792567 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:03.689449 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d899a22-0706-4bc2-b2a9-5ee3cf792567 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:03.689796 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d899a22-0706-4bc2-b2a9-5ee3cf792567 admin admin] PATH_INFO: `/v3/projects/717105ff34924c32a74c8a00eef52830` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:03.691080 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d899a22-0706-4bc2-b2a9-5ee3cf792567 admin admin] RBAC: Authorizing `identity:delete_project(project_id=717105ff34924c32a74c8a00eef52830)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:03.693200 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d899a22-0706-4bc2-b2a9-5ee3cf792567 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:03.751055 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-0d899a22-0706-4bc2-b2a9-5ee3cf792567 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '717105ff34924c32a74c8a00eef52830', 'request_id': 'req-0d899a22-0706-4bc2-b2a9-5ee3cf792567'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:03.758797 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-0d899a22-0706-4bc2-b2a9-5ee3cf792567 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '717105ff34924c32a74c8a00eef52830', 'request_id': 'req-0d899a22-0706-4bc2-b2a9-5ee3cf792567'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:03.769671 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-0d899a22-0706-4bc2-b2a9-5ee3cf792567 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '717105ff34924c32a74c8a00eef52830', 'request_id': 'req-0d899a22-0706-4bc2-b2a9-5ee3cf792567'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:03.782303 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-0d899a22-0706-4bc2-b2a9-5ee3cf792567 admin admin] The token cache is being invalidate because project 717105ff34924c32a74c8a00eef52830 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 10:28:03.782596 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-0d899a22-0706-4bc2-b2a9-5ee3cf792567 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:03.783254 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-0d899a22-0706-4bc2-b2a9-5ee3cf792567 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:03.784968 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 999/1963] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 19 10:28:03 2022] DELETE /identity/v3/projects/717105ff34924c32a74c8a00eef52830 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:28:03.789092 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ebd1a3-621f-45c8-b23f-9de926c2c540 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:03.790943 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-c7ebd1a3-621f-45c8-b23f-9de926c2c540 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:28:03.806475 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ebd1a3-621f-45c8-b23f-9de926c2c540 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:03.902569 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cecf744-0f2c-462c-b671-5f30e13ac392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:03.903221 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cecf744-0f2c-462c-b671-5f30e13ac392 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:03.903818 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cecf744-0f2c-462c-b671-5f30e13ac392 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:03.903982 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cecf744-0f2c-462c-b671-5f30e13ac392 admin admin] PATH_INFO: `/v3/users/ba309ee5a1c74f0b86c3e5ea0ee471bd` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:03.905424 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cecf744-0f2c-462c-b671-5f30e13ac392 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba309ee5a1c74f0b86c3e5ea0ee471bd)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:03.907370 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cecf744-0f2c-462c-b671-5f30e13ac392 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:03.971649 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-1cecf744-0f2c-462c-b671-5f30e13ac392 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba309ee5a1c74f0b86c3e5ea0ee471bd'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:03.982245 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-1cecf744-0f2c-462c-b671-5f30e13ac392 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba309ee5a1c74f0b86c3e5ea0ee471bd'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:03.983905 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-1cecf744-0f2c-462c-b671-5f30e13ac392 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba309ee5a1c74f0b86c3e5ea0ee471bd'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:03.984739 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-1cecf744-0f2c-462c-b671-5f30e13ac392 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba309ee5a1c74f0b86c3e5ea0ee471bd'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:03.987468 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:28:04.005420 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-1cecf744-0f2c-462c-b671-5f30e13ac392 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba309ee5a1c74f0b86c3e5ea0ee471bd'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:04.026142 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 965/1964] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 19 10:28:03 2022] DELETE /identity/v3/users/ba309ee5a1c74f0b86c3e5ea0ee471bd => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:28:04.653049 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d899a22-0706-4bc2-b2a9-5ee3cf792567 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:04.655216 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-0d899a22-0706-4bc2-b2a9-5ee3cf792567 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:28:04.671877 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d899a22-0706-4bc2-b2a9-5ee3cf792567 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:04.745639 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1455ca84-d0d4-45e2-88f6-b75f5c74c5b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:04.746308 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1455ca84-d0d4-45e2-88f6-b75f5c74c5b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:04.746592 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1455ca84-d0d4-45e2-88f6-b75f5c74c5b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:04.746863 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1455ca84-d0d4-45e2-88f6-b75f5c74c5b9 admin admin] PATH_INFO: `/v3/projects/383080a987164aa2b0db26916dc767cb` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:04.747986 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1455ca84-d0d4-45e2-88f6-b75f5c74c5b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=383080a987164aa2b0db26916dc767cb)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:04.749979 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1455ca84-d0d4-45e2-88f6-b75f5c74c5b9 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:04.804969 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-1455ca84-d0d4-45e2-88f6-b75f5c74c5b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '383080a987164aa2b0db26916dc767cb', 'request_id': 'req-1455ca84-d0d4-45e2-88f6-b75f5c74c5b9'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:04.806280 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:28:04.814407 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-1455ca84-d0d4-45e2-88f6-b75f5c74c5b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '383080a987164aa2b0db26916dc767cb', 'request_id': 'req-1455ca84-d0d4-45e2-88f6-b75f5c74c5b9'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:04.826390 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-1455ca84-d0d4-45e2-88f6-b75f5c74c5b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '383080a987164aa2b0db26916dc767cb', 'request_id': 'req-1455ca84-d0d4-45e2-88f6-b75f5c74c5b9'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:04.839261 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-1455ca84-d0d4-45e2-88f6-b75f5c74c5b9 admin admin] The token cache is being invalidate because project 383080a987164aa2b0db26916dc767cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 10:28:04.840057 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-1455ca84-d0d4-45e2-88f6-b75f5c74c5b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:04.840738 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-1455ca84-d0d4-45e2-88f6-b75f5c74c5b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:04.842527 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1000/1965] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 19 10:28:04 2022] DELETE /identity/v3/projects/383080a987164aa2b0db26916dc767cb => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:28:04.848132 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7546dcdb-c730-4eac-a61a-395324b8c36f None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:04.848533 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7546dcdb-c730-4eac-a61a-395324b8c36f None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:04.848854 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7546dcdb-c730-4eac-a61a-395324b8c36f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:04.876280 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-7546dcdb-c730-4eac-a61a-395324b8c36f None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:28:04.877663 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-7546dcdb-c730-4eac-a61a-395324b8c36f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:28:04.965590 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 966/1966] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:28:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:28:04.973464 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0986160e-9dfc-4db5-9c5e-fff2e886a930 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:04.973797 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0986160e-9dfc-4db5-9c5e-fff2e886a930 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:04.974078 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0986160e-9dfc-4db5-9c5e-fff2e886a930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:04.997006 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-0986160e-9dfc-4db5-9c5e-fff2e886a930 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:28:04.998834 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-0986160e-9dfc-4db5-9c5e-fff2e886a930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:28:05.010230 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1001/1967] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:28:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:28:05.012049 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7546dcdb-c730-4eac-a61a-395324b8c36f None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:05.022811 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7546dcdb-c730-4eac-a61a-395324b8c36f None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:05.028643 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9061edd1-2b76-49e6-afce-9f553960eaea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:05.029318 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9061edd1-2b76-49e6-afce-9f553960eaea admin admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:05.029945 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9061edd1-2b76-49e6-afce-9f553960eaea admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:05.030285 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9061edd1-2b76-49e6-afce-9f553960eaea admin admin] PATH_INFO: `/v3/domains` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:05.031014 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9061edd1-2b76-49e6-afce-9f553960eaea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:28:05.031422 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9061edd1-2b76-49e6-afce-9f553960eaea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:05.033785 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9061edd1-2b76-49e6-afce-9f553960eaea admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:05.049171 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 967/1968] 10.222.0.66 () {58 vars in 1153 bytes} [Mon Sep 19 10:28:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:28:05.059153 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0986160e-9dfc-4db5-9c5e-fff2e886a930 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:05.070783 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0986160e-9dfc-4db5-9c5e-fff2e886a930 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:05.086419 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fae3b52-e584-46e6-8850-709a8b577260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:05.087446 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fae3b52-e584-46e6-8850-709a8b577260 admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:05.087910 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fae3b52-e584-46e6-8850-709a8b577260 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:05.088429 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fae3b52-e584-46e6-8850-709a8b577260 admin admin] PATH_INFO: `/v3/projects` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:05.089294 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fae3b52-e584-46e6-8850-709a8b577260 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:05.091805 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fae3b52-e584-46e6-8850-709a8b577260 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:05.150755 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1002/1969] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 19 10:28:05 2022] POST /identity/v3/projects => generated 371 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:28:05.152440 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9061edd1-2b76-49e6-afce-9f553960eaea admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:05.165037 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9061edd1-2b76-49e6-afce-9f553960eaea admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:05.263566 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c6ccc9-451c-4478-930d-2600873768f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:05.264821 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c6ccc9-451c-4478-930d-2600873768f5 admin admin] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:05.265526 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c6ccc9-451c-4478-930d-2600873768f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:05.266016 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c6ccc9-451c-4478-930d-2600873768f5 admin admin] PATH_INFO: `/v3/users` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:05.266979 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c6ccc9-451c-4478-930d-2600873768f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:05.269370 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c6ccc9-451c-4478-930d-2600873768f5 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:05.295974 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 968/1970] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 19 10:28:05 2022] POST /identity/v3/users => generated 286 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:28:05.299816 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fae3b52-e584-46e6-8850-709a8b577260 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:05.311179 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fae3b52-e584-46e6-8850-709a8b577260 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:05.316074 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57db0c1a-cea7-4374-84c9-7d519dbcf6bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:05.316716 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57db0c1a-cea7-4374-84c9-7d519dbcf6bc admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:05.317334 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57db0c1a-cea7-4374-84c9-7d519dbcf6bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:05.317334 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57db0c1a-cea7-4374-84c9-7d519dbcf6bc admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:05.317898 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57db0c1a-cea7-4374-84c9-7d519dbcf6bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:05.319502 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57db0c1a-cea7-4374-84c9-7d519dbcf6bc admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:05.330866 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1003/1971] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:28:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 10:28:05.334772 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c6ccc9-451c-4478-930d-2600873768f5 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:05.345728 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c6ccc9-451c-4478-930d-2600873768f5 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:05.351423 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05da2bef-85bc-48c5-ad8d-07fef5ba03ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:05.352074 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05da2bef-85bc-48c5-ad8d-07fef5ba03ae admin admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:05.352408 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05da2bef-85bc-48c5-ad8d-07fef5ba03ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:05.352683 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05da2bef-85bc-48c5-ad8d-07fef5ba03ae admin admin] PATH_INFO: `/v3/roles` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:05.353329 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05da2bef-85bc-48c5-ad8d-07fef5ba03ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:05.355011 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05da2bef-85bc-48c5-ad8d-07fef5ba03ae admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:05.372215 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 969/1972] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:28:05 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 10:28:05.373998 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57db0c1a-cea7-4374-84c9-7d519dbcf6bc admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:05.387804 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57db0c1a-cea7-4374-84c9-7d519dbcf6bc admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:05.393084 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd12ad04-bcaa-4688-b695-2233e7cf6afe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:05.393828 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd12ad04-bcaa-4688-b695-2233e7cf6afe admin admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:05.394185 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd12ad04-bcaa-4688-b695-2233e7cf6afe admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:05.394541 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd12ad04-bcaa-4688-b695-2233e7cf6afe admin admin] PATH_INFO: `/v3/projects/051dda581f074f8598ca847a341827c2/users/7b625fd0d9ec45898a962947bf4acb4b/roles/cd5b42ed3b754b58817a62bbe74651b4` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:05.413505 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd12ad04-bcaa-4688-b695-2233e7cf6afe admin admin] RBAC: Authorizing `identity:create_grant(project_id=051dda581f074f8598ca847a341827c2, user_id=7b625fd0d9ec45898a962947bf4acb4b, role_id=cd5b42ed3b754b58817a62bbe74651b4)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:05.416232 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd12ad04-bcaa-4688-b695-2233e7cf6afe admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:05.431933 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1004/1973] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 19 10:28:05 2022] PUT /identity/v3/projects/051dda581f074f8598ca847a341827c2/users/7b625fd0d9ec45898a962947bf4acb4b/roles/cd5b42ed3b754b58817a62bbe74651b4 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:28:05.437458 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c11c02-060e-4b76-b1ae-e0506c0b019d None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:05.437745 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c11c02-060e-4b76-b1ae-e0506c0b019d None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:05.438022 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c11c02-060e-4b76-b1ae-e0506c0b019d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:05.460028 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-b5c11c02-060e-4b76-b1ae-e0506c0b019d None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:28:05.461364 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-b5c11c02-060e-4b76-b1ae-e0506c0b019d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:28:05.504725 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:28:05.563364 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 970/1974] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:28:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:28:05.564808 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd12ad04-bcaa-4688-b695-2233e7cf6afe admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:05.568314 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-cd12ad04-bcaa-4688-b695-2233e7cf6afe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:28:05.648823 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd12ad04-bcaa-4688-b695-2233e7cf6afe admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:05.653303 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06c72b9-da00-4135-9c44-2e018ca9fbdc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c1289b015854c6bb6aee8fed6b807db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:05.653997 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06c72b9-da00-4135-9c44-2e018ca9fbdc service neutron] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:05.654234 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06c72b9-da00-4135-9c44-2e018ca9fbdc service neutron] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:05.654461 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06c72b9-da00-4135-9c44-2e018ca9fbdc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:05.665270 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06c72b9-da00-4135-9c44-2e018ca9fbdc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:05.666746 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06c72b9-da00-4135-9c44-2e018ca9fbdc service neutron] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:05.677630 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1005/1975] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:28:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 10:28:06.685545 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1a6824-e731-4fbe-a187-fc0872935dcc None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:06.686630 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1a6824-e731-4fbe-a187-fc0872935dcc None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:06.687193 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1a6824-e731-4fbe-a187-fc0872935dcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:06.716362 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-2a1a6824-e731-4fbe-a187-fc0872935dcc None None] MFA Rules not processed for user `7b625fd0d9ec45898a962947bf4acb4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:28:06.717794 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-2a1a6824-e731-4fbe-a187-fc0872935dcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:28:06.797711 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 971/1976] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:28:06 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:28:06.802079 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06c72b9-da00-4135-9c44-2e018ca9fbdc service neutron] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:06.813944 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06c72b9-da00-4135-9c44-2e018ca9fbdc service neutron] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:06.821832 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6317b27a-1a72-460d-a48c-85952b6bde7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:06.822913 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6317b27a-1a72-460d-a48c-85952b6bde7b admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:06.823204 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6317b27a-1a72-460d-a48c-85952b6bde7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:06.823541 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6317b27a-1a72-460d-a48c-85952b6bde7b admin admin] PATH_INFO: `/v3/projects` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:06.824951 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6317b27a-1a72-460d-a48c-85952b6bde7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:06.827017 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6317b27a-1a72-460d-a48c-85952b6bde7b admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:06.858311 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1006/1977] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 19 10:28:06 2022] POST /identity/v3/projects => generated 373 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:28:06.862413 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1a6824-e731-4fbe-a187-fc0872935dcc None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:06.876768 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1a6824-e731-4fbe-a187-fc0872935dcc None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:06.960738 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b8804b-390f-4212-be56-8bfdf4e90224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:06.961367 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b8804b-390f-4212-be56-8bfdf4e90224 admin admin] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:06.961648 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b8804b-390f-4212-be56-8bfdf4e90224 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:06.961926 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b8804b-390f-4212-be56-8bfdf4e90224 admin admin] PATH_INFO: `/v3/users` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:06.962562 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b8804b-390f-4212-be56-8bfdf4e90224 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:06.964673 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b8804b-390f-4212-be56-8bfdf4e90224 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:06.990363 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 972/1978] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 19 10:28:06 2022] POST /identity/v3/users => generated 293 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 10:28:06.991679 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6317b27a-1a72-460d-a48c-85952b6bde7b admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:07.004387 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6317b27a-1a72-460d-a48c-85952b6bde7b admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:07.010421 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bfc73f-4940-49ef-b9be-218e41107a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:07.011085 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bfc73f-4940-49ef-b9be-218e41107a08 admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:07.011369 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bfc73f-4940-49ef-b9be-218e41107a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:07.011831 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bfc73f-4940-49ef-b9be-218e41107a08 admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:07.012529 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bfc73f-4940-49ef-b9be-218e41107a08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:07.014317 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bfc73f-4940-49ef-b9be-218e41107a08 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:07.033004 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1007/1979] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:28:06 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 10:28:07.037976 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b8804b-390f-4212-be56-8bfdf4e90224 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:07.052654 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b8804b-390f-4212-be56-8bfdf4e90224 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:07.059702 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06afd37a-5e62-49f8-b120-0999f17af7bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:07.060512 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06afd37a-5e62-49f8-b120-0999f17af7bc admin admin] REQUEST_METHOD: `PUT` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:07.060763 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06afd37a-5e62-49f8-b120-0999f17af7bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:07.061007 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06afd37a-5e62-49f8-b120-0999f17af7bc admin admin] PATH_INFO: `/v3/projects/45584272919f451881cc199fdddc0f99/users/88be76395a9d45e4ad7e926c4c28e592/roles/5c8b89fae4fa45bd944cbeaf442136e1` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:07.082844 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06afd37a-5e62-49f8-b120-0999f17af7bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=45584272919f451881cc199fdddc0f99, user_id=88be76395a9d45e4ad7e926c4c28e592, role_id=5c8b89fae4fa45bd944cbeaf442136e1)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:07.086366 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06afd37a-5e62-49f8-b120-0999f17af7bc admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:07.102315 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 973/1980] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 19 10:28:07 2022] PUT /identity/v3/projects/45584272919f451881cc199fdddc0f99/users/88be76395a9d45e4ad7e926c4c28e592/roles/5c8b89fae4fa45bd944cbeaf442136e1 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:28:07.107020 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bfc73f-4940-49ef-b9be-218e41107a08 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:07.118483 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bfc73f-4940-49ef-b9be-218e41107a08 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:07.175817 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:28:07.194712 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0f9ef8-51dd-4792-8858-cd381904ff9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:07.195342 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0f9ef8-51dd-4792-8858-cd381904ff9b admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:07.195628 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0f9ef8-51dd-4792-8858-cd381904ff9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:07.195907 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0f9ef8-51dd-4792-8858-cd381904ff9b admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:07.196603 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0f9ef8-51dd-4792-8858-cd381904ff9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:07.198311 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0f9ef8-51dd-4792-8858-cd381904ff9b admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:07.209453 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1008/1981] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:28:07 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 10:28:07.213566 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06afd37a-5e62-49f8-b120-0999f17af7bc admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:07.227893 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06afd37a-5e62-49f8-b120-0999f17af7bc admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:07.234172 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92e5932-4363-4667-abf0-25c9a9721491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:07.234961 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92e5932-4363-4667-abf0-25c9a9721491 admin admin] REQUEST_METHOD: `PUT` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:07.235341 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92e5932-4363-4667-abf0-25c9a9721491 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:07.235716 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92e5932-4363-4667-abf0-25c9a9721491 admin admin] PATH_INFO: `/v3/projects/45584272919f451881cc199fdddc0f99/users/88be76395a9d45e4ad7e926c4c28e592/roles/5c8b89fae4fa45bd944cbeaf442136e1` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:07.238019 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92e5932-4363-4667-abf0-25c9a9721491 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45584272919f451881cc199fdddc0f99, user_id=88be76395a9d45e4ad7e926c4c28e592, role_id=5c8b89fae4fa45bd944cbeaf442136e1)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:07.240836 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92e5932-4363-4667-abf0-25c9a9721491 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:07.253548 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 974/1982] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 19 10:28:07 2022] PUT /identity/v3/projects/45584272919f451881cc199fdddc0f99/users/88be76395a9d45e4ad7e926c4c28e592/roles/5c8b89fae4fa45bd944cbeaf442136e1 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:28:08.191920 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbf2e10-c122-4b53-9901-ba0aa7c138e9 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:08.192506 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbf2e10-c122-4b53-9901-ba0aa7c138e9 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:08.192613 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbf2e10-c122-4b53-9901-ba0aa7c138e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:08.230381 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-fbbf2e10-c122-4b53-9901-ba0aa7c138e9 None None] MFA Rules not processed for user `88be76395a9d45e4ad7e926c4c28e592`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:28:08.232006 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-fbbf2e10-c122-4b53-9901-ba0aa7c138e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:28:08.313603 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1009/1983] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:28:08 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:28:08.325227 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3227fe2e-04a0-451c-ac97-e71f34e847ec None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:08.325762 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3227fe2e-04a0-451c-ac97-e71f34e847ec None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:08.325864 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3227fe2e-04a0-451c-ac97-e71f34e847ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:08.346554 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-3227fe2e-04a0-451c-ac97-e71f34e847ec None None] MFA Rules not processed for user `7b625fd0d9ec45898a962947bf4acb4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:28:08.347835 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-3227fe2e-04a0-451c-ac97-e71f34e847ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:28:08.362191 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:28:08.422909 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 975/1984] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:28:08 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:28:08.435618 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbf2e10-c122-4b53-9901-ba0aa7c138e9 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:08.437368 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-fbbf2e10-c122-4b53-9901-ba0aa7c138e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:28:08.533594 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbf2e10-c122-4b53-9901-ba0aa7c138e9 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:08.534876 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bfcf92-e2b7-4d64-8be4-a8bdbbe16481 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15c70bfb085a44e9b84942b480ff22f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:08.535781 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bfcf92-e2b7-4d64-8be4-a8bdbbe16481 service nova] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:08.535976 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bfcf92-e2b7-4d64-8be4-a8bdbbe16481 service nova] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:08.536361 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bfcf92-e2b7-4d64-8be4-a8bdbbe16481 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:08.548005 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bfcf92-e2b7-4d64-8be4-a8bdbbe16481 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:08.550652 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bfcf92-e2b7-4d64-8be4-a8bdbbe16481 service nova] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:08.576264 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1010/1985] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:28:08 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:28:08.740918 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3227fe2e-04a0-451c-ac97-e71f34e847ec None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:08.742749 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-3227fe2e-04a0-451c-ac97-e71f34e847ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:28:08.833793 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3227fe2e-04a0-451c-ac97-e71f34e847ec None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:08.837592 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f52bc24-0e3e-4e2c-880e-c04638cdc3a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa4d004fd44482cae761c4b3bdfab31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:08.838177 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f52bc24-0e3e-4e2c-880e-c04638cdc3a0 service cinder] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:08.838454 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f52bc24-0e3e-4e2c-880e-c04638cdc3a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:08.838723 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f52bc24-0e3e-4e2c-880e-c04638cdc3a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:08.841078 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-2f52bc24-0e3e-4e2c-880e-c04638cdc3a0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:28:08.924147 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f52bc24-0e3e-4e2c-880e-c04638cdc3a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:08.925840 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f52bc24-0e3e-4e2c-880e-c04638cdc3a0 service cinder] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:08.947216 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 976/1986] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:28:08 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:28:13.961886 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bfcf92-e2b7-4d64-8be4-a8bdbbe16481 service nova] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:13.963377 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-93bfcf92-e2b7-4d64-8be4-a8bdbbe16481 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:28:14.023183 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:28:14.038276 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bfcf92-e2b7-4d64-8be4-a8bdbbe16481 service nova] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:14.043731 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df74b9df-003a-4416-b1bf-bc17cf5acb55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:14.044470 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df74b9df-003a-4416-b1bf-bc17cf5acb55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:14.044753 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df74b9df-003a-4416-b1bf-bc17cf5acb55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:14.045336 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df74b9df-003a-4416-b1bf-bc17cf5acb55 admin admin] PATH_INFO: `/v3/users/66626e1b76b74b038126aabb57aa8608` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:14.046804 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df74b9df-003a-4416-b1bf-bc17cf5acb55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=66626e1b76b74b038126aabb57aa8608)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:14.049039 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df74b9df-003a-4416-b1bf-bc17cf5acb55 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:14.095850 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-df74b9df-003a-4416-b1bf-bc17cf5acb55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66626e1b76b74b038126aabb57aa8608'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:14.103145 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-df74b9df-003a-4416-b1bf-bc17cf5acb55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66626e1b76b74b038126aabb57aa8608'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:14.103807 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-df74b9df-003a-4416-b1bf-bc17cf5acb55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66626e1b76b74b038126aabb57aa8608'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:14.105193 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-df74b9df-003a-4416-b1bf-bc17cf5acb55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66626e1b76b74b038126aabb57aa8608'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:14.112994 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-df74b9df-003a-4416-b1bf-bc17cf5acb55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66626e1b76b74b038126aabb57aa8608'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:14.133680 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f52bc24-0e3e-4e2c-880e-c04638cdc3a0 service cinder] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:14.135305 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-2f52bc24-0e3e-4e2c-880e-c04638cdc3a0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:28:14.135418 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1011/1987] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 19 10:28:13 2022] DELETE /identity/v3/users/66626e1b76b74b038126aabb57aa8608 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:28:14.136770 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc816805-0ce3-4fce-b89e-2612f74922e3 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:14.137063 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc816805-0ce3-4fce-b89e-2612f74922e3 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:14.137347 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc816805-0ce3-4fce-b89e-2612f74922e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:14.149168 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f52bc24-0e3e-4e2c-880e-c04638cdc3a0 service cinder] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:14.159151 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-fc816805-0ce3-4fce-b89e-2612f74922e3 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:28:14.160605 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-fc816805-0ce3-4fce-b89e-2612f74922e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:28:14.240833 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c15b26c-db0c-44ce-b766-963aa5189b93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:14.241513 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c15b26c-db0c-44ce-b766-963aa5189b93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:14.241795 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c15b26c-db0c-44ce-b766-963aa5189b93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:14.242072 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c15b26c-db0c-44ce-b766-963aa5189b93 admin admin] PATH_INFO: `/v3/users/2b361041bc354fd8bbc10b8eee32efaf` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:14.244996 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c15b26c-db0c-44ce-b766-963aa5189b93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b361041bc354fd8bbc10b8eee32efaf)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:14.249894 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c15b26c-db0c-44ce-b766-963aa5189b93 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:14.277130 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:28:14.278378 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1012/1988] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:28:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:28:14.289396 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc816805-0ce3-4fce-b89e-2612f74922e3 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:14.294274 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-fc816805-0ce3-4fce-b89e-2612f74922e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:28:14.327957 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-3c15b26c-db0c-44ce-b766-963aa5189b93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b361041bc354fd8bbc10b8eee32efaf'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:14.337350 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-3c15b26c-db0c-44ce-b766-963aa5189b93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b361041bc354fd8bbc10b8eee32efaf'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:14.337989 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-3c15b26c-db0c-44ce-b766-963aa5189b93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b361041bc354fd8bbc10b8eee32efaf'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:14.338583 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-3c15b26c-db0c-44ce-b766-963aa5189b93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b361041bc354fd8bbc10b8eee32efaf'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:14.347200 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-3c15b26c-db0c-44ce-b766-963aa5189b93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b361041bc354fd8bbc10b8eee32efaf'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:14.366138 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc816805-0ce3-4fce-b89e-2612f74922e3 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:14.371002 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5bfe2c-cd8d-4042-bae4-1b7e49502803 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c1289b015854c6bb6aee8fed6b807db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:14.371675 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5bfe2c-cd8d-4042-bae4-1b7e49502803 service neutron] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:14.371954 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5bfe2c-cd8d-4042-bae4-1b7e49502803 service neutron] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:14.372254 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5bfe2c-cd8d-4042-bae4-1b7e49502803 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:14.373680 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 977/1989] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 19 10:28:14 2022] DELETE /identity/v3/users/2b361041bc354fd8bbc10b8eee32efaf => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 10:28:14.374090 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-6d5bfe2c-cd8d-4042-bae4-1b7e49502803 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:28:14.378094 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06353b62-697e-4ea1-87f6-c229031c8216 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:14.378386 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06353b62-697e-4ea1-87f6-c229031c8216 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:14.378663 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06353b62-697e-4ea1-87f6-c229031c8216 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:14.387847 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5bfe2c-cd8d-4042-bae4-1b7e49502803 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:14.392721 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5bfe2c-cd8d-4042-bae4-1b7e49502803 service neutron] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:14.403567 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-06353b62-697e-4ea1-87f6-c229031c8216 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:28:14.405043 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1013/1990] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:28:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 10:28:14.408442 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-06353b62-697e-4ea1-87f6-c229031c8216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:28:14.491313 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 978/1991] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:28:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:28:14.502726 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5bfe2c-cd8d-4042-bae4-1b7e49502803 service neutron] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:14.504488 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-6d5bfe2c-cd8d-4042-bae4-1b7e49502803 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:28:14.516653 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5bfe2c-cd8d-4042-bae4-1b7e49502803 service neutron] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:14.527718 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:28:14.588089 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b016897-05eb-412c-afc6-061f72b14bb4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c1289b015854c6bb6aee8fed6b807db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:14.589382 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b016897-05eb-412c-afc6-061f72b14bb4 service neutron] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:14.589680 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b016897-05eb-412c-afc6-061f72b14bb4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:14.590013 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b016897-05eb-412c-afc6-061f72b14bb4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:14.602055 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b016897-05eb-412c-afc6-061f72b14bb4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:14.603708 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b016897-05eb-412c-afc6-061f72b14bb4 service neutron] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:14.615415 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1014/1992] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:28:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 10:28:14.859651 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06353b62-697e-4ea1-87f6-c229031c8216 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:14.861122 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-06353b62-697e-4ea1-87f6-c229031c8216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:28:14.879423 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06353b62-697e-4ea1-87f6-c229031c8216 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:14.888934 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e495dab8-0b4f-4c36-a946-90f44c5737b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:14.889995 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e495dab8-0b4f-4c36-a946-90f44c5737b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:14.890274 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e495dab8-0b4f-4c36-a946-90f44c5737b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:14.891515 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e495dab8-0b4f-4c36-a946-90f44c5737b9 admin admin] PATH_INFO: `/v3/projects/110e858c19b04f41a48550efc103e0a8` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:14.893208 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e495dab8-0b4f-4c36-a946-90f44c5737b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=110e858c19b04f41a48550efc103e0a8)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:14.895210 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e495dab8-0b4f-4c36-a946-90f44c5737b9 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:14.963169 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-e495dab8-0b4f-4c36-a946-90f44c5737b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '110e858c19b04f41a48550efc103e0a8', 'request_id': 'req-e495dab8-0b4f-4c36-a946-90f44c5737b9'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:14.970558 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-e495dab8-0b4f-4c36-a946-90f44c5737b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '110e858c19b04f41a48550efc103e0a8', 'request_id': 'req-e495dab8-0b4f-4c36-a946-90f44c5737b9'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:14.980654 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-e495dab8-0b4f-4c36-a946-90f44c5737b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '110e858c19b04f41a48550efc103e0a8', 'request_id': 'req-e495dab8-0b4f-4c36-a946-90f44c5737b9'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:15.001160 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-e495dab8-0b4f-4c36-a946-90f44c5737b9 admin admin] The token cache is being invalidate because project 110e858c19b04f41a48550efc103e0a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 10:28:15.001718 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-e495dab8-0b4f-4c36-a946-90f44c5737b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:15.002743 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-e495dab8-0b4f-4c36-a946-90f44c5737b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:15.006490 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 979/1993] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 19 10:28:14 2022] DELETE /identity/v3/projects/110e858c19b04f41a48550efc103e0a8 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:28:15.010093 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b016897-05eb-412c-afc6-061f72b14bb4 service neutron] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:15.030138 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b016897-05eb-412c-afc6-061f72b14bb4 service neutron] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:15.038118 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e495dab8-0b4f-4c36-a946-90f44c5737b9 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:15.039826 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-e495dab8-0b4f-4c36-a946-90f44c5737b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:28:15.069383 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:28:15.123680 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57dc358-82c3-4a03-996d-1f9f7dda4b6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:15.124468 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57dc358-82c3-4a03-996d-1f9f7dda4b6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:15.124843 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57dc358-82c3-4a03-996d-1f9f7dda4b6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:15.125237 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57dc358-82c3-4a03-996d-1f9f7dda4b6c admin admin] PATH_INFO: `/v3/users/db0511f828504cf18c5865a253e498b8` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:15.126408 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57dc358-82c3-4a03-996d-1f9f7dda4b6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=db0511f828504cf18c5865a253e498b8)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:15.128377 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57dc358-82c3-4a03-996d-1f9f7dda4b6c admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:15.134764 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e495dab8-0b4f-4c36-a946-90f44c5737b9 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:15.139927 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a53aea-e5b6-4b32-b8ee-5d056505a025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:15.140592 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a53aea-e5b6-4b32-b8ee-5d056505a025 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:15.140878 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a53aea-e5b6-4b32-b8ee-5d056505a025 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:15.141172 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a53aea-e5b6-4b32-b8ee-5d056505a025 admin admin] PATH_INFO: `/v3/projects/71958d60e6104b25b68140f4732f0fc3` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:15.142384 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a53aea-e5b6-4b32-b8ee-5d056505a025 admin admin] RBAC: Authorizing `identity:delete_project(project_id=71958d60e6104b25b68140f4732f0fc3)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:15.144349 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a53aea-e5b6-4b32-b8ee-5d056505a025 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:15.179886 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-c57dc358-82c3-4a03-996d-1f9f7dda4b6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db0511f828504cf18c5865a253e498b8'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:15.190493 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-c57dc358-82c3-4a03-996d-1f9f7dda4b6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db0511f828504cf18c5865a253e498b8'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:15.191185 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-c57dc358-82c3-4a03-996d-1f9f7dda4b6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db0511f828504cf18c5865a253e498b8'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:15.191848 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-c57dc358-82c3-4a03-996d-1f9f7dda4b6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db0511f828504cf18c5865a253e498b8'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:15.202488 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-c57dc358-82c3-4a03-996d-1f9f7dda4b6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db0511f828504cf18c5865a253e498b8'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:15.208176 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-85a53aea-e5b6-4b32-b8ee-5d056505a025 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71958d60e6104b25b68140f4732f0fc3', 'request_id': 'req-85a53aea-e5b6-4b32-b8ee-5d056505a025'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:15.222392 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-85a53aea-e5b6-4b32-b8ee-5d056505a025 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71958d60e6104b25b68140f4732f0fc3', 'request_id': 'req-85a53aea-e5b6-4b32-b8ee-5d056505a025'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:15.232685 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-85a53aea-e5b6-4b32-b8ee-5d056505a025 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71958d60e6104b25b68140f4732f0fc3', 'request_id': 'req-85a53aea-e5b6-4b32-b8ee-5d056505a025'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:15.235768 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1015/1994] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 19 10:28:15 2022] DELETE /identity/v3/users/db0511f828504cf18c5865a253e498b8 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:28:15.248075 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-85a53aea-e5b6-4b32-b8ee-5d056505a025 admin admin] The token cache is being invalidate because project 71958d60e6104b25b68140f4732f0fc3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 10:28:15.248489 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-85a53aea-e5b6-4b32-b8ee-5d056505a025 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:15.249376 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-85a53aea-e5b6-4b32-b8ee-5d056505a025 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:15.251130 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 980/1995] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 19 10:28:15 2022] DELETE /identity/v3/projects/71958d60e6104b25b68140f4732f0fc3 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 10:28:15.255053 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57dc358-82c3-4a03-996d-1f9f7dda4b6c admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:15.256568 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-c57dc358-82c3-4a03-996d-1f9f7dda4b6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:28:15.301677 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:28:15.330965 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57dc358-82c3-4a03-996d-1f9f7dda4b6c admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:15.335918 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7897a4d7-bc37-44c2-a2a7-e68e37b117eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:15.336588 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7897a4d7-bc37-44c2-a2a7-e68e37b117eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:15.336872 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7897a4d7-bc37-44c2-a2a7-e68e37b117eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:15.337151 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7897a4d7-bc37-44c2-a2a7-e68e37b117eb admin admin] PATH_INFO: `/v3/users/ac4cac2627764eff96a62eefdce72904` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:15.338305 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7897a4d7-bc37-44c2-a2a7-e68e37b117eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac4cac2627764eff96a62eefdce72904)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:15.340544 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7897a4d7-bc37-44c2-a2a7-e68e37b117eb admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:15.398558 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-7897a4d7-bc37-44c2-a2a7-e68e37b117eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac4cac2627764eff96a62eefdce72904'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:15.407041 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-7897a4d7-bc37-44c2-a2a7-e68e37b117eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac4cac2627764eff96a62eefdce72904'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:15.407705 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-7897a4d7-bc37-44c2-a2a7-e68e37b117eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac4cac2627764eff96a62eefdce72904'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:15.408403 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-7897a4d7-bc37-44c2-a2a7-e68e37b117eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac4cac2627764eff96a62eefdce72904'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:15.416153 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-7897a4d7-bc37-44c2-a2a7-e68e37b117eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac4cac2627764eff96a62eefdce72904'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:15.439079 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1016/1996] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 19 10:28:15 2022] DELETE /identity/v3/users/ac4cac2627764eff96a62eefdce72904 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:28:15.536987 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a53aea-e5b6-4b32-b8ee-5d056505a025 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:15.538888 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-85a53aea-e5b6-4b32-b8ee-5d056505a025 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:28:15.625846 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a53aea-e5b6-4b32-b8ee-5d056505a025 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:15.685286 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:28:15.699533 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75ac647-9f1c-481b-b177-75a8d41c7d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:15.700204 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75ac647-9f1c-481b-b177-75a8d41c7d03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:15.700489 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75ac647-9f1c-481b-b177-75a8d41c7d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:15.700891 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75ac647-9f1c-481b-b177-75a8d41c7d03 admin admin] PATH_INFO: `/v3/projects/0d3d99db253b4c6aa5b62e1b08c3e0e6` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:15.702099 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75ac647-9f1c-481b-b177-75a8d41c7d03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d3d99db253b4c6aa5b62e1b08c3e0e6)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:15.704046 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75ac647-9f1c-481b-b177-75a8d41c7d03 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:15.740976 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7897a4d7-bc37-44c2-a2a7-e68e37b117eb admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:15.742798 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-7897a4d7-bc37-44c2-a2a7-e68e37b117eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:28:15.764354 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7897a4d7-bc37-44c2-a2a7-e68e37b117eb admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:15.781594 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-f75ac647-9f1c-481b-b177-75a8d41c7d03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d3d99db253b4c6aa5b62e1b08c3e0e6', 'request_id': 'req-f75ac647-9f1c-481b-b177-75a8d41c7d03'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:15.789108 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-f75ac647-9f1c-481b-b177-75a8d41c7d03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d3d99db253b4c6aa5b62e1b08c3e0e6', 'request_id': 'req-f75ac647-9f1c-481b-b177-75a8d41c7d03'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:15.803420 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-f75ac647-9f1c-481b-b177-75a8d41c7d03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d3d99db253b4c6aa5b62e1b08c3e0e6', 'request_id': 'req-f75ac647-9f1c-481b-b177-75a8d41c7d03'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:15.816727 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-f75ac647-9f1c-481b-b177-75a8d41c7d03 admin admin] The token cache is being invalidate because project 0d3d99db253b4c6aa5b62e1b08c3e0e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 10:28:15.817030 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-f75ac647-9f1c-481b-b177-75a8d41c7d03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:15.817649 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-f75ac647-9f1c-481b-b177-75a8d41c7d03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:15.819158 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 981/1997] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 19 10:28:15 2022] DELETE /identity/v3/projects/0d3d99db253b4c6aa5b62e1b08c3e0e6 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:28:15.824633 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3591ad-31c8-4f9b-8f70-5148a6d1b19f None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:15.824954 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3591ad-31c8-4f9b-8f70-5148a6d1b19f None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:15.825225 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3591ad-31c8-4f9b-8f70-5148a6d1b19f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:15.850471 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-7e3591ad-31c8-4f9b-8f70-5148a6d1b19f None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:28:15.852484 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-7e3591ad-31c8-4f9b-8f70-5148a6d1b19f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:28:15.861186 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1eaaa4-efae-4e88-a615-55da07575f17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:15.862323 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1eaaa4-efae-4e88-a615-55da07575f17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:15.862788 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1eaaa4-efae-4e88-a615-55da07575f17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:15.863250 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1eaaa4-efae-4e88-a615-55da07575f17 admin admin] PATH_INFO: `/v3/projects/acdcde1d388b4c2fa748444a43d70cf0` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:15.865175 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1eaaa4-efae-4e88-a615-55da07575f17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=acdcde1d388b4c2fa748444a43d70cf0)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:15.872227 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 982/1998] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:28:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 10:28:15.872378 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1eaaa4-efae-4e88-a615-55da07575f17 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:15.877643 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3151326-5fe3-4e99-aa03-29737820f1c3 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:15.877935 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3151326-5fe3-4e99-aa03-29737820f1c3 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:15.878214 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3151326-5fe3-4e99-aa03-29737820f1c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:15.902946 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-e3151326-5fe3-4e99-aa03-29737820f1c3 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:28:15.905399 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-e3151326-5fe3-4e99-aa03-29737820f1c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:28:15.921999 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-ce1eaaa4-efae-4e88-a615-55da07575f17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'acdcde1d388b4c2fa748444a43d70cf0', 'request_id': 'req-ce1eaaa4-efae-4e88-a615-55da07575f17'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:15.929462 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-ce1eaaa4-efae-4e88-a615-55da07575f17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'acdcde1d388b4c2fa748444a43d70cf0', 'request_id': 'req-ce1eaaa4-efae-4e88-a615-55da07575f17'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:15.932808 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:28:15.941454 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-ce1eaaa4-efae-4e88-a615-55da07575f17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'acdcde1d388b4c2fa748444a43d70cf0', 'request_id': 'req-ce1eaaa4-efae-4e88-a615-55da07575f17'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:15.955252 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-ce1eaaa4-efae-4e88-a615-55da07575f17 admin admin] The token cache is being invalidate because project acdcde1d388b4c2fa748444a43d70cf0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 10:28:15.957102 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-ce1eaaa4-efae-4e88-a615-55da07575f17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:15.957102 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-ce1eaaa4-efae-4e88-a615-55da07575f17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:15.958381 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1017/1999] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 19 10:28:15 2022] DELETE /identity/v3/projects/acdcde1d388b4c2fa748444a43d70cf0 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:28:15.966377 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5772010-9f59-401c-8d7c-bc0f92e62cea None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:15.967579 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5772010-9f59-401c-8d7c-bc0f92e62cea None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:15.967579 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5772010-9f59-401c-8d7c-bc0f92e62cea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:15.988080 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-b5772010-9f59-401c-8d7c-bc0f92e62cea None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:28:15.988505 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 983/2000] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:28:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:28:15.989327 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-b5772010-9f59-401c-8d7c-bc0f92e62cea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:28:15.993126 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3151326-5fe3-4e99-aa03-29737820f1c3 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:16.003658 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3151326-5fe3-4e99-aa03-29737820f1c3 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:16.011429 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1018/2001] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:28:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:28:16.013813 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba092bb-9ed6-4d11-987d-5c70aa1813fc None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:16.014163 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba092bb-9ed6-4d11-987d-5c70aa1813fc None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:16.014510 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba092bb-9ed6-4d11-987d-5c70aa1813fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:16.017543 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efadbb9-6266-470a-b28a-6498d883d3e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:16.018217 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efadbb9-6266-470a-b28a-6498d883d3e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:16.018509 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efadbb9-6266-470a-b28a-6498d883d3e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:16.018792 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efadbb9-6266-470a-b28a-6498d883d3e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:16.019455 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efadbb9-6266-470a-b28a-6498d883d3e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:28:16.019760 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efadbb9-6266-470a-b28a-6498d883d3e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:16.021449 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efadbb9-6266-470a-b28a-6498d883d3e9 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:16.039188 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 984/2002] 10.222.0.66 () {58 vars in 1153 bytes} [Mon Sep 19 10:28:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 10:28:16.043890 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-7ba092bb-9ed6-4d11-987d-5c70aa1813fc None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:28:16.044395 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efadbb9-6266-470a-b28a-6498d883d3e9 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:16.044813 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-7ba092bb-9ed6-4d11-987d-5c70aa1813fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:28:16.055636 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efadbb9-6266-470a-b28a-6498d883d3e9 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:16.055953 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1019/2003] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:28:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 10:28:16.063988 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b83e40-8180-459a-a7bd-5756f238238e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:16.064634 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba092bb-9ed6-4d11-987d-5c70aa1813fc None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:16.065100 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b83e40-8180-459a-a7bd-5756f238238e admin admin] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:16.065583 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b83e40-8180-459a-a7bd-5756f238238e admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:16.066039 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b83e40-8180-459a-a7bd-5756f238238e admin admin] PATH_INFO: `/v3/projects` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:16.066949 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b83e40-8180-459a-a7bd-5756f238238e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:16.069120 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b83e40-8180-459a-a7bd-5756f238238e admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:16.075488 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba092bb-9ed6-4d11-987d-5c70aa1813fc None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:16.092463 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d06b3ac-4971-4ef8-8a8b-3d49d4c8c02d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:16.092463 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d06b3ac-4971-4ef8-8a8b-3d49d4c8c02d admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:16.092463 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d06b3ac-4971-4ef8-8a8b-3d49d4c8c02d admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:16.092463 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d06b3ac-4971-4ef8-8a8b-3d49d4c8c02d admin admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:16.092812 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d06b3ac-4971-4ef8-8a8b-3d49d4c8c02d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:28:16.092812 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d06b3ac-4971-4ef8-8a8b-3d49d4c8c02d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:16.098000 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d06b3ac-4971-4ef8-8a8b-3d49d4c8c02d admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:16.110261 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1020/2004] 10.222.0.66 () {58 vars in 1153 bytes} [Mon Sep 19 10:28:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:28:16.118109 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d06b3ac-4971-4ef8-8a8b-3d49d4c8c02d admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:16.133471 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 985/2005] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 19 10:28:16 2022] POST /identity/v3/projects => generated 363 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:28:16.140887 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b83e40-8180-459a-a7bd-5756f238238e admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:16.156137 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d06b3ac-4971-4ef8-8a8b-3d49d4c8c02d admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:16.252937 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:28:16.274560 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12240941-93af-4a0f-89bc-d17df20403ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:16.275186 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12240941-93af-4a0f-89bc-d17df20403ec admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:16.275465 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12240941-93af-4a0f-89bc-d17df20403ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:16.275735 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12240941-93af-4a0f-89bc-d17df20403ec admin admin] PATH_INFO: `/v3/projects` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:16.277033 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12240941-93af-4a0f-89bc-d17df20403ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:16.283586 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b83e40-8180-459a-a7bd-5756f238238e admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:16.291631 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d82f4e-7cb2-4fa9-bc93-80369b77d48c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:16.292481 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d82f4e-7cb2-4fa9-bc93-80369b77d48c admin admin] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:16.292840 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d82f4e-7cb2-4fa9-bc93-80369b77d48c admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:16.293030 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12240941-93af-4a0f-89bc-d17df20403ec admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:16.293249 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d82f4e-7cb2-4fa9-bc93-80369b77d48c admin admin] PATH_INFO: `/v3/users` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:16.293987 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d82f4e-7cb2-4fa9-bc93-80369b77d48c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:16.296315 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d82f4e-7cb2-4fa9-bc93-80369b77d48c admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:16.342414 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 986/2006] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 19 10:28:16 2022] POST /identity/v3/users => generated 282 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:28:16.344240 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d82f4e-7cb2-4fa9-bc93-80369b77d48c admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:16.350848 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1021/2007] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 19 10:28:16 2022] POST /identity/v3/projects => generated 383 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:28:16.355665 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d82f4e-7cb2-4fa9-bc93-80369b77d48c admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:16.357190 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12240941-93af-4a0f-89bc-d17df20403ec admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:16.430799 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12240941-93af-4a0f-89bc-d17df20403ec admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:16.433426 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0983d4d-d1cb-49c9-bb36-9a65a396a7f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:16.434041 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0983d4d-d1cb-49c9-bb36-9a65a396a7f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:16.434321 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0983d4d-d1cb-49c9-bb36-9a65a396a7f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:16.434596 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0983d4d-d1cb-49c9-bb36-9a65a396a7f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:16.435236 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0983d4d-d1cb-49c9-bb36-9a65a396a7f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:16.436211 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982ed158-8ec8-40ae-885a-74ce904759d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:16.436821 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982ed158-8ec8-40ae-885a-74ce904759d4 admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:16.436928 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0983d4d-d1cb-49c9-bb36-9a65a396a7f1 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:16.437095 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982ed158-8ec8-40ae-885a-74ce904759d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:16.437366 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982ed158-8ec8-40ae-885a-74ce904759d4 admin admin] PATH_INFO: `/v3/users` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:16.438065 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982ed158-8ec8-40ae-885a-74ce904759d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:16.439861 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982ed158-8ec8-40ae-885a-74ce904759d4 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:16.447160 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 987/2008] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:28:16 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 10:28:16.451584 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0983d4d-d1cb-49c9-bb36-9a65a396a7f1 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:16.462923 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0983d4d-d1cb-49c9-bb36-9a65a396a7f1 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:16.466549 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1022/2009] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 19 10:28:16 2022] POST /identity/v3/users => generated 292 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:28:16.467553 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982ed158-8ec8-40ae-885a-74ce904759d4 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:16.468121 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43742035-d2c6-4892-80bd-061ef301733d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:16.468748 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43742035-d2c6-4892-80bd-061ef301733d admin admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:16.469029 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43742035-d2c6-4892-80bd-061ef301733d admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:16.469305 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43742035-d2c6-4892-80bd-061ef301733d admin admin] PATH_INFO: `/v3/roles` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:16.469938 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43742035-d2c6-4892-80bd-061ef301733d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:16.471529 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43742035-d2c6-4892-80bd-061ef301733d admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:16.477761 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982ed158-8ec8-40ae-885a-74ce904759d4 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:16.482446 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 988/2010] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:28:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 10:28:16.484450 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a99571-d82b-48b1-b534-7e2496acf31b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:16.485103 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a99571-d82b-48b1-b534-7e2496acf31b admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:16.485388 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a99571-d82b-48b1-b534-7e2496acf31b admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:16.485668 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a99571-d82b-48b1-b534-7e2496acf31b admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:16.486363 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a99571-d82b-48b1-b534-7e2496acf31b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:16.486607 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43742035-d2c6-4892-80bd-061ef301733d admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:16.488142 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a99571-d82b-48b1-b534-7e2496acf31b admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:16.497812 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43742035-d2c6-4892-80bd-061ef301733d admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:16.500205 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1023/2011] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:28:16 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 10:28:16.504144 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e0412d-d5d5-42b3-8ece-1c079a90fd8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:16.504370 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a99571-d82b-48b1-b534-7e2496acf31b admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:16.504871 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e0412d-d5d5-42b3-8ece-1c079a90fd8f admin admin] REQUEST_METHOD: `PUT` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:16.505396 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e0412d-d5d5-42b3-8ece-1c079a90fd8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:16.505883 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e0412d-d5d5-42b3-8ece-1c079a90fd8f admin admin] PATH_INFO: `/v3/projects/2d0f3b5224b94249b7693fce1b37ff07/users/89344f2c3ec04ebabc4ebcf11e59b716/roles/cd5b42ed3b754b58817a62bbe74651b4` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:16.515714 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a99571-d82b-48b1-b534-7e2496acf31b admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:16.521209 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bbcfb1-2f99-45ea-908b-477e9189b9db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:16.522090 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bbcfb1-2f99-45ea-908b-477e9189b9db admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:16.522304 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bbcfb1-2f99-45ea-908b-477e9189b9db admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:16.522575 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bbcfb1-2f99-45ea-908b-477e9189b9db admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:16.523305 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bbcfb1-2f99-45ea-908b-477e9189b9db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:16.524952 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bbcfb1-2f99-45ea-908b-477e9189b9db admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:16.527919 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e0412d-d5d5-42b3-8ece-1c079a90fd8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d0f3b5224b94249b7693fce1b37ff07, user_id=89344f2c3ec04ebabc4ebcf11e59b716, role_id=cd5b42ed3b754b58817a62bbe74651b4)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:16.531028 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e0412d-d5d5-42b3-8ece-1c079a90fd8f admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:16.538850 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1024/2012] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:28:16 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 10:28:16.543176 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bbcfb1-2f99-45ea-908b-477e9189b9db admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:16.546064 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 989/2013] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 19 10:28:16 2022] PUT /identity/v3/projects/2d0f3b5224b94249b7693fce1b37ff07/users/89344f2c3ec04ebabc4ebcf11e59b716/roles/cd5b42ed3b754b58817a62bbe74651b4 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 10:28:16.553952 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bbcfb1-2f99-45ea-908b-477e9189b9db admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:16.556447 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8a7ef4-1412-437a-9235-6d4009fd9eb1 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:16.556740 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8a7ef4-1412-437a-9235-6d4009fd9eb1 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:16.557020 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8a7ef4-1412-437a-9235-6d4009fd9eb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:16.562963 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:28:16.587707 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-4f8a7ef4-1412-437a-9235-6d4009fd9eb1 None None] MFA Rules not processed for user `89344f2c3ec04ebabc4ebcf11e59b716`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:28:16.589097 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-4f8a7ef4-1412-437a-9235-6d4009fd9eb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:28:16.630455 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4696ba89-af9b-441f-a7a5-9c0624a40769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:16.631271 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4696ba89-af9b-441f-a7a5-9c0624a40769 admin admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:16.631933 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4696ba89-af9b-441f-a7a5-9c0624a40769 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:16.632353 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4696ba89-af9b-441f-a7a5-9c0624a40769 admin admin] PATH_INFO: `/v3/projects/d7d5a2eb8317458b87c50c3a18c9b763/users/944d9a9092d644b2a9226b12ea77793a/roles/cd5b42ed3b754b58817a62bbe74651b4` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:16.649298 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4696ba89-af9b-441f-a7a5-9c0624a40769 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7d5a2eb8317458b87c50c3a18c9b763, user_id=944d9a9092d644b2a9226b12ea77793a, role_id=cd5b42ed3b754b58817a62bbe74651b4)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:16.652851 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4696ba89-af9b-441f-a7a5-9c0624a40769 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:16.669008 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1025/2014] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 19 10:28:16 2022] PUT /identity/v3/projects/d7d5a2eb8317458b87c50c3a18c9b763/users/944d9a9092d644b2a9226b12ea77793a/roles/cd5b42ed3b754b58817a62bbe74651b4 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:28:16.683719 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 990/2015] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:28:16 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 10:28:16.690034 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4696ba89-af9b-441f-a7a5-9c0624a40769 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:16.690923 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076cfc4b-2a9e-48f3-9935-a1933c1613f7 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:16.691411 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076cfc4b-2a9e-48f3-9935-a1933c1613f7 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:16.692686 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076cfc4b-2a9e-48f3-9935-a1933c1613f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:16.731423 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-076cfc4b-2a9e-48f3-9935-a1933c1613f7 None None] MFA Rules not processed for user `944d9a9092d644b2a9226b12ea77793a`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:28:16.733242 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-076cfc4b-2a9e-48f3-9935-a1933c1613f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:28:16.745772 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:28:16.764917 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4696ba89-af9b-441f-a7a5-9c0624a40769 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:16.770005 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3320ba-51f2-4ff6-a297-cdecd822bd3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:16.770702 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3320ba-51f2-4ff6-a297-cdecd822bd3b admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:16.770983 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3320ba-51f2-4ff6-a297-cdecd822bd3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:16.771258 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3320ba-51f2-4ff6-a297-cdecd822bd3b admin admin] PATH_INFO: `/v3/projects` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:16.771954 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3320ba-51f2-4ff6-a297-cdecd822bd3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:16.774043 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3320ba-51f2-4ff6-a297-cdecd822bd3b admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:16.804201 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1026/2016] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 19 10:28:16 2022] POST /identity/v3/projects => generated 363 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:28:16.806584 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3320ba-51f2-4ff6-a297-cdecd822bd3b admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:16.812105 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 991/2017] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:28:16 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:28:16.825575 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076cfc4b-2a9e-48f3-9935-a1933c1613f7 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:16.827533 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-076cfc4b-2a9e-48f3-9935-a1933c1613f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:28:16.892187 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3320ba-51f2-4ff6-a297-cdecd822bd3b admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:16.899419 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be376af0-249c-4bb7-8be8-4404927ce486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:16.900306 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be376af0-249c-4bb7-8be8-4404927ce486 admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:16.900769 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be376af0-249c-4bb7-8be8-4404927ce486 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:16.901313 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be376af0-249c-4bb7-8be8-4404927ce486 admin admin] PATH_INFO: `/v3/users` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:16.901950 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be376af0-249c-4bb7-8be8-4404927ce486 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:16.903939 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be376af0-249c-4bb7-8be8-4404927ce486 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:16.914573 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076cfc4b-2a9e-48f3-9935-a1933c1613f7 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:16.935454 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1027/2018] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 19 10:28:16 2022] POST /identity/v3/users => generated 288 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 10:28:16.937874 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be376af0-249c-4bb7-8be8-4404927ce486 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:16.952311 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be376af0-249c-4bb7-8be8-4404927ce486 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:16.958848 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12d9465-e3d0-4200-b170-78abafd86b55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:16.961480 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12d9465-e3d0-4200-b170-78abafd86b55 admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:16.961836 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12d9465-e3d0-4200-b170-78abafd86b55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:16.962154 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12d9465-e3d0-4200-b170-78abafd86b55 admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:16.962879 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12d9465-e3d0-4200-b170-78abafd86b55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:16.965253 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12d9465-e3d0-4200-b170-78abafd86b55 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:16.972405 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:28:16.984693 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1028/2019] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:28:16 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 10:28:16.988977 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12d9465-e3d0-4200-b170-78abafd86b55 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:16.999522 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12d9465-e3d0-4200-b170-78abafd86b55 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:17.000208 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c73070-66ed-40a8-84f5-e9ccb45bdde3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa4d004fd44482cae761c4b3bdfab31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:17.000802 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c73070-66ed-40a8-84f5-e9ccb45bdde3 service cinder] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:17.001080 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c73070-66ed-40a8-84f5-e9ccb45bdde3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:17.001350 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c73070-66ed-40a8-84f5-e9ccb45bdde3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:17.004916 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3619860a-e79c-491d-bc8c-af89758c30ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:17.005787 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3619860a-e79c-491d-bc8c-af89758c30ec admin admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:17.006067 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3619860a-e79c-491d-bc8c-af89758c30ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:17.006712 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3619860a-e79c-491d-bc8c-af89758c30ec admin admin] PATH_INFO: `/v3/projects/d898a902991b40ddad96b5d7eef17866/users/f55cbacc7bba4eb0bdf449ffe825f80f/roles/5c8b89fae4fa45bd944cbeaf442136e1` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:17.025928 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3619860a-e79c-491d-bc8c-af89758c30ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=d898a902991b40ddad96b5d7eef17866, user_id=f55cbacc7bba4eb0bdf449ffe825f80f, role_id=5c8b89fae4fa45bd944cbeaf442136e1)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:17.029276 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3619860a-e79c-491d-bc8c-af89758c30ec admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:17.046059 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1029/2020] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 19 10:28:16 2022] PUT /identity/v3/projects/d898a902991b40ddad96b5d7eef17866/users/f55cbacc7bba4eb0bdf449ffe825f80f/roles/5c8b89fae4fa45bd944cbeaf442136e1 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 10:28:17.050694 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3619860a-e79c-491d-bc8c-af89758c30ec admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:17.074587 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c73070-66ed-40a8-84f5-e9ccb45bdde3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:17.076103 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c73070-66ed-40a8-84f5-e9ccb45bdde3 service cinder] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:17.088528 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 992/2021] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:28:16 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:28:17.113758 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c73070-66ed-40a8-84f5-e9ccb45bdde3 service cinder] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:17.124832 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3619860a-e79c-491d-bc8c-af89758c30ec admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:17.126847 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c73070-66ed-40a8-84f5-e9ccb45bdde3 service cinder] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:17.131437 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42112a0-6e7f-466a-9b31-90b855b35bc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:17.133039 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42112a0-6e7f-466a-9b31-90b855b35bc4 admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:17.133477 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42112a0-6e7f-466a-9b31-90b855b35bc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:17.133921 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42112a0-6e7f-466a-9b31-90b855b35bc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:17.135959 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42112a0-6e7f-466a-9b31-90b855b35bc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:17.137670 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42112a0-6e7f-466a-9b31-90b855b35bc4 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:17.138955 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983085b5-f7b9-4c33-b1dd-7133a1019e98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:17.139704 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983085b5-f7b9-4c33-b1dd-7133a1019e98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:17.140092 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983085b5-f7b9-4c33-b1dd-7133a1019e98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:17.140499 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983085b5-f7b9-4c33-b1dd-7133a1019e98 admin admin] PATH_INFO: `/v3/users/944d9a9092d644b2a9226b12ea77793a` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:17.142303 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983085b5-f7b9-4c33-b1dd-7133a1019e98 admin admin] RBAC: Authorizing `identity:delete_user(user_id=944d9a9092d644b2a9226b12ea77793a)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:17.144434 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983085b5-f7b9-4c33-b1dd-7133a1019e98 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:17.153335 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1030/2022] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:28:17 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 10:28:17.154468 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42112a0-6e7f-466a-9b31-90b855b35bc4 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:17.164654 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42112a0-6e7f-466a-9b31-90b855b35bc4 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:17.170319 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2174e52f-1426-4178-8893-0c119e11d36f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:17.170885 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:28:17.171239 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2174e52f-1426-4178-8893-0c119e11d36f admin admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:17.171526 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2174e52f-1426-4178-8893-0c119e11d36f admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:17.171992 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2174e52f-1426-4178-8893-0c119e11d36f admin admin] PATH_INFO: `/v3/projects/d898a902991b40ddad96b5d7eef17866/users/f55cbacc7bba4eb0bdf449ffe825f80f/roles/5c8b89fae4fa45bd944cbeaf442136e1` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:17.173985 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2174e52f-1426-4178-8893-0c119e11d36f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d898a902991b40ddad96b5d7eef17866, user_id=f55cbacc7bba4eb0bdf449ffe825f80f, role_id=5c8b89fae4fa45bd944cbeaf442136e1)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:17.176751 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2174e52f-1426-4178-8893-0c119e11d36f admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:17.188719 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1031/2023] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 19 10:28:17 2022] PUT /identity/v3/projects/d898a902991b40ddad96b5d7eef17866/users/f55cbacc7bba4eb0bdf449ffe825f80f/roles/5c8b89fae4fa45bd944cbeaf442136e1 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:28:17.200098 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d98933f-8cb2-4c40-aca6-ee56a4987625 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:17.200417 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d98933f-8cb2-4c40-aca6-ee56a4987625 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:17.201277 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d98933f-8cb2-4c40-aca6-ee56a4987625 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:17.216868 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-983085b5-f7b9-4c33-b1dd-7133a1019e98 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '944d9a9092d644b2a9226b12ea77793a'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:17.227180 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-983085b5-f7b9-4c33-b1dd-7133a1019e98 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '944d9a9092d644b2a9226b12ea77793a'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:17.228175 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-983085b5-f7b9-4c33-b1dd-7133a1019e98 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '944d9a9092d644b2a9226b12ea77793a'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:17.229226 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-983085b5-f7b9-4c33-b1dd-7133a1019e98 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '944d9a9092d644b2a9226b12ea77793a'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:17.232474 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-0d98933f-8cb2-4c40-aca6-ee56a4987625 None None] MFA Rules not processed for user `f55cbacc7bba4eb0bdf449ffe825f80f`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:28:17.233274 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-0d98933f-8cb2-4c40-aca6-ee56a4987625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:28:17.237744 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-983085b5-f7b9-4c33-b1dd-7133a1019e98 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '944d9a9092d644b2a9226b12ea77793a'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:17.264622 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 993/2024] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 19 10:28:17 2022] DELETE /identity/v3/users/944d9a9092d644b2a9226b12ea77793a => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:28:17.269040 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121b47cc-1bf2-42df-9218-d0140fb50b5e None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:17.269685 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121b47cc-1bf2-42df-9218-d0140fb50b5e None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:17.270231 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121b47cc-1bf2-42df-9218-d0140fb50b5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:17.321207 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-121b47cc-1bf2-42df-9218-d0140fb50b5e None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:28:17.328251 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-121b47cc-1bf2-42df-9218-d0140fb50b5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:28:17.332472 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1032/2025] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:28:17 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:28:17.344479 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d98933f-8cb2-4c40-aca6-ee56a4987625 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:17.346385 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-0d98933f-8cb2-4c40-aca6-ee56a4987625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:28:17.435207 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:28:17.449370 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d98933f-8cb2-4c40-aca6-ee56a4987625 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:17.492769 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 994/2026] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:28:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:28:17.503711 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121b47cc-1bf2-42df-9218-d0140fb50b5e None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:17.505408 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-121b47cc-1bf2-42df-9218-d0140fb50b5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:28:17.509331 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237b5f64-a197-4c92-ae74-4ddd429a2644 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa4d004fd44482cae761c4b3bdfab31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:17.510081 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237b5f64-a197-4c92-ae74-4ddd429a2644 service cinder] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:17.510367 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237b5f64-a197-4c92-ae74-4ddd429a2644 service cinder] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:17.511174 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237b5f64-a197-4c92-ae74-4ddd429a2644 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:17.575121 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121b47cc-1bf2-42df-9218-d0140fb50b5e None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:17.578759 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80a3f1a-ffbe-41d5-8354-25f4b1c5c40f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c1289b015854c6bb6aee8fed6b807db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:17.579364 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80a3f1a-ffbe-41d5-8354-25f4b1c5c40f service neutron] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:17.579673 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80a3f1a-ffbe-41d5-8354-25f4b1c5c40f service neutron] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:17.579905 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80a3f1a-ffbe-41d5-8354-25f4b1c5c40f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:17.592599 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80a3f1a-ffbe-41d5-8354-25f4b1c5c40f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:17.594034 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80a3f1a-ffbe-41d5-8354-25f4b1c5c40f service neutron] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:17.604609 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237b5f64-a197-4c92-ae74-4ddd429a2644 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:17.606439 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237b5f64-a197-4c92-ae74-4ddd429a2644 service cinder] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:17.609991 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 995/2027] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:28:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 10:28:17.618712 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1033/2028] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:28:17 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:28:17.710018 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80a3f1a-ffbe-41d5-8354-25f4b1c5c40f service neutron] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:17.722327 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80a3f1a-ffbe-41d5-8354-25f4b1c5c40f service neutron] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:17.728012 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb1d05f-5f9b-41e8-8df1-621e255d6628 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa4d004fd44482cae761c4b3bdfab31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:17.728012 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb1d05f-5f9b-41e8-8df1-621e255d6628 service cinder] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:17.728391 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb1d05f-5f9b-41e8-8df1-621e255d6628 service cinder] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:17.728667 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb1d05f-5f9b-41e8-8df1-621e255d6628 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:17.731030 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-1bb1d05f-5f9b-41e8-8df1-621e255d6628 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:28:17.781013 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:28:17.811865 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb1d05f-5f9b-41e8-8df1-621e255d6628 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:17.813577 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb1d05f-5f9b-41e8-8df1-621e255d6628 service cinder] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:17.836487 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 996/2029] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:28:17 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:28:18.003478 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237b5f64-a197-4c92-ae74-4ddd429a2644 service cinder] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:18.004956 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-237b5f64-a197-4c92-ae74-4ddd429a2644 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:28:18.046518 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237b5f64-a197-4c92-ae74-4ddd429a2644 service cinder] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:18.052265 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf257b1-d7bb-4570-baac-bae7ae51b691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:18.052986 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf257b1-d7bb-4570-baac-bae7ae51b691 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:18.053339 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf257b1-d7bb-4570-baac-bae7ae51b691 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:18.053802 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf257b1-d7bb-4570-baac-bae7ae51b691 admin admin] PATH_INFO: `/v3/projects/d7d5a2eb8317458b87c50c3a18c9b763` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:18.054913 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf257b1-d7bb-4570-baac-bae7ae51b691 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7d5a2eb8317458b87c50c3a18c9b763)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:18.056962 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf257b1-d7bb-4570-baac-bae7ae51b691 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:18.108215 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-ddf257b1-d7bb-4570-baac-bae7ae51b691 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7d5a2eb8317458b87c50c3a18c9b763', 'request_id': 'req-ddf257b1-d7bb-4570-baac-bae7ae51b691'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:18.115483 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-ddf257b1-d7bb-4570-baac-bae7ae51b691 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7d5a2eb8317458b87c50c3a18c9b763', 'request_id': 'req-ddf257b1-d7bb-4570-baac-bae7ae51b691'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:18.124811 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-ddf257b1-d7bb-4570-baac-bae7ae51b691 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7d5a2eb8317458b87c50c3a18c9b763', 'request_id': 'req-ddf257b1-d7bb-4570-baac-bae7ae51b691'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:18.138196 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-ddf257b1-d7bb-4570-baac-bae7ae51b691 admin admin] The token cache is being invalidate because project d7d5a2eb8317458b87c50c3a18c9b763 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 10:28:18.138490 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-ddf257b1-d7bb-4570-baac-bae7ae51b691 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:18.139167 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-ddf257b1-d7bb-4570-baac-bae7ae51b691 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:18.140722 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1034/2030] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 19 10:28:18 2022] DELETE /identity/v3/projects/d7d5a2eb8317458b87c50c3a18c9b763 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:28:18.145795 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cb4f09-3aaf-4f1d-982f-1e69ba12a837 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:18.146369 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cb4f09-3aaf-4f1d-982f-1e69ba12a837 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:18.146369 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cb4f09-3aaf-4f1d-982f-1e69ba12a837 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:18.168416 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-90cb4f09-3aaf-4f1d-982f-1e69ba12a837 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:28:18.169666 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-90cb4f09-3aaf-4f1d-982f-1e69ba12a837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:28:18.235531 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 997/2031] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:28:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:28:18.243188 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37ce7b2-8c47-4261-9eea-567c9d61f2a8 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:18.243478 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37ce7b2-8c47-4261-9eea-567c9d61f2a8 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:18.243757 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37ce7b2-8c47-4261-9eea-567c9d61f2a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:18.264449 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-e37ce7b2-8c47-4261-9eea-567c9d61f2a8 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:28:18.265698 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-e37ce7b2-8c47-4261-9eea-567c9d61f2a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:28:18.273732 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1035/2032] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:28:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:28:18.278247 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cb4f09-3aaf-4f1d-982f-1e69ba12a837 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:18.288381 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cb4f09-3aaf-4f1d-982f-1e69ba12a837 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:18.293574 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a595c481-7c3b-4501-b8b2-ee6237624254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:18.294191 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a595c481-7c3b-4501-b8b2-ee6237624254 admin admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:18.294471 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a595c481-7c3b-4501-b8b2-ee6237624254 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:18.294748 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a595c481-7c3b-4501-b8b2-ee6237624254 admin admin] PATH_INFO: `/v3/domains` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:18.295786 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a595c481-7c3b-4501-b8b2-ee6237624254 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:28:18.296091 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a595c481-7c3b-4501-b8b2-ee6237624254 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:18.297733 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a595c481-7c3b-4501-b8b2-ee6237624254 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:18.313488 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 998/2033] 10.222.0.66 () {58 vars in 1153 bytes} [Mon Sep 19 10:28:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 10:28:18.318088 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37ce7b2-8c47-4261-9eea-567c9d61f2a8 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:18.329165 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37ce7b2-8c47-4261-9eea-567c9d61f2a8 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:18.335575 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c880080-ec3d-4117-b25a-fce3ae0c5d40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:18.336231 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c880080-ec3d-4117-b25a-fce3ae0c5d40 admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:18.336561 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c880080-ec3d-4117-b25a-fce3ae0c5d40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:18.336860 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c880080-ec3d-4117-b25a-fce3ae0c5d40 admin admin] PATH_INFO: `/v3/projects` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:18.337416 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c880080-ec3d-4117-b25a-fce3ae0c5d40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:18.339503 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c880080-ec3d-4117-b25a-fce3ae0c5d40 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:18.380375 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1036/2034] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 19 10:28:18 2022] POST /identity/v3/projects => generated 373 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:28:18.384486 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a595c481-7c3b-4501-b8b2-ee6237624254 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:18.397574 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a595c481-7c3b-4501-b8b2-ee6237624254 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:18.468373 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5c6037-1d6c-4f3a-ab81-43fba022e949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:18.469050 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5c6037-1d6c-4f3a-ab81-43fba022e949 admin admin] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:18.469333 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5c6037-1d6c-4f3a-ab81-43fba022e949 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:18.469758 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5c6037-1d6c-4f3a-ab81-43fba022e949 admin admin] PATH_INFO: `/v3/users` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:18.470407 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5c6037-1d6c-4f3a-ab81-43fba022e949 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:18.472377 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5c6037-1d6c-4f3a-ab81-43fba022e949 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:18.499525 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 999/2035] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 19 10:28:18 2022] POST /identity/v3/users => generated 287 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:28:18.503634 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c880080-ec3d-4117-b25a-fce3ae0c5d40 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:18.509449 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:28:18.522407 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c880080-ec3d-4117-b25a-fce3ae0c5d40 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:18.530383 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c176625b-c0f1-47c6-b4a2-188493a2bb38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:18.531368 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c176625b-c0f1-47c6-b4a2-188493a2bb38 admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:18.531723 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c176625b-c0f1-47c6-b4a2-188493a2bb38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:18.532424 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c176625b-c0f1-47c6-b4a2-188493a2bb38 admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:18.533073 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c176625b-c0f1-47c6-b4a2-188493a2bb38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:18.535765 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c176625b-c0f1-47c6-b4a2-188493a2bb38 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:18.551920 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1037/2036] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:28:18 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 10:28:18.553123 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5c6037-1d6c-4f3a-ab81-43fba022e949 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:18.568109 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5c6037-1d6c-4f3a-ab81-43fba022e949 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:18.573545 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761649c0-b187-4adc-b465-04fb0606f610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:18.574164 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761649c0-b187-4adc-b465-04fb0606f610 admin admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:18.574447 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761649c0-b187-4adc-b465-04fb0606f610 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:18.574722 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761649c0-b187-4adc-b465-04fb0606f610 admin admin] PATH_INFO: `/v3/roles` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:18.575364 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761649c0-b187-4adc-b465-04fb0606f610 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:18.577008 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761649c0-b187-4adc-b465-04fb0606f610 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:18.592974 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1000/2037] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:28:18 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 10:28:18.595591 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c176625b-c0f1-47c6-b4a2-188493a2bb38 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:18.607608 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c176625b-c0f1-47c6-b4a2-188493a2bb38 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:18.612622 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbe69aa-55a5-4ab0-bc6a-90990f027e8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:18.613419 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbe69aa-55a5-4ab0-bc6a-90990f027e8e admin admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:18.613707 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbe69aa-55a5-4ab0-bc6a-90990f027e8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:18.613981 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbe69aa-55a5-4ab0-bc6a-90990f027e8e admin admin] PATH_INFO: `/v3/projects/dce568f12adf4245900fa13e0e771e35/users/3c6ec6f0dfa24185afdf6b8ce4b14708/roles/cd5b42ed3b754b58817a62bbe74651b4` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:18.634497 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbe69aa-55a5-4ab0-bc6a-90990f027e8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=dce568f12adf4245900fa13e0e771e35, user_id=3c6ec6f0dfa24185afdf6b8ce4b14708, role_id=cd5b42ed3b754b58817a62bbe74651b4)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:18.637257 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbe69aa-55a5-4ab0-bc6a-90990f027e8e admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:18.652082 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1038/2038] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 19 10:28:18 2022] PUT /identity/v3/projects/dce568f12adf4245900fa13e0e771e35/users/3c6ec6f0dfa24185afdf6b8ce4b14708/roles/cd5b42ed3b754b58817a62bbe74651b4 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:28:18.664104 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcec94d8-9d9b-4e46-ba08-de46c65326cb None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:18.664381 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcec94d8-9d9b-4e46-ba08-de46c65326cb None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:18.664855 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcec94d8-9d9b-4e46-ba08-de46c65326cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:18.701535 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-bcec94d8-9d9b-4e46-ba08-de46c65326cb None None] MFA Rules not processed for user `3c6ec6f0dfa24185afdf6b8ce4b14708`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:28:18.702873 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-bcec94d8-9d9b-4e46-ba08-de46c65326cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:28:18.742361 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:28:18.779393 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1001/2039] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:28:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:28:18.792437 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbe69aa-55a5-4ab0-bc6a-90990f027e8e admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:18.794212 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-3fbe69aa-55a5-4ab0-bc6a-90990f027e8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:28:18.855020 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbe69aa-55a5-4ab0-bc6a-90990f027e8e admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:18.858914 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6f05e9-2b2c-4dd3-bcf7-87324468e161 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa4d004fd44482cae761c4b3bdfab31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:18.859470 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6f05e9-2b2c-4dd3-bcf7-87324468e161 service cinder] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:18.859788 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6f05e9-2b2c-4dd3-bcf7-87324468e161 service cinder] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:18.860013 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6f05e9-2b2c-4dd3-bcf7-87324468e161 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:18.868703 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6f05e9-2b2c-4dd3-bcf7-87324468e161 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:18.870175 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6f05e9-2b2c-4dd3-bcf7-87324468e161 service cinder] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:18.879334 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1039/2040] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:28:18 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:28:23.200688 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcec94d8-9d9b-4e46-ba08-de46c65326cb None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:23.264773 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcec94d8-9d9b-4e46-ba08-de46c65326cb None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:23.269391 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7b26b7-2d77-445d-b6fb-024e1de68cfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:23.270091 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7b26b7-2d77-445d-b6fb-024e1de68cfb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:23.270373 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7b26b7-2d77-445d-b6fb-024e1de68cfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:23.270647 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7b26b7-2d77-445d-b6fb-024e1de68cfb admin admin] PATH_INFO: `/v3/users/3c6ec6f0dfa24185afdf6b8ce4b14708` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:23.271840 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7b26b7-2d77-445d-b6fb-024e1de68cfb admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c6ec6f0dfa24185afdf6b8ce4b14708)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:23.273806 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7b26b7-2d77-445d-b6fb-024e1de68cfb admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:23.332588 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-6f7b26b7-2d77-445d-b6fb-024e1de68cfb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c6ec6f0dfa24185afdf6b8ce4b14708'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:23.341351 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-6f7b26b7-2d77-445d-b6fb-024e1de68cfb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c6ec6f0dfa24185afdf6b8ce4b14708'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:23.341995 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-6f7b26b7-2d77-445d-b6fb-024e1de68cfb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c6ec6f0dfa24185afdf6b8ce4b14708'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:23.342803 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-6f7b26b7-2d77-445d-b6fb-024e1de68cfb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c6ec6f0dfa24185afdf6b8ce4b14708'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:23.350865 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-6f7b26b7-2d77-445d-b6fb-024e1de68cfb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c6ec6f0dfa24185afdf6b8ce4b14708'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:23.371436 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1002/2041] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 19 10:28:23 2022] DELETE /identity/v3/users/3c6ec6f0dfa24185afdf6b8ce4b14708 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:28:23.376457 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2aefe2-4c7f-4961-be82-6b906a70c766 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:23.377583 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2aefe2-4c7f-4961-be82-6b906a70c766 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:23.378140 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2aefe2-4c7f-4961-be82-6b906a70c766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:23.402370 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-9d2aefe2-4c7f-4961-be82-6b906a70c766 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:28:23.403744 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-9d2aefe2-4c7f-4961-be82-6b906a70c766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:28:23.516928 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1040/2042] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:28:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 10:28:23.526629 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7b26b7-2d77-445d-b6fb-024e1de68cfb admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:23.528076 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-6f7b26b7-2d77-445d-b6fb-024e1de68cfb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:28:23.591696 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7b26b7-2d77-445d-b6fb-024e1de68cfb admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:23.595475 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84035d0-49b1-4e8c-8702-a0274af580c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c1289b015854c6bb6aee8fed6b807db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:23.596503 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84035d0-49b1-4e8c-8702-a0274af580c9 service neutron] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:23.596596 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84035d0-49b1-4e8c-8702-a0274af580c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:23.596826 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84035d0-49b1-4e8c-8702-a0274af580c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:23.605132 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:28:23.609609 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84035d0-49b1-4e8c-8702-a0274af580c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:23.611665 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84035d0-49b1-4e8c-8702-a0274af580c9 service neutron] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:23.623962 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1003/2043] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:28:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:28:24.087167 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2aefe2-4c7f-4961-be82-6b906a70c766 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:24.089246 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-9d2aefe2-4c7f-4961-be82-6b906a70c766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:28:24.102888 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2aefe2-4c7f-4961-be82-6b906a70c766 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:24.113709 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38340cba-4ef7-4e86-92f9-e744d8c74df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:24.114400 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38340cba-4ef7-4e86-92f9-e744d8c74df6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:24.114662 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38340cba-4ef7-4e86-92f9-e744d8c74df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:24.114943 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38340cba-4ef7-4e86-92f9-e744d8c74df6 admin admin] PATH_INFO: `/v3/projects/dce568f12adf4245900fa13e0e771e35` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:24.116337 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38340cba-4ef7-4e86-92f9-e744d8c74df6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dce568f12adf4245900fa13e0e771e35)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:24.118256 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38340cba-4ef7-4e86-92f9-e744d8c74df6 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:24.168911 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-38340cba-4ef7-4e86-92f9-e744d8c74df6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dce568f12adf4245900fa13e0e771e35', 'request_id': 'req-38340cba-4ef7-4e86-92f9-e744d8c74df6'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:24.175983 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-38340cba-4ef7-4e86-92f9-e744d8c74df6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dce568f12adf4245900fa13e0e771e35', 'request_id': 'req-38340cba-4ef7-4e86-92f9-e744d8c74df6'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:24.185487 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-38340cba-4ef7-4e86-92f9-e744d8c74df6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dce568f12adf4245900fa13e0e771e35', 'request_id': 'req-38340cba-4ef7-4e86-92f9-e744d8c74df6'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:24.189558 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:28:24.197237 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-38340cba-4ef7-4e86-92f9-e744d8c74df6 admin admin] The token cache is being invalidate because project dce568f12adf4245900fa13e0e771e35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 10:28:24.197474 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-38340cba-4ef7-4e86-92f9-e744d8c74df6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:24.198988 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-38340cba-4ef7-4e86-92f9-e744d8c74df6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:24.200985 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1041/2044] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 19 10:28:24 2022] DELETE /identity/v3/projects/dce568f12adf4245900fa13e0e771e35 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:28:24.205877 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda95fc2-21cd-4e78-bf13-9c9bb254d41f None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:24.206415 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda95fc2-21cd-4e78-bf13-9c9bb254d41f None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:24.206920 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda95fc2-21cd-4e78-bf13-9c9bb254d41f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:24.227593 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-eda95fc2-21cd-4e78-bf13-9c9bb254d41f None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:28:24.228841 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-eda95fc2-21cd-4e78-bf13-9c9bb254d41f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:28:24.292268 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1004/2045] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:28:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:28:24.299940 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391bfd29-9f49-4686-ad0d-353c0d2dfd8f None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:24.300281 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391bfd29-9f49-4686-ad0d-353c0d2dfd8f None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:24.300585 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391bfd29-9f49-4686-ad0d-353c0d2dfd8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:24.320912 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-391bfd29-9f49-4686-ad0d-353c0d2dfd8f None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:28:24.322119 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-391bfd29-9f49-4686-ad0d-353c0d2dfd8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:28:24.334665 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1042/2046] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:28:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:28:24.339321 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda95fc2-21cd-4e78-bf13-9c9bb254d41f None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:24.349477 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda95fc2-21cd-4e78-bf13-9c9bb254d41f None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:24.354839 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fa9c5b-704d-4630-9115-8415f3ef8446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:24.355439 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fa9c5b-704d-4630-9115-8415f3ef8446 admin admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:24.355715 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fa9c5b-704d-4630-9115-8415f3ef8446 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:24.355983 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fa9c5b-704d-4630-9115-8415f3ef8446 admin admin] PATH_INFO: `/v3/domains` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:24.356684 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fa9c5b-704d-4630-9115-8415f3ef8446 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:28:24.357132 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fa9c5b-704d-4630-9115-8415f3ef8446 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:24.358753 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fa9c5b-704d-4630-9115-8415f3ef8446 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:24.371150 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1005/2047] 10.222.0.66 () {58 vars in 1153 bytes} [Mon Sep 19 10:28:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 10:28:24.375589 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391bfd29-9f49-4686-ad0d-353c0d2dfd8f None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:24.385569 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391bfd29-9f49-4686-ad0d-353c0d2dfd8f None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:24.390929 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba8d32d-cc6b-44da-99c7-188f0f99cb38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:24.391534 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba8d32d-cc6b-44da-99c7-188f0f99cb38 admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:24.391816 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba8d32d-cc6b-44da-99c7-188f0f99cb38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:24.392090 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba8d32d-cc6b-44da-99c7-188f0f99cb38 admin admin] PATH_INFO: `/v3/projects` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:24.393002 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba8d32d-cc6b-44da-99c7-188f0f99cb38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:24.394924 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba8d32d-cc6b-44da-99c7-188f0f99cb38 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:24.422664 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1043/2048] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 19 10:28:24 2022] POST /identity/v3/projects => generated 377 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:28:24.426908 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fa9c5b-704d-4630-9115-8415f3ef8446 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:24.437532 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fa9c5b-704d-4630-9115-8415f3ef8446 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:24.500518 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4731f164-2aec-40ea-933e-2cc337396125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:24.501130 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4731f164-2aec-40ea-933e-2cc337396125 admin admin] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:24.501411 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4731f164-2aec-40ea-933e-2cc337396125 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:24.501686 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4731f164-2aec-40ea-933e-2cc337396125 admin admin] PATH_INFO: `/v3/users` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:24.502320 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4731f164-2aec-40ea-933e-2cc337396125 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:24.504260 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4731f164-2aec-40ea-933e-2cc337396125 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:24.528014 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1006/2049] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 19 10:28:24 2022] POST /identity/v3/users => generated 289 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:28:24.532245 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba8d32d-cc6b-44da-99c7-188f0f99cb38 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:24.545897 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba8d32d-cc6b-44da-99c7-188f0f99cb38 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:24.551648 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc04a75e-edb5-4ae7-aa03-59c7f5fe3b65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:24.552370 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc04a75e-edb5-4ae7-aa03-59c7f5fe3b65 admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:24.552721 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc04a75e-edb5-4ae7-aa03-59c7f5fe3b65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:24.553070 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc04a75e-edb5-4ae7-aa03-59c7f5fe3b65 admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:24.553891 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc04a75e-edb5-4ae7-aa03-59c7f5fe3b65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:24.555502 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc04a75e-edb5-4ae7-aa03-59c7f5fe3b65 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:24.566318 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1044/2050] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:28:24 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 10:28:24.570467 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4731f164-2aec-40ea-933e-2cc337396125 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:24.584037 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4731f164-2aec-40ea-933e-2cc337396125 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:24.589223 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53f7e4e-5520-43a1-8bd9-8816eaebfd34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:24.589830 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53f7e4e-5520-43a1-8bd9-8816eaebfd34 admin admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:24.590116 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53f7e4e-5520-43a1-8bd9-8816eaebfd34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:24.590393 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53f7e4e-5520-43a1-8bd9-8816eaebfd34 admin admin] PATH_INFO: `/v3/roles` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:24.591098 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53f7e4e-5520-43a1-8bd9-8816eaebfd34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:24.592661 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53f7e4e-5520-43a1-8bd9-8816eaebfd34 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:24.608575 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1007/2051] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:28:24 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 10:28:24.612380 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc04a75e-edb5-4ae7-aa03-59c7f5fe3b65 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:24.623138 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc04a75e-edb5-4ae7-aa03-59c7f5fe3b65 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:24.629423 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1b6b6f-f58a-4b44-9ac0-358e49f2b9ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:24.630236 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1b6b6f-f58a-4b44-9ac0-358e49f2b9ba admin admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:24.630454 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1b6b6f-f58a-4b44-9ac0-358e49f2b9ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:24.630689 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1b6b6f-f58a-4b44-9ac0-358e49f2b9ba admin admin] PATH_INFO: `/v3/projects/a3194b9cdb2a4304ab1929c079b9ad59/users/3a8afb9d99194b4bb8ac9c63f9896259/roles/cd5b42ed3b754b58817a62bbe74651b4` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:24.649303 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1b6b6f-f58a-4b44-9ac0-358e49f2b9ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3194b9cdb2a4304ab1929c079b9ad59, user_id=3a8afb9d99194b4bb8ac9c63f9896259, role_id=cd5b42ed3b754b58817a62bbe74651b4)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:24.652585 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1b6b6f-f58a-4b44-9ac0-358e49f2b9ba admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:24.669869 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1045/2052] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 19 10:28:24 2022] PUT /identity/v3/projects/a3194b9cdb2a4304ab1929c079b9ad59/users/3a8afb9d99194b4bb8ac9c63f9896259/roles/cd5b42ed3b754b58817a62bbe74651b4 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:28:24.680725 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fd9ee0-2b95-4928-87ac-603d006b0766 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:24.681035 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fd9ee0-2b95-4928-87ac-603d006b0766 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:24.681287 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fd9ee0-2b95-4928-87ac-603d006b0766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:24.731350 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-97fd9ee0-2b95-4928-87ac-603d006b0766 None None] MFA Rules not processed for user `3a8afb9d99194b4bb8ac9c63f9896259`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:28:24.732628 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-97fd9ee0-2b95-4928-87ac-603d006b0766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:28:24.786468 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:28:24.806399 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1008/2053] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:28:24 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:28:24.811158 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1b6b6f-f58a-4b44-9ac0-358e49f2b9ba admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:24.879659 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1b6b6f-f58a-4b44-9ac0-358e49f2b9ba admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:24.884537 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa9cd81-280c-47f1-92f0-2165ccd28628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:24.885156 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa9cd81-280c-47f1-92f0-2165ccd28628 admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:24.885489 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa9cd81-280c-47f1-92f0-2165ccd28628 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:24.885766 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa9cd81-280c-47f1-92f0-2165ccd28628 admin admin] PATH_INFO: `/v3/projects` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:24.886414 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa9cd81-280c-47f1-92f0-2165ccd28628 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:24.888374 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa9cd81-280c-47f1-92f0-2165ccd28628 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:24.924542 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1046/2054] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 19 10:28:24 2022] POST /identity/v3/projects => generated 377 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 10:28:24.925858 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fd9ee0-2b95-4928-87ac-603d006b0766 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:24.949045 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fd9ee0-2b95-4928-87ac-603d006b0766 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:25.032376 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd754083-16cb-4a84-a5bd-e0329ab3278d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:25.032907 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd754083-16cb-4a84-a5bd-e0329ab3278d admin admin] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:25.033181 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd754083-16cb-4a84-a5bd-e0329ab3278d admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:25.033529 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd754083-16cb-4a84-a5bd-e0329ab3278d admin admin] PATH_INFO: `/v3/users` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:25.034177 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd754083-16cb-4a84-a5bd-e0329ab3278d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:25.039864 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd754083-16cb-4a84-a5bd-e0329ab3278d admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:25.067171 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1009/2055] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 19 10:28:24 2022] POST /identity/v3/users => generated 289 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:28:25.070995 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa9cd81-280c-47f1-92f0-2165ccd28628 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:25.082555 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa9cd81-280c-47f1-92f0-2165ccd28628 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:25.088006 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95373f11-c5ee-4741-bc97-9fb13ebd6f0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:25.089212 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95373f11-c5ee-4741-bc97-9fb13ebd6f0e admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:25.089537 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95373f11-c5ee-4741-bc97-9fb13ebd6f0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:25.089871 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95373f11-c5ee-4741-bc97-9fb13ebd6f0e admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:25.090650 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95373f11-c5ee-4741-bc97-9fb13ebd6f0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:25.092121 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95373f11-c5ee-4741-bc97-9fb13ebd6f0e admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:25.105477 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1047/2056] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:28:25 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 10:28:25.108887 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd754083-16cb-4a84-a5bd-e0329ab3278d admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:25.119773 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd754083-16cb-4a84-a5bd-e0329ab3278d admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:25.125272 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4007849a-1e88-4229-88d2-55b17dd22e6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:25.125888 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4007849a-1e88-4229-88d2-55b17dd22e6e admin admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:25.126168 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4007849a-1e88-4229-88d2-55b17dd22e6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:25.126435 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4007849a-1e88-4229-88d2-55b17dd22e6e admin admin] PATH_INFO: `/v3/roles` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:25.127216 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4007849a-1e88-4229-88d2-55b17dd22e6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:25.128774 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4007849a-1e88-4229-88d2-55b17dd22e6e admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:25.141281 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1010/2057] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:28:25 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 10:28:25.145453 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95373f11-c5ee-4741-bc97-9fb13ebd6f0e admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:25.157907 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95373f11-c5ee-4741-bc97-9fb13ebd6f0e admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:25.163246 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54497dbb-e96d-4db7-9f26-f67627acdb0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:25.164046 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54497dbb-e96d-4db7-9f26-f67627acdb0b admin admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:25.164516 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54497dbb-e96d-4db7-9f26-f67627acdb0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:25.164949 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54497dbb-e96d-4db7-9f26-f67627acdb0b admin admin] PATH_INFO: `/v3/projects/459be25bb5f54205a32ae6d2d4dbdb0c/users/b463b4aa3acd453cb45e6ddf7c582854/roles/cd5b42ed3b754b58817a62bbe74651b4` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:25.182747 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54497dbb-e96d-4db7-9f26-f67627acdb0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=459be25bb5f54205a32ae6d2d4dbdb0c, user_id=b463b4aa3acd453cb45e6ddf7c582854, role_id=cd5b42ed3b754b58817a62bbe74651b4)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:25.185826 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54497dbb-e96d-4db7-9f26-f67627acdb0b admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:25.213168 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1048/2058] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 19 10:28:25 2022] PUT /identity/v3/projects/459be25bb5f54205a32ae6d2d4dbdb0c/users/b463b4aa3acd453cb45e6ddf7c582854/roles/cd5b42ed3b754b58817a62bbe74651b4 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 10:28:25.225059 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fb553a-a977-40ad-ac8d-1aa1cd49ae9c None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:25.225519 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fb553a-a977-40ad-ac8d-1aa1cd49ae9c None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:25.225627 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fb553a-a977-40ad-ac8d-1aa1cd49ae9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:25.258542 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-94fb553a-a977-40ad-ac8d-1aa1cd49ae9c None None] MFA Rules not processed for user `b463b4aa3acd453cb45e6ddf7c582854`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:28:25.259933 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-94fb553a-a977-40ad-ac8d-1aa1cd49ae9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:28:25.346939 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1011/2059] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:28:25 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:28:25.348117 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54497dbb-e96d-4db7-9f26-f67627acdb0b admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:25.400099 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:DELETE=1,keystone:SELECT=95,keystone:INSERT=4 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:28:25.429353 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54497dbb-e96d-4db7-9f26-f67627acdb0b admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:25.435368 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6ef868-ddba-49bf-82d2-0630f70d53ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:25.436145 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6ef868-ddba-49bf-82d2-0630f70d53ba admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:25.436567 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6ef868-ddba-49bf-82d2-0630f70d53ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:25.436914 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6ef868-ddba-49bf-82d2-0630f70d53ba admin admin] PATH_INFO: `/v3/projects` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:25.437654 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6ef868-ddba-49bf-82d2-0630f70d53ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:25.439638 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6ef868-ddba-49bf-82d2-0630f70d53ba admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:25.471384 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1049/2060] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 19 10:28:25 2022] POST /identity/v3/projects => generated 375 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:28:25.476401 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fb553a-a977-40ad-ac8d-1aa1cd49ae9c None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:25.492545 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fb553a-a977-40ad-ac8d-1aa1cd49ae9c None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:25.555514 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0c2065-96c8-42ac-9c1f-a65d267b63e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:25.556454 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0c2065-96c8-42ac-9c1f-a65d267b63e4 admin admin] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:25.556454 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0c2065-96c8-42ac-9c1f-a65d267b63e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:25.556821 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0c2065-96c8-42ac-9c1f-a65d267b63e4 admin admin] PATH_INFO: `/v3/users` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:25.558375 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0c2065-96c8-42ac-9c1f-a65d267b63e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:25.560579 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0c2065-96c8-42ac-9c1f-a65d267b63e4 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:25.572507 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:28:25.592310 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1012/2061] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 19 10:28:25 2022] POST /identity/v3/users => generated 294 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 10:28:25.593529 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6ef868-ddba-49bf-82d2-0630f70d53ba admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:25.604207 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6ef868-ddba-49bf-82d2-0630f70d53ba admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:25.609609 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f628408-b97b-404f-812c-8a65635745e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:25.610231 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f628408-b97b-404f-812c-8a65635745e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:25.610507 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f628408-b97b-404f-812c-8a65635745e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:25.610778 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f628408-b97b-404f-812c-8a65635745e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:25.611424 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f628408-b97b-404f-812c-8a65635745e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:25.613073 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f628408-b97b-404f-812c-8a65635745e8 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:25.628131 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1050/2062] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:28:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 10:28:25.629781 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0c2065-96c8-42ac-9c1f-a65d267b63e4 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:25.641192 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0c2065-96c8-42ac-9c1f-a65d267b63e4 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:25.646774 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458db447-0752-4b78-8d8a-f065c7a1717a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:25.647689 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458db447-0752-4b78-8d8a-f065c7a1717a admin admin] REQUEST_METHOD: `PUT` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:25.647976 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458db447-0752-4b78-8d8a-f065c7a1717a admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:25.648279 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458db447-0752-4b78-8d8a-f065c7a1717a admin admin] PATH_INFO: `/v3/projects/66840ae8d171487cac9c3bdf75bde603/users/a15c10690bf9410184315069818bd9d1/roles/5c8b89fae4fa45bd944cbeaf442136e1` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:25.664504 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458db447-0752-4b78-8d8a-f065c7a1717a admin admin] RBAC: Authorizing `identity:create_grant(project_id=66840ae8d171487cac9c3bdf75bde603, user_id=a15c10690bf9410184315069818bd9d1, role_id=5c8b89fae4fa45bd944cbeaf442136e1)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:25.667705 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458db447-0752-4b78-8d8a-f065c7a1717a admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:25.693434 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1013/2063] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 19 10:28:25 2022] PUT /identity/v3/projects/66840ae8d171487cac9c3bdf75bde603/users/a15c10690bf9410184315069818bd9d1/roles/5c8b89fae4fa45bd944cbeaf442136e1 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:28:25.697410 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f628408-b97b-404f-812c-8a65635745e8 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:25.722468 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f628408-b97b-404f-812c-8a65635745e8 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:25.819914 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad43d7eb-1551-4b4d-ac62-0b6fb045c5c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:25.820948 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad43d7eb-1551-4b4d-ac62-0b6fb045c5c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:25.821527 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad43d7eb-1551-4b4d-ac62-0b6fb045c5c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:25.822089 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad43d7eb-1551-4b4d-ac62-0b6fb045c5c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:25.823156 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad43d7eb-1551-4b4d-ac62-0b6fb045c5c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:25.824854 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad43d7eb-1551-4b4d-ac62-0b6fb045c5c7 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:25.837854 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1051/2064] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:28:25 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 10:28:25.842158 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458db447-0752-4b78-8d8a-f065c7a1717a admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:25.853722 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458db447-0752-4b78-8d8a-f065c7a1717a admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:25.860291 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbb7971-d102-47de-b68c-be7f173758ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:25.861069 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbb7971-d102-47de-b68c-be7f173758ab admin admin] REQUEST_METHOD: `PUT` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:25.861670 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbb7971-d102-47de-b68c-be7f173758ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:25.862561 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbb7971-d102-47de-b68c-be7f173758ab admin admin] PATH_INFO: `/v3/projects/66840ae8d171487cac9c3bdf75bde603/users/a15c10690bf9410184315069818bd9d1/roles/5c8b89fae4fa45bd944cbeaf442136e1` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:25.864103 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbb7971-d102-47de-b68c-be7f173758ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=66840ae8d171487cac9c3bdf75bde603, user_id=a15c10690bf9410184315069818bd9d1, role_id=5c8b89fae4fa45bd944cbeaf442136e1)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:25.867734 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbb7971-d102-47de-b68c-be7f173758ab admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:25.889779 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1014/2065] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 19 10:28:25 2022] PUT /identity/v3/projects/66840ae8d171487cac9c3bdf75bde603/users/a15c10690bf9410184315069818bd9d1/roles/5c8b89fae4fa45bd944cbeaf442136e1 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 10:28:25.899229 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79599573-b2f9-477f-a312-affad31cf1d7 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:25.899229 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79599573-b2f9-477f-a312-affad31cf1d7 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:25.899229 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79599573-b2f9-477f-a312-affad31cf1d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:25.941357 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-79599573-b2f9-477f-a312-affad31cf1d7 None None] MFA Rules not processed for user `a15c10690bf9410184315069818bd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:28:25.942701 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-79599573-b2f9-477f-a312-affad31cf1d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:28:26.015895 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1052/2066] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:28:25 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:28:26.031685 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbb7971-d102-47de-b68c-be7f173758ab admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:26.033411 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-5cbb7971-d102-47de-b68c-be7f173758ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:28:26.101861 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbb7971-d102-47de-b68c-be7f173758ab admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:26.106206 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967d22c2-0339-4adf-9fbf-bdc6292b8f4b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa4d004fd44482cae761c4b3bdfab31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:26.106856 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967d22c2-0339-4adf-9fbf-bdc6292b8f4b service cinder] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:26.107135 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967d22c2-0339-4adf-9fbf-bdc6292b8f4b service cinder] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:26.107409 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967d22c2-0339-4adf-9fbf-bdc6292b8f4b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:26.189424 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967d22c2-0339-4adf-9fbf-bdc6292b8f4b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:26.190885 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967d22c2-0339-4adf-9fbf-bdc6292b8f4b service cinder] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:26.200111 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1015/2067] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:28:26 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:28:26.638514 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79599573-b2f9-477f-a312-affad31cf1d7 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:26.640051 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-79599573-b2f9-477f-a312-affad31cf1d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:28:26.726157 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:28:26.773401 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79599573-b2f9-477f-a312-affad31cf1d7 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:26.778696 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22495da-57b4-4966-ae92-5bcc3233f9b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:26.779342 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22495da-57b4-4966-ae92-5bcc3233f9b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:26.779623 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22495da-57b4-4966-ae92-5bcc3233f9b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:26.779896 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22495da-57b4-4966-ae92-5bcc3233f9b1 admin admin] PATH_INFO: `/v3/users/89344f2c3ec04ebabc4ebcf11e59b716` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:26.781272 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22495da-57b4-4966-ae92-5bcc3233f9b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=89344f2c3ec04ebabc4ebcf11e59b716)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:26.783375 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22495da-57b4-4966-ae92-5bcc3233f9b1 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:26.838382 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-e22495da-57b4-4966-ae92-5bcc3233f9b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89344f2c3ec04ebabc4ebcf11e59b716'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:26.846693 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-e22495da-57b4-4966-ae92-5bcc3233f9b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89344f2c3ec04ebabc4ebcf11e59b716'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:26.847361 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-e22495da-57b4-4966-ae92-5bcc3233f9b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89344f2c3ec04ebabc4ebcf11e59b716'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:26.847961 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-e22495da-57b4-4966-ae92-5bcc3233f9b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89344f2c3ec04ebabc4ebcf11e59b716'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:26.855308 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-e22495da-57b4-4966-ae92-5bcc3233f9b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89344f2c3ec04ebabc4ebcf11e59b716'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:26.873826 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1053/2068] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 19 10:28:26 2022] DELETE /identity/v3/users/89344f2c3ec04ebabc4ebcf11e59b716 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:28:26.878378 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a3e507-9667-40db-98a4-937935025502 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:26.878845 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a3e507-9667-40db-98a4-937935025502 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:26.879044 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a3e507-9667-40db-98a4-937935025502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:26.899405 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-22a3e507-9667-40db-98a4-937935025502 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:28:26.900658 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-22a3e507-9667-40db-98a4-937935025502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:28:26.977271 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1016/2069] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:28:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:28:26.985932 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22495da-57b4-4966-ae92-5bcc3233f9b1 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:26.987709 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-e22495da-57b4-4966-ae92-5bcc3233f9b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:28:27.075513 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22495da-57b4-4966-ae92-5bcc3233f9b1 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:27.079449 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe6424c-683d-4dc7-8b9c-f8392eb8aa45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c1289b015854c6bb6aee8fed6b807db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:27.080078 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe6424c-683d-4dc7-8b9c-f8392eb8aa45 service neutron] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:27.080388 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe6424c-683d-4dc7-8b9c-f8392eb8aa45 service neutron] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:27.080722 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe6424c-683d-4dc7-8b9c-f8392eb8aa45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:27.093867 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe6424c-683d-4dc7-8b9c-f8392eb8aa45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:27.096041 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe6424c-683d-4dc7-8b9c-f8392eb8aa45 service neutron] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:27.108927 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1054/2070] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:28:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:28:27.490856 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a3e507-9667-40db-98a4-937935025502 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:27.492592 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-22a3e507-9667-40db-98a4-937935025502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:28:27.507615 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a3e507-9667-40db-98a4-937935025502 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:27.513386 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f95e89d-dbb5-4579-b8b7-9ba2917cd86e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:27.514019 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f95e89d-dbb5-4579-b8b7-9ba2917cd86e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:27.514494 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f95e89d-dbb5-4579-b8b7-9ba2917cd86e admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:27.514722 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f95e89d-dbb5-4579-b8b7-9ba2917cd86e admin admin] PATH_INFO: `/v3/projects/2d0f3b5224b94249b7693fce1b37ff07` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:27.515930 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f95e89d-dbb5-4579-b8b7-9ba2917cd86e admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d0f3b5224b94249b7693fce1b37ff07)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:27.517883 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f95e89d-dbb5-4579-b8b7-9ba2917cd86e admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:27.532446 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:28:27.577561 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-0f95e89d-dbb5-4579-b8b7-9ba2917cd86e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d0f3b5224b94249b7693fce1b37ff07', 'request_id': 'req-0f95e89d-dbb5-4579-b8b7-9ba2917cd86e'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:27.585248 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-0f95e89d-dbb5-4579-b8b7-9ba2917cd86e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d0f3b5224b94249b7693fce1b37ff07', 'request_id': 'req-0f95e89d-dbb5-4579-b8b7-9ba2917cd86e'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:27.593909 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-0f95e89d-dbb5-4579-b8b7-9ba2917cd86e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d0f3b5224b94249b7693fce1b37ff07', 'request_id': 'req-0f95e89d-dbb5-4579-b8b7-9ba2917cd86e'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:27.607721 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-0f95e89d-dbb5-4579-b8b7-9ba2917cd86e admin admin] The token cache is being invalidate because project 2d0f3b5224b94249b7693fce1b37ff07 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 10:28:27.608023 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-0f95e89d-dbb5-4579-b8b7-9ba2917cd86e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:27.608734 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-0f95e89d-dbb5-4579-b8b7-9ba2917cd86e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:27.610912 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1017/2071] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 19 10:28:27 2022] DELETE /identity/v3/projects/2d0f3b5224b94249b7693fce1b37ff07 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:28:27.614968 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe6424c-683d-4dc7-8b9c-f8392eb8aa45 service neutron] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:27.624811 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe6424c-683d-4dc7-8b9c-f8392eb8aa45 service neutron] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:27.704787 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:28:27.714456 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3114b32c-d1a3-4aed-af0e-5fc649d2bdc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:27.715580 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3114b32c-d1a3-4aed-af0e-5fc649d2bdc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:27.715931 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3114b32c-d1a3-4aed-af0e-5fc649d2bdc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:27.716408 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3114b32c-d1a3-4aed-af0e-5fc649d2bdc6 admin admin] PATH_INFO: `/v3/users/f55cbacc7bba4eb0bdf449ffe825f80f` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:27.719946 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3114b32c-d1a3-4aed-af0e-5fc649d2bdc6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f55cbacc7bba4eb0bdf449ffe825f80f)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:27.722294 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3114b32c-d1a3-4aed-af0e-5fc649d2bdc6 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:27.820883 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-3114b32c-d1a3-4aed-af0e-5fc649d2bdc6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f55cbacc7bba4eb0bdf449ffe825f80f'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:27.837351 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-3114b32c-d1a3-4aed-af0e-5fc649d2bdc6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f55cbacc7bba4eb0bdf449ffe825f80f'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:27.839511 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-3114b32c-d1a3-4aed-af0e-5fc649d2bdc6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f55cbacc7bba4eb0bdf449ffe825f80f'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:27.841414 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-3114b32c-d1a3-4aed-af0e-5fc649d2bdc6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f55cbacc7bba4eb0bdf449ffe825f80f'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:27.851832 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-3114b32c-d1a3-4aed-af0e-5fc649d2bdc6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f55cbacc7bba4eb0bdf449ffe825f80f'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:27.873316 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1055/2072] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 19 10:28:27 2022] DELETE /identity/v3/users/f55cbacc7bba4eb0bdf449ffe825f80f => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:28:27.963424 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f95e89d-dbb5-4579-b8b7-9ba2917cd86e admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:27.965729 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-0f95e89d-dbb5-4579-b8b7-9ba2917cd86e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:28:28.028633 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f95e89d-dbb5-4579-b8b7-9ba2917cd86e admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:28.084325 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773445de-06b5-4645-89fb-34a0f7ad3116 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa4d004fd44482cae761c4b3bdfab31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:28.084849 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773445de-06b5-4645-89fb-34a0f7ad3116 service cinder] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:28.085130 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773445de-06b5-4645-89fb-34a0f7ad3116 service cinder] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:28.085407 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773445de-06b5-4645-89fb-34a0f7ad3116 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:28.087645 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-773445de-06b5-4645-89fb-34a0f7ad3116 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:28:28.161607 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773445de-06b5-4645-89fb-34a0f7ad3116 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:28.163364 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773445de-06b5-4645-89fb-34a0f7ad3116 service cinder] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:28.171641 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:28:28.188382 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1018/2073] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:28:27 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:28:28.199572 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3114b32c-d1a3-4aed-af0e-5fc649d2bdc6 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:28.201036 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-3114b32c-d1a3-4aed-af0e-5fc649d2bdc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:28:28.302935 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3114b32c-d1a3-4aed-af0e-5fc649d2bdc6 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:28.309544 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a452d405-3cd1-4df4-994d-e7037f2f164b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:28.310222 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a452d405-3cd1-4df4-994d-e7037f2f164b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:28.310502 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a452d405-3cd1-4df4-994d-e7037f2f164b admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:28.310782 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a452d405-3cd1-4df4-994d-e7037f2f164b admin admin] PATH_INFO: `/v3/projects/d898a902991b40ddad96b5d7eef17866` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:28.312142 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a452d405-3cd1-4df4-994d-e7037f2f164b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d898a902991b40ddad96b5d7eef17866)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:28.314348 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a452d405-3cd1-4df4-994d-e7037f2f164b admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:28.373502 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-a452d405-3cd1-4df4-994d-e7037f2f164b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd898a902991b40ddad96b5d7eef17866', 'request_id': 'req-a452d405-3cd1-4df4-994d-e7037f2f164b'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:28.381101 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-a452d405-3cd1-4df4-994d-e7037f2f164b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd898a902991b40ddad96b5d7eef17866', 'request_id': 'req-a452d405-3cd1-4df4-994d-e7037f2f164b'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:28.390656 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-a452d405-3cd1-4df4-994d-e7037f2f164b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd898a902991b40ddad96b5d7eef17866', 'request_id': 'req-a452d405-3cd1-4df4-994d-e7037f2f164b'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:28.403920 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-a452d405-3cd1-4df4-994d-e7037f2f164b admin admin] The token cache is being invalidate because project d898a902991b40ddad96b5d7eef17866 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 10:28:28.404279 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-a452d405-3cd1-4df4-994d-e7037f2f164b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:28.405091 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-a452d405-3cd1-4df4-994d-e7037f2f164b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:28.407280 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1056/2074] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 19 10:28:28 2022] DELETE /identity/v3/projects/d898a902991b40ddad96b5d7eef17866 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:28:28.418078 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edff4d63-3c7b-4b5c-86c3-caad6642da93 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:28.418484 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edff4d63-3c7b-4b5c-86c3-caad6642da93 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:28.418825 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edff4d63-3c7b-4b5c-86c3-caad6642da93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:28.440476 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-edff4d63-3c7b-4b5c-86c3-caad6642da93 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:28:28.441700 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-edff4d63-3c7b-4b5c-86c3-caad6642da93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:28:28.524344 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1019/2075] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:28:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 10:28:28.534391 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f43d6ff-e42e-494b-899b-d8b70c03f591 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:28.534391 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f43d6ff-e42e-494b-899b-d8b70c03f591 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:28.534767 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f43d6ff-e42e-494b-899b-d8b70c03f591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:28.550532 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:28:28.557752 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-6f43d6ff-e42e-494b-899b-d8b70c03f591 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:28:28.560142 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-6f43d6ff-e42e-494b-899b-d8b70c03f591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:28:28.571185 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1057/2076] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:28:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:28:28.576558 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edff4d63-3c7b-4b5c-86c3-caad6642da93 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:28.595149 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edff4d63-3c7b-4b5c-86c3-caad6642da93 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:28.600100 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cecd205-5022-40e2-8fc6-8ea7eb4a41bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:28.600784 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cecd205-5022-40e2-8fc6-8ea7eb4a41bb admin admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:28.601191 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cecd205-5022-40e2-8fc6-8ea7eb4a41bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:28.601479 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cecd205-5022-40e2-8fc6-8ea7eb4a41bb admin admin] PATH_INFO: `/v3/domains` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:28.601919 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cecd205-5022-40e2-8fc6-8ea7eb4a41bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:28:28.602223 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cecd205-5022-40e2-8fc6-8ea7eb4a41bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:28.603859 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cecd205-5022-40e2-8fc6-8ea7eb4a41bb admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:28.617044 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1020/2077] 10.222.0.66 () {58 vars in 1153 bytes} [Mon Sep 19 10:28:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:28:28.622859 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f43d6ff-e42e-494b-899b-d8b70c03f591 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:28.634234 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f43d6ff-e42e-494b-899b-d8b70c03f591 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:28.639931 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d850210-19d7-4b28-96ef-2dd5a5f003fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:28.640617 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d850210-19d7-4b28-96ef-2dd5a5f003fd admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:28.640894 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d850210-19d7-4b28-96ef-2dd5a5f003fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:28.641199 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d850210-19d7-4b28-96ef-2dd5a5f003fd admin admin] PATH_INFO: `/v3/projects` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:28.641884 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d850210-19d7-4b28-96ef-2dd5a5f003fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:28.643781 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d850210-19d7-4b28-96ef-2dd5a5f003fd admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:28.676229 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1058/2078] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 19 10:28:28 2022] POST /identity/v3/projects => generated 387 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 10:28:28.678356 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cecd205-5022-40e2-8fc6-8ea7eb4a41bb admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:28.690772 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cecd205-5022-40e2-8fc6-8ea7eb4a41bb admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:28.751405 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bde8f30-67fb-4486-9ce7-ada05555c777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:28.752085 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bde8f30-67fb-4486-9ce7-ada05555c777 admin admin] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:28.752411 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bde8f30-67fb-4486-9ce7-ada05555c777 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:28.752681 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bde8f30-67fb-4486-9ce7-ada05555c777 admin admin] PATH_INFO: `/v3/users` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:28.753316 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bde8f30-67fb-4486-9ce7-ada05555c777 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:28.755246 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bde8f30-67fb-4486-9ce7-ada05555c777 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:28.778781 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1021/2079] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 19 10:28:28 2022] POST /identity/v3/users => generated 294 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:28:28.783999 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d850210-19d7-4b28-96ef-2dd5a5f003fd admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:28.797823 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d850210-19d7-4b28-96ef-2dd5a5f003fd admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:28.803739 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2fdd70-3063-4b12-ba02-d43720dc25c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:28.804622 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2fdd70-3063-4b12-ba02-d43720dc25c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:28.804970 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2fdd70-3063-4b12-ba02-d43720dc25c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:28.805335 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2fdd70-3063-4b12-ba02-d43720dc25c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:28.806093 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2fdd70-3063-4b12-ba02-d43720dc25c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:28.808269 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2fdd70-3063-4b12-ba02-d43720dc25c6 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:28.824742 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1059/2080] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:28:28 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 10:28:28.826002 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bde8f30-67fb-4486-9ce7-ada05555c777 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:28.836631 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bde8f30-67fb-4486-9ce7-ada05555c777 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:28.841317 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47db4e4-e83a-4a78-8d77-61edfdb849b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:28.841929 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47db4e4-e83a-4a78-8d77-61edfdb849b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:28.842211 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47db4e4-e83a-4a78-8d77-61edfdb849b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:28.842489 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47db4e4-e83a-4a78-8d77-61edfdb849b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:28.843126 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47db4e4-e83a-4a78-8d77-61edfdb849b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:28.844802 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47db4e4-e83a-4a78-8d77-61edfdb849b2 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:28.858543 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1022/2081] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:28:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 10:28:28.860852 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2fdd70-3063-4b12-ba02-d43720dc25c6 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:28.863338 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47db4e4-e83a-4a78-8d77-61edfdb849b2 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:28.865167 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-f47db4e4-e83a-4a78-8d77-61edfdb849b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:28:28.875068 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2fdd70-3063-4b12-ba02-d43720dc25c6 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:28.880199 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0809421-3c85-4aac-9712-29c6cad797e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:28.880879 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0809421-3c85-4aac-9712-29c6cad797e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:28.881163 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0809421-3c85-4aac-9712-29c6cad797e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:28.881444 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0809421-3c85-4aac-9712-29c6cad797e1 admin admin] PATH_INFO: `/v3/projects/64541c5045b84669b012a92eaa8806a5/users/2ca03e1b6c6d437c8da3e9536972cd20/roles/cd5b42ed3b754b58817a62bbe74651b4` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:28.899065 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0809421-3c85-4aac-9712-29c6cad797e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64541c5045b84669b012a92eaa8806a5, user_id=2ca03e1b6c6d437c8da3e9536972cd20, role_id=cd5b42ed3b754b58817a62bbe74651b4)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:28.902073 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0809421-3c85-4aac-9712-29c6cad797e1 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:28.919553 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1060/2082] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 19 10:28:28 2022] PUT /identity/v3/projects/64541c5045b84669b012a92eaa8806a5/users/2ca03e1b6c6d437c8da3e9536972cd20/roles/cd5b42ed3b754b58817a62bbe74651b4 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:28:28.930585 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38f0802-7cd4-4b78-8f09-78436878b559 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:28.930895 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38f0802-7cd4-4b78-8f09-78436878b559 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:28.931146 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38f0802-7cd4-4b78-8f09-78436878b559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:28.937950 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47db4e4-e83a-4a78-8d77-61edfdb849b2 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:28.958886 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:28:28.966093 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-e38f0802-7cd4-4b78-8f09-78436878b559 None None] MFA Rules not processed for user `2ca03e1b6c6d437c8da3e9536972cd20`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:28:28.967710 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-e38f0802-7cd4-4b78-8f09-78436878b559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:28:28.995301 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a828016e-af51-47bb-b0e3-10a39f28b0ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa4d004fd44482cae761c4b3bdfab31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:28.996651 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a828016e-af51-47bb-b0e3-10a39f28b0ae service cinder] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:28.997112 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a828016e-af51-47bb-b0e3-10a39f28b0ae service cinder] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:28.997564 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a828016e-af51-47bb-b0e3-10a39f28b0ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:28.999486 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-a828016e-af51-47bb-b0e3-10a39f28b0ae service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:28:29.051980 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1061/2083] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:28:28 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 10:28:29.056675 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38f0802-7cd4-4b78-8f09-78436878b559 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:29.082799 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a828016e-af51-47bb-b0e3-10a39f28b0ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:29.084287 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a828016e-af51-47bb-b0e3-10a39f28b0ae service cinder] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:29.095642 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1023/2084] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:28:28 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:28:29.131476 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38f0802-7cd4-4b78-8f09-78436878b559 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:29.136506 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d7e549-c5b5-4a6e-bd6a-1058b75d9401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:29.137094 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d7e549-c5b5-4a6e-bd6a-1058b75d9401 admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:29.137378 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d7e549-c5b5-4a6e-bd6a-1058b75d9401 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:29.137658 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d7e549-c5b5-4a6e-bd6a-1058b75d9401 admin admin] PATH_INFO: `/v3/projects` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:29.138297 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d7e549-c5b5-4a6e-bd6a-1058b75d9401 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:29.140271 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d7e549-c5b5-4a6e-bd6a-1058b75d9401 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:29.172035 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1062/2085] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 19 10:28:29 2022] POST /identity/v3/projects => generated 387 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 10:28:29.176534 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a828016e-af51-47bb-b0e3-10a39f28b0ae service cinder] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:29.187532 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a828016e-af51-47bb-b0e3-10a39f28b0ae service cinder] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:29.250021 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74764353-35d8-4cf5-8f57-11fa774a3ed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:29.250563 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74764353-35d8-4cf5-8f57-11fa774a3ed8 admin admin] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:29.250842 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74764353-35d8-4cf5-8f57-11fa774a3ed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:29.251125 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74764353-35d8-4cf5-8f57-11fa774a3ed8 admin admin] PATH_INFO: `/v3/users` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:29.251740 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74764353-35d8-4cf5-8f57-11fa774a3ed8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:29.253751 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74764353-35d8-4cf5-8f57-11fa774a3ed8 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:29.274911 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1024/2086] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 19 10:28:29 2022] POST /identity/v3/users => generated 300 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:28:29.279108 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d7e549-c5b5-4a6e-bd6a-1058b75d9401 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:29.289900 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d7e549-c5b5-4a6e-bd6a-1058b75d9401 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:29.295722 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a1ff29-2dbd-4710-9a26-ed2faea2117e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:29.296358 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a1ff29-2dbd-4710-9a26-ed2faea2117e admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:29.296642 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a1ff29-2dbd-4710-9a26-ed2faea2117e admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:29.296919 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a1ff29-2dbd-4710-9a26-ed2faea2117e admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:29.297588 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a1ff29-2dbd-4710-9a26-ed2faea2117e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:29.299202 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a1ff29-2dbd-4710-9a26-ed2faea2117e admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:29.309454 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1063/2087] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:28:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 10:28:29.313868 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74764353-35d8-4cf5-8f57-11fa774a3ed8 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:29.323864 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74764353-35d8-4cf5-8f57-11fa774a3ed8 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:29.328499 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdb7f44-1af7-4043-846d-296fde9f8894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:29.329147 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdb7f44-1af7-4043-846d-296fde9f8894 admin admin] REQUEST_METHOD: `PUT` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:29.329429 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdb7f44-1af7-4043-846d-296fde9f8894 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:29.329702 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdb7f44-1af7-4043-846d-296fde9f8894 admin admin] PATH_INFO: `/v3/projects/87c9f54edfaf4a71bee17bbef5ca9133/users/199e03e4e6324821871d87eb3f792576/roles/5c8b89fae4fa45bd944cbeaf442136e1` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:29.345300 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdb7f44-1af7-4043-846d-296fde9f8894 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87c9f54edfaf4a71bee17bbef5ca9133, user_id=199e03e4e6324821871d87eb3f792576, role_id=5c8b89fae4fa45bd944cbeaf442136e1)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:29.348032 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdb7f44-1af7-4043-846d-296fde9f8894 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:29.365087 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1025/2088] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 19 10:28:29 2022] PUT /identity/v3/projects/87c9f54edfaf4a71bee17bbef5ca9133/users/199e03e4e6324821871d87eb3f792576/roles/5c8b89fae4fa45bd944cbeaf442136e1 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 10:28:29.370028 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a1ff29-2dbd-4710-9a26-ed2faea2117e admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:29.382191 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a1ff29-2dbd-4710-9a26-ed2faea2117e admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:29.387043 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:28:29.448686 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b746c4eb-b880-4be7-acf7-a5ecba98ca7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:29.450988 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b746c4eb-b880-4be7-acf7-a5ecba98ca7f admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:29.450988 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b746c4eb-b880-4be7-acf7-a5ecba98ca7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:29.450988 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b746c4eb-b880-4be7-acf7-a5ecba98ca7f admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:29.450988 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b746c4eb-b880-4be7-acf7-a5ecba98ca7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:29.452438 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b746c4eb-b880-4be7-acf7-a5ecba98ca7f admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:29.473343 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1064/2089] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:28:29 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 10:28:29.474515 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdb7f44-1af7-4043-846d-296fde9f8894 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:29.487112 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdb7f44-1af7-4043-846d-296fde9f8894 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:29.492246 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e9c1ab-863f-4c96-be75-9e90966fdf33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:29.493018 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e9c1ab-863f-4c96-be75-9e90966fdf33 admin admin] REQUEST_METHOD: `PUT` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:29.493379 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e9c1ab-863f-4c96-be75-9e90966fdf33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:29.493730 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e9c1ab-863f-4c96-be75-9e90966fdf33 admin admin] PATH_INFO: `/v3/projects/87c9f54edfaf4a71bee17bbef5ca9133/users/199e03e4e6324821871d87eb3f792576/roles/5c8b89fae4fa45bd944cbeaf442136e1` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:29.495942 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e9c1ab-863f-4c96-be75-9e90966fdf33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87c9f54edfaf4a71bee17bbef5ca9133, user_id=199e03e4e6324821871d87eb3f792576, role_id=5c8b89fae4fa45bd944cbeaf442136e1)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:29.498697 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e9c1ab-863f-4c96-be75-9e90966fdf33 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:29.511237 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1026/2090] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 19 10:28:29 2022] PUT /identity/v3/projects/87c9f54edfaf4a71bee17bbef5ca9133/users/199e03e4e6324821871d87eb3f792576/roles/5c8b89fae4fa45bd944cbeaf442136e1 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:28:29.522486 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9076c9-aec1-4e41-8ba0-ab1cbe8cd18a None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:29.522775 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9076c9-aec1-4e41-8ba0-ab1cbe8cd18a None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:29.523050 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9076c9-aec1-4e41-8ba0-ab1cbe8cd18a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:29.555386 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-ff9076c9-aec1-4e41-8ba0-ab1cbe8cd18a None None] MFA Rules not processed for user `199e03e4e6324821871d87eb3f792576`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:28:29.556659 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-ff9076c9-aec1-4e41-8ba0-ab1cbe8cd18a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:28:29.637926 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1065/2091] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:28:29 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:28:29.648912 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e9c1ab-863f-4c96-be75-9e90966fdf33 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:29.651525 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-c2e9c1ab-863f-4c96-be75-9e90966fdf33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:28:29.685075 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:28:29.722577 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e9c1ab-863f-4c96-be75-9e90966fdf33 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:29.726339 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eb3ffe-f53a-47b2-8afa-aa92044da020 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa4d004fd44482cae761c4b3bdfab31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:29.727710 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eb3ffe-f53a-47b2-8afa-aa92044da020 service cinder] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:29.727992 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eb3ffe-f53a-47b2-8afa-aa92044da020 service cinder] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:29.728833 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eb3ffe-f53a-47b2-8afa-aa92044da020 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:29.739248 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61eb3ffe-f53a-47b2-8afa-aa92044da020 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:29.740723 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61eb3ffe-f53a-47b2-8afa-aa92044da020 service cinder] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:29.750519 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1027/2092] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:28:29 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:28:30.464720 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9076c9-aec1-4e41-8ba0-ab1cbe8cd18a None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:30.623250 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9076c9-aec1-4e41-8ba0-ab1cbe8cd18a None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:30.644195 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2cae7a-bd24-49b0-b30c-19a49ac0476f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:30.648599 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2cae7a-bd24-49b0-b30c-19a49ac0476f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:30.649996 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2cae7a-bd24-49b0-b30c-19a49ac0476f admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:30.649996 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2cae7a-bd24-49b0-b30c-19a49ac0476f admin admin] PATH_INFO: `/v3/users/2ca03e1b6c6d437c8da3e9536972cd20` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:30.650516 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2cae7a-bd24-49b0-b30c-19a49ac0476f admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ca03e1b6c6d437c8da3e9536972cd20)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:30.655037 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2cae7a-bd24-49b0-b30c-19a49ac0476f admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:30.754790 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:28:30.774528 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-ab2cae7a-bd24-49b0-b30c-19a49ac0476f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ca03e1b6c6d437c8da3e9536972cd20'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:30.796289 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-ab2cae7a-bd24-49b0-b30c-19a49ac0476f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ca03e1b6c6d437c8da3e9536972cd20'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:30.796452 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-ab2cae7a-bd24-49b0-b30c-19a49ac0476f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ca03e1b6c6d437c8da3e9536972cd20'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:30.798023 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-ab2cae7a-bd24-49b0-b30c-19a49ac0476f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ca03e1b6c6d437c8da3e9536972cd20'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:30.812532 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-ab2cae7a-bd24-49b0-b30c-19a49ac0476f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ca03e1b6c6d437c8da3e9536972cd20'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:30.843300 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1066/2093] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 19 10:28:30 2022] DELETE /identity/v3/users/2ca03e1b6c6d437c8da3e9536972cd20 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 10:28:30.847707 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31762607-bccc-4872-8431-280ebe5544be None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:30.848232 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31762607-bccc-4872-8431-280ebe5544be None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:30.848326 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31762607-bccc-4872-8431-280ebe5544be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:30.871348 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-31762607-bccc-4872-8431-280ebe5544be None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:28:30.872567 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-31762607-bccc-4872-8431-280ebe5544be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:28:30.945608 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1028/2094] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:28:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:28:30.957246 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2cae7a-bd24-49b0-b30c-19a49ac0476f admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:30.958721 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-ab2cae7a-bd24-49b0-b30c-19a49ac0476f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:28:31.024413 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2cae7a-bd24-49b0-b30c-19a49ac0476f admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:31.029052 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f0b9b3-33fb-45c6-8d3d-498e6d4a2cd7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c1289b015854c6bb6aee8fed6b807db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:31.029698 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f0b9b3-33fb-45c6-8d3d-498e6d4a2cd7 service neutron] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:31.030018 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f0b9b3-33fb-45c6-8d3d-498e6d4a2cd7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:31.030377 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f0b9b3-33fb-45c6-8d3d-498e6d4a2cd7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:31.040815 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f0b9b3-33fb-45c6-8d3d-498e6d4a2cd7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:31.042402 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f0b9b3-33fb-45c6-8d3d-498e6d4a2cd7 service neutron] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:31.054569 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1067/2095] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:28:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:28:31.329774 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31762607-bccc-4872-8431-280ebe5544be None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:31.331224 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-31762607-bccc-4872-8431-280ebe5544be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:28:31.343281 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31762607-bccc-4872-8431-280ebe5544be None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:31.348022 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5771d08-e092-4370-8873-ef7ee595de40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:31.348704 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5771d08-e092-4370-8873-ef7ee595de40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:31.348988 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5771d08-e092-4370-8873-ef7ee595de40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:31.349264 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5771d08-e092-4370-8873-ef7ee595de40 admin admin] PATH_INFO: `/v3/projects/64541c5045b84669b012a92eaa8806a5` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:31.350393 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5771d08-e092-4370-8873-ef7ee595de40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=64541c5045b84669b012a92eaa8806a5)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:31.352435 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5771d08-e092-4370-8873-ef7ee595de40 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:31.418644 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-d5771d08-e092-4370-8873-ef7ee595de40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64541c5045b84669b012a92eaa8806a5', 'request_id': 'req-d5771d08-e092-4370-8873-ef7ee595de40'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:31.426522 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-d5771d08-e092-4370-8873-ef7ee595de40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64541c5045b84669b012a92eaa8806a5', 'request_id': 'req-d5771d08-e092-4370-8873-ef7ee595de40'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:31.441637 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-d5771d08-e092-4370-8873-ef7ee595de40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64541c5045b84669b012a92eaa8806a5', 'request_id': 'req-d5771d08-e092-4370-8873-ef7ee595de40'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:31.455969 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-d5771d08-e092-4370-8873-ef7ee595de40 admin admin] The token cache is being invalidate because project 64541c5045b84669b012a92eaa8806a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 10:28:31.456313 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-d5771d08-e092-4370-8873-ef7ee595de40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:31.457013 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-d5771d08-e092-4370-8873-ef7ee595de40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:31.458866 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1029/2096] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 19 10:28:31 2022] DELETE /identity/v3/projects/64541c5045b84669b012a92eaa8806a5 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:28:31.462578 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f0b9b3-33fb-45c6-8d3d-498e6d4a2cd7 service neutron] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:31.474789 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f0b9b3-33fb-45c6-8d3d-498e6d4a2cd7 service neutron] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:31.548785 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eae23e7-fc1b-47af-a38c-20485353a835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:31.549419 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eae23e7-fc1b-47af-a38c-20485353a835 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:31.549700 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eae23e7-fc1b-47af-a38c-20485353a835 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:31.549971 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eae23e7-fc1b-47af-a38c-20485353a835 admin admin] PATH_INFO: `/v3/users/199e03e4e6324821871d87eb3f792576` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:31.551102 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eae23e7-fc1b-47af-a38c-20485353a835 admin admin] RBAC: Authorizing `identity:delete_user(user_id=199e03e4e6324821871d87eb3f792576)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:31.553081 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eae23e7-fc1b-47af-a38c-20485353a835 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:31.601069 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-9eae23e7-fc1b-47af-a38c-20485353a835 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '199e03e4e6324821871d87eb3f792576'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:31.604590 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:28:31.609125 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-9eae23e7-fc1b-47af-a38c-20485353a835 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '199e03e4e6324821871d87eb3f792576'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:31.610097 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-9eae23e7-fc1b-47af-a38c-20485353a835 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '199e03e4e6324821871d87eb3f792576'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:31.611044 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-9eae23e7-fc1b-47af-a38c-20485353a835 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '199e03e4e6324821871d87eb3f792576'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:31.619272 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-9eae23e7-fc1b-47af-a38c-20485353a835 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '199e03e4e6324821871d87eb3f792576'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:31.638405 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1068/2097] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 19 10:28:31 2022] DELETE /identity/v3/users/199e03e4e6324821871d87eb3f792576 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 10:28:31.939515 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5771d08-e092-4370-8873-ef7ee595de40 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:31.941473 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-d5771d08-e092-4370-8873-ef7ee595de40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:28:31.958084 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5771d08-e092-4370-8873-ef7ee595de40 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:32.019159 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:28:32.054336 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b4f251-559d-470d-b9d1-0b561c9e7a25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:32.054993 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b4f251-559d-470d-b9d1-0b561c9e7a25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:32.055266 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b4f251-559d-470d-b9d1-0b561c9e7a25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:32.055716 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b4f251-559d-470d-b9d1-0b561c9e7a25 admin admin] PATH_INFO: `/v3/projects/87c9f54edfaf4a71bee17bbef5ca9133` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:32.056990 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b4f251-559d-470d-b9d1-0b561c9e7a25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=87c9f54edfaf4a71bee17bbef5ca9133)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:32.058972 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b4f251-559d-470d-b9d1-0b561c9e7a25 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:32.159890 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-63b4f251-559d-470d-b9d1-0b561c9e7a25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87c9f54edfaf4a71bee17bbef5ca9133', 'request_id': 'req-63b4f251-559d-470d-b9d1-0b561c9e7a25'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:32.168981 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-63b4f251-559d-470d-b9d1-0b561c9e7a25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87c9f54edfaf4a71bee17bbef5ca9133', 'request_id': 'req-63b4f251-559d-470d-b9d1-0b561c9e7a25'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:32.181164 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-63b4f251-559d-470d-b9d1-0b561c9e7a25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87c9f54edfaf4a71bee17bbef5ca9133', 'request_id': 'req-63b4f251-559d-470d-b9d1-0b561c9e7a25'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:32.202634 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-63b4f251-559d-470d-b9d1-0b561c9e7a25 admin admin] The token cache is being invalidate because project 87c9f54edfaf4a71bee17bbef5ca9133 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 10:28:32.203148 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-63b4f251-559d-470d-b9d1-0b561c9e7a25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:32.204034 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-63b4f251-559d-470d-b9d1-0b561c9e7a25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:32.205960 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1030/2098] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 19 10:28:31 2022] DELETE /identity/v3/projects/87c9f54edfaf4a71bee17bbef5ca9133 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:28:32.212609 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00118eb3-e0f6-4005-90be-36efa4add081 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:32.213051 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00118eb3-e0f6-4005-90be-36efa4add081 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:32.214236 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00118eb3-e0f6-4005-90be-36efa4add081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:32.238506 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-00118eb3-e0f6-4005-90be-36efa4add081 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:28:32.239943 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-00118eb3-e0f6-4005-90be-36efa4add081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:28:32.313907 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1069/2099] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:28:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:28:32.322595 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52be0bca-b44f-4f44-8e89-6eb8ee7e9eec None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:32.322882 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52be0bca-b44f-4f44-8e89-6eb8ee7e9eec None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:32.323153 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52be0bca-b44f-4f44-8e89-6eb8ee7e9eec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:32.344257 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-52be0bca-b44f-4f44-8e89-6eb8ee7e9eec None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:28:32.345589 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-52be0bca-b44f-4f44-8e89-6eb8ee7e9eec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:28:32.355677 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1031/2100] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:28:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:28:32.360063 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00118eb3-e0f6-4005-90be-36efa4add081 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:32.372034 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00118eb3-e0f6-4005-90be-36efa4add081 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:32.377160 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faee6d73-e8bb-4e9d-a06a-ce123c7f1197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:32.377830 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faee6d73-e8bb-4e9d-a06a-ce123c7f1197 admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:32.378109 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faee6d73-e8bb-4e9d-a06a-ce123c7f1197 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:32.378382 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faee6d73-e8bb-4e9d-a06a-ce123c7f1197 admin admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:32.379036 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faee6d73-e8bb-4e9d-a06a-ce123c7f1197 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:28:32.379339 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faee6d73-e8bb-4e9d-a06a-ce123c7f1197 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:32.380979 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faee6d73-e8bb-4e9d-a06a-ce123c7f1197 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:32.396911 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1070/2101] 10.222.0.66 () {58 vars in 1153 bytes} [Mon Sep 19 10:28:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:28:32.398019 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52be0bca-b44f-4f44-8e89-6eb8ee7e9eec None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:32.408129 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52be0bca-b44f-4f44-8e89-6eb8ee7e9eec None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:32.413058 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf66f94-14eb-4c2a-8eaa-7e8c8622d8cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:32.413693 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf66f94-14eb-4c2a-8eaa-7e8c8622d8cf admin admin] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:32.413991 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf66f94-14eb-4c2a-8eaa-7e8c8622d8cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:32.414260 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf66f94-14eb-4c2a-8eaa-7e8c8622d8cf admin admin] PATH_INFO: `/v3/projects` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:32.414915 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf66f94-14eb-4c2a-8eaa-7e8c8622d8cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:32.417522 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf66f94-14eb-4c2a-8eaa-7e8c8622d8cf admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:32.445632 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1032/2102] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 19 10:28:32 2022] POST /identity/v3/projects => generated 383 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 10:28:32.450628 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faee6d73-e8bb-4e9d-a06a-ce123c7f1197 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:32.462325 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faee6d73-e8bb-4e9d-a06a-ce123c7f1197 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:32.524721 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9109eba-b661-47c9-94f9-33c8dc9085b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:32.525426 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9109eba-b661-47c9-94f9-33c8dc9085b1 admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:32.525654 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9109eba-b661-47c9-94f9-33c8dc9085b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:32.526470 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9109eba-b661-47c9-94f9-33c8dc9085b1 admin admin] PATH_INFO: `/v3/users` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:32.527179 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9109eba-b661-47c9-94f9-33c8dc9085b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:32.529369 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9109eba-b661-47c9-94f9-33c8dc9085b1 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:32.552139 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1071/2103] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 19 10:28:32 2022] POST /identity/v3/users => generated 292 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:28:32.557444 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf66f94-14eb-4c2a-8eaa-7e8c8622d8cf admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:32.569883 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf66f94-14eb-4c2a-8eaa-7e8c8622d8cf admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:32.581650 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d158d14-f91f-4ba8-87f2-f1b350b87eef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:32.583718 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d158d14-f91f-4ba8-87f2-f1b350b87eef admin admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:32.583718 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d158d14-f91f-4ba8-87f2-f1b350b87eef admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:32.583718 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d158d14-f91f-4ba8-87f2-f1b350b87eef admin admin] PATH_INFO: `/v3/roles` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:32.583718 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d158d14-f91f-4ba8-87f2-f1b350b87eef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:32.585122 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d158d14-f91f-4ba8-87f2-f1b350b87eef admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:32.597043 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1033/2104] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:28:32 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 10:28:32.602113 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9109eba-b661-47c9-94f9-33c8dc9085b1 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:32.613780 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9109eba-b661-47c9-94f9-33c8dc9085b1 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:32.621186 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef0fa31-fc97-4249-9fda-78d135eeb6c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:32.621946 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef0fa31-fc97-4249-9fda-78d135eeb6c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:32.622392 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef0fa31-fc97-4249-9fda-78d135eeb6c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:32.622703 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef0fa31-fc97-4249-9fda-78d135eeb6c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:32.623448 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef0fa31-fc97-4249-9fda-78d135eeb6c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:32.625212 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef0fa31-fc97-4249-9fda-78d135eeb6c5 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:32.640661 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1072/2105] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:28:32 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 10:28:32.643087 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d158d14-f91f-4ba8-87f2-f1b350b87eef admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:32.656339 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d158d14-f91f-4ba8-87f2-f1b350b87eef admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:32.662296 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ac5977-5f2e-4910-922e-da275e600781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:32.662982 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ac5977-5f2e-4910-922e-da275e600781 admin admin] REQUEST_METHOD: `PUT` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:32.663412 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ac5977-5f2e-4910-922e-da275e600781 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:32.663816 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ac5977-5f2e-4910-922e-da275e600781 admin admin] PATH_INFO: `/v3/projects/fba4c72bafeb46a58a4db385b6a1f043/users/e41d62d37f2c45b6bff0a3ce5752bc41/roles/cd5b42ed3b754b58817a62bbe74651b4` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:32.698618 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ac5977-5f2e-4910-922e-da275e600781 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fba4c72bafeb46a58a4db385b6a1f043, user_id=e41d62d37f2c45b6bff0a3ce5752bc41, role_id=cd5b42ed3b754b58817a62bbe74651b4)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:32.701884 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ac5977-5f2e-4910-922e-da275e600781 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:32.732074 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1034/2106] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 19 10:28:32 2022] PUT /identity/v3/projects/fba4c72bafeb46a58a4db385b6a1f043/users/e41d62d37f2c45b6bff0a3ce5752bc41/roles/cd5b42ed3b754b58817a62bbe74651b4 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:28:32.743885 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1758b37b-1ac5-4b3a-aa68-74847925b4e0 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:32.744528 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1758b37b-1ac5-4b3a-aa68-74847925b4e0 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:32.745094 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1758b37b-1ac5-4b3a-aa68-74847925b4e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:32.784024 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-1758b37b-1ac5-4b3a-aa68-74847925b4e0 None None] MFA Rules not processed for user `e41d62d37f2c45b6bff0a3ce5752bc41`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:28:32.785390 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-1758b37b-1ac5-4b3a-aa68-74847925b4e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:28:32.812211 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:28:32.865454 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1073/2107] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:28:32 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:28:32.875899 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ac5977-5f2e-4910-922e-da275e600781 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:32.877760 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-99ac5977-5f2e-4910-922e-da275e600781 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:28:32.980230 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ac5977-5f2e-4910-922e-da275e600781 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:32.986240 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ede8a4-b432-481b-8f50-a275bb2936a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa4d004fd44482cae761c4b3bdfab31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:32.987335 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ede8a4-b432-481b-8f50-a275bb2936a0 service cinder] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:32.987803 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ede8a4-b432-481b-8f50-a275bb2936a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:32.988086 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ede8a4-b432-481b-8f50-a275bb2936a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:33.000634 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ede8a4-b432-481b-8f50-a275bb2936a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:33.002084 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ede8a4-b432-481b-8f50-a275bb2936a0 service cinder] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:33.013283 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1035/2108] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:28:32 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:28:33.427392 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1758b37b-1ac5-4b3a-aa68-74847925b4e0 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:33.429054 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-1758b37b-1ac5-4b3a-aa68-74847925b4e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:28:33.506434 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1758b37b-1ac5-4b3a-aa68-74847925b4e0 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:33.511367 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fb16e6-7ce7-4df9-9c67-d4954b83ce44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:33.512075 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fb16e6-7ce7-4df9-9c67-d4954b83ce44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:33.512388 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fb16e6-7ce7-4df9-9c67-d4954b83ce44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:33.512661 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fb16e6-7ce7-4df9-9c67-d4954b83ce44 admin admin] PATH_INFO: `/v3/users/3a8afb9d99194b4bb8ac9c63f9896259` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:33.513814 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fb16e6-7ce7-4df9-9c67-d4954b83ce44 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a8afb9d99194b4bb8ac9c63f9896259)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:33.515909 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fb16e6-7ce7-4df9-9c67-d4954b83ce44 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:33.568304 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-d6fb16e6-7ce7-4df9-9c67-d4954b83ce44 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a8afb9d99194b4bb8ac9c63f9896259'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:33.577224 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-d6fb16e6-7ce7-4df9-9c67-d4954b83ce44 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a8afb9d99194b4bb8ac9c63f9896259'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:33.577871 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-d6fb16e6-7ce7-4df9-9c67-d4954b83ce44 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a8afb9d99194b4bb8ac9c63f9896259'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:33.578571 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-d6fb16e6-7ce7-4df9-9c67-d4954b83ce44 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a8afb9d99194b4bb8ac9c63f9896259'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:33.585776 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-d6fb16e6-7ce7-4df9-9c67-d4954b83ce44 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a8afb9d99194b4bb8ac9c63f9896259'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:33.607068 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1074/2109] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 19 10:28:33 2022] DELETE /identity/v3/users/3a8afb9d99194b4bb8ac9c63f9896259 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:28:33.608735 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5c441d-f574-44f0-b5b0-0d15fe14f4ee None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:33.609071 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5c441d-f574-44f0-b5b0-0d15fe14f4ee None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:33.609346 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5c441d-f574-44f0-b5b0-0d15fe14f4ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:33.629049 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-2a5c441d-f574-44f0-b5b0-0d15fe14f4ee None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:28:33.631130 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-2a5c441d-f574-44f0-b5b0-0d15fe14f4ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:28:33.645220 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:28:33.704594 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1036/2110] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:28:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 10:28:33.714591 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fb16e6-7ce7-4df9-9c67-d4954b83ce44 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:33.716024 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-d6fb16e6-7ce7-4df9-9c67-d4954b83ce44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:28:33.773208 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:28:33.786094 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fb16e6-7ce7-4df9-9c67-d4954b83ce44 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:33.791464 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46f597d-e764-4a96-b2af-775cb4e84efd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c1289b015854c6bb6aee8fed6b807db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:33.792410 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46f597d-e764-4a96-b2af-775cb4e84efd service neutron] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:33.792910 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46f597d-e764-4a96-b2af-775cb4e84efd service neutron] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:33.793373 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46f597d-e764-4a96-b2af-775cb4e84efd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:33.808598 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46f597d-e764-4a96-b2af-775cb4e84efd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:33.810500 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46f597d-e764-4a96-b2af-775cb4e84efd service neutron] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:33.823742 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1075/2111] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:28:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:28:34.116778 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5c441d-f574-44f0-b5b0-0d15fe14f4ee None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:34.118816 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-2a5c441d-f574-44f0-b5b0-0d15fe14f4ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:28:34.137612 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5c441d-f574-44f0-b5b0-0d15fe14f4ee None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:34.145336 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7e1a7b-4dc6-4dff-ade6-451034b327b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:34.146163 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7e1a7b-4dc6-4dff-ade6-451034b327b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:34.146473 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7e1a7b-4dc6-4dff-ade6-451034b327b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:34.146825 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7e1a7b-4dc6-4dff-ade6-451034b327b2 admin admin] PATH_INFO: `/v3/projects/a3194b9cdb2a4304ab1929c079b9ad59` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:34.148237 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7e1a7b-4dc6-4dff-ade6-451034b327b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3194b9cdb2a4304ab1929c079b9ad59)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:34.150252 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7e1a7b-4dc6-4dff-ade6-451034b327b2 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:34.205846 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-de7e1a7b-4dc6-4dff-ade6-451034b327b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3194b9cdb2a4304ab1929c079b9ad59', 'request_id': 'req-de7e1a7b-4dc6-4dff-ade6-451034b327b2'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:34.212724 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-de7e1a7b-4dc6-4dff-ade6-451034b327b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3194b9cdb2a4304ab1929c079b9ad59', 'request_id': 'req-de7e1a7b-4dc6-4dff-ade6-451034b327b2'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:34.226000 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-de7e1a7b-4dc6-4dff-ade6-451034b327b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3194b9cdb2a4304ab1929c079b9ad59', 'request_id': 'req-de7e1a7b-4dc6-4dff-ade6-451034b327b2'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:34.245004 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-de7e1a7b-4dc6-4dff-ade6-451034b327b2 admin admin] The token cache is being invalidate because project a3194b9cdb2a4304ab1929c079b9ad59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 10:28:34.245525 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-de7e1a7b-4dc6-4dff-ade6-451034b327b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:34.246588 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-de7e1a7b-4dc6-4dff-ade6-451034b327b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:34.250311 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1037/2112] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 19 10:28:34 2022] DELETE /identity/v3/projects/a3194b9cdb2a4304ab1929c079b9ad59 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:28:34.254184 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46f597d-e764-4a96-b2af-775cb4e84efd service neutron] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:34.264449 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46f597d-e764-4a96-b2af-775cb4e84efd service neutron] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:34.333310 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc6f2ef-9ed9-4c66-867e-9098288386b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:34.333951 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc6f2ef-9ed9-4c66-867e-9098288386b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:34.334231 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc6f2ef-9ed9-4c66-867e-9098288386b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:34.334501 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc6f2ef-9ed9-4c66-867e-9098288386b5 admin admin] PATH_INFO: `/v3/users/b463b4aa3acd453cb45e6ddf7c582854` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:34.335636 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc6f2ef-9ed9-4c66-867e-9098288386b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b463b4aa3acd453cb45e6ddf7c582854)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:34.337726 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc6f2ef-9ed9-4c66-867e-9098288386b5 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:34.392900 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-8fc6f2ef-9ed9-4c66-867e-9098288386b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b463b4aa3acd453cb45e6ddf7c582854'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:34.404827 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-8fc6f2ef-9ed9-4c66-867e-9098288386b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b463b4aa3acd453cb45e6ddf7c582854'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:34.405698 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-8fc6f2ef-9ed9-4c66-867e-9098288386b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b463b4aa3acd453cb45e6ddf7c582854'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:34.407600 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-8fc6f2ef-9ed9-4c66-867e-9098288386b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b463b4aa3acd453cb45e6ddf7c582854'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:34.421196 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-8fc6f2ef-9ed9-4c66-867e-9098288386b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b463b4aa3acd453cb45e6ddf7c582854'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:34.443636 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1076/2113] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 19 10:28:34 2022] DELETE /identity/v3/users/b463b4aa3acd453cb45e6ddf7c582854 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:28:34.891912 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7e1a7b-4dc6-4dff-ade6-451034b327b2 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:34.895070 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-de7e1a7b-4dc6-4dff-ade6-451034b327b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:28:34.911349 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7e1a7b-4dc6-4dff-ade6-451034b327b2 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:34.991964 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aae8cb6-2623-4d9b-8fc0-134ea121e585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:34.993159 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aae8cb6-2623-4d9b-8fc0-134ea121e585 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:34.993159 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aae8cb6-2623-4d9b-8fc0-134ea121e585 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:34.993159 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aae8cb6-2623-4d9b-8fc0-134ea121e585 admin admin] PATH_INFO: `/v3/projects/459be25bb5f54205a32ae6d2d4dbdb0c` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:34.994394 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aae8cb6-2623-4d9b-8fc0-134ea121e585 admin admin] RBAC: Authorizing `identity:delete_project(project_id=459be25bb5f54205a32ae6d2d4dbdb0c)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:34.996719 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aae8cb6-2623-4d9b-8fc0-134ea121e585 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:35.091151 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:28:35.099221 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-6aae8cb6-2623-4d9b-8fc0-134ea121e585 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '459be25bb5f54205a32ae6d2d4dbdb0c', 'request_id': 'req-6aae8cb6-2623-4d9b-8fc0-134ea121e585'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:35.112875 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-6aae8cb6-2623-4d9b-8fc0-134ea121e585 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '459be25bb5f54205a32ae6d2d4dbdb0c', 'request_id': 'req-6aae8cb6-2623-4d9b-8fc0-134ea121e585'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:35.127083 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-6aae8cb6-2623-4d9b-8fc0-134ea121e585 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '459be25bb5f54205a32ae6d2d4dbdb0c', 'request_id': 'req-6aae8cb6-2623-4d9b-8fc0-134ea121e585'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:35.140015 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-6aae8cb6-2623-4d9b-8fc0-134ea121e585 admin admin] The token cache is being invalidate because project 459be25bb5f54205a32ae6d2d4dbdb0c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 10:28:35.140331 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-6aae8cb6-2623-4d9b-8fc0-134ea121e585 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:35.141276 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-6aae8cb6-2623-4d9b-8fc0-134ea121e585 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:35.143441 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1038/2114] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 19 10:28:34 2022] DELETE /identity/v3/projects/459be25bb5f54205a32ae6d2d4dbdb0c => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:28:35.147568 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc6f2ef-9ed9-4c66-867e-9098288386b5 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:35.149122 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-8fc6f2ef-9ed9-4c66-867e-9098288386b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:28:35.175719 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc6f2ef-9ed9-4c66-867e-9098288386b5 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:35.248247 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7392c7d0-a0ab-4b7b-8e49-463f86c6f437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:35.249428 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7392c7d0-a0ab-4b7b-8e49-463f86c6f437 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:35.249901 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7392c7d0-a0ab-4b7b-8e49-463f86c6f437 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:35.250362 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7392c7d0-a0ab-4b7b-8e49-463f86c6f437 admin admin] PATH_INFO: `/v3/users/a15c10690bf9410184315069818bd9d1` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:35.252524 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7392c7d0-a0ab-4b7b-8e49-463f86c6f437 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a15c10690bf9410184315069818bd9d1)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:35.254860 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7392c7d0-a0ab-4b7b-8e49-463f86c6f437 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:35.263002 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:28:35.324720 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-7392c7d0-a0ab-4b7b-8e49-463f86c6f437 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a15c10690bf9410184315069818bd9d1'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:35.333150 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-7392c7d0-a0ab-4b7b-8e49-463f86c6f437 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a15c10690bf9410184315069818bd9d1'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:35.333816 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-7392c7d0-a0ab-4b7b-8e49-463f86c6f437 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a15c10690bf9410184315069818bd9d1'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:35.334429 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-7392c7d0-a0ab-4b7b-8e49-463f86c6f437 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a15c10690bf9410184315069818bd9d1'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:35.341923 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-7392c7d0-a0ab-4b7b-8e49-463f86c6f437 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a15c10690bf9410184315069818bd9d1'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:35.361933 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1077/2115] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 19 10:28:35 2022] DELETE /identity/v3/users/a15c10690bf9410184315069818bd9d1 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:28:35.702794 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aae8cb6-2623-4d9b-8fc0-134ea121e585 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:35.704420 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-6aae8cb6-2623-4d9b-8fc0-134ea121e585 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:28:35.720143 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aae8cb6-2623-4d9b-8fc0-134ea121e585 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:35.782932 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e89767-a806-4da2-ab06-8da9ca6508d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:35.783579 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e89767-a806-4da2-ab06-8da9ca6508d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:35.783839 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e89767-a806-4da2-ab06-8da9ca6508d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:35.784109 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e89767-a806-4da2-ab06-8da9ca6508d1 admin admin] PATH_INFO: `/v3/projects/66840ae8d171487cac9c3bdf75bde603` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:35.785284 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e89767-a806-4da2-ab06-8da9ca6508d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=66840ae8d171487cac9c3bdf75bde603)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:35.787201 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e89767-a806-4da2-ab06-8da9ca6508d1 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:35.853664 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-a5e89767-a806-4da2-ab06-8da9ca6508d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66840ae8d171487cac9c3bdf75bde603', 'request_id': 'req-a5e89767-a806-4da2-ab06-8da9ca6508d1'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:35.863851 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-a5e89767-a806-4da2-ab06-8da9ca6508d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66840ae8d171487cac9c3bdf75bde603', 'request_id': 'req-a5e89767-a806-4da2-ab06-8da9ca6508d1'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:35.881650 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-a5e89767-a806-4da2-ab06-8da9ca6508d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66840ae8d171487cac9c3bdf75bde603', 'request_id': 'req-a5e89767-a806-4da2-ab06-8da9ca6508d1'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:35.898828 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-a5e89767-a806-4da2-ab06-8da9ca6508d1 admin admin] The token cache is being invalidate because project 66840ae8d171487cac9c3bdf75bde603 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 10:28:35.899152 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-a5e89767-a806-4da2-ab06-8da9ca6508d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:35.900037 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-a5e89767-a806-4da2-ab06-8da9ca6508d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:35.905937 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1039/2116] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 19 10:28:35 2022] DELETE /identity/v3/projects/66840ae8d171487cac9c3bdf75bde603 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:28:35.907707 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcc44ed-ccd1-47ab-b6b5-9c64c3d87e77 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:35.908008 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcc44ed-ccd1-47ab-b6b5-9c64c3d87e77 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:35.908316 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcc44ed-ccd1-47ab-b6b5-9c64c3d87e77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:35.934380 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-0dcc44ed-ccd1-47ab-b6b5-9c64c3d87e77 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:28:35.936375 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-0dcc44ed-ccd1-47ab-b6b5-9c64c3d87e77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:28:36.058369 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1078/2117] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:28:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 10:28:36.059490 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e708e9a9-3442-460f-ba80-98d0fb0c8603 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:36.059854 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e708e9a9-3442-460f-ba80-98d0fb0c8603 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:36.060582 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e708e9a9-3442-460f-ba80-98d0fb0c8603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:36.106663 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-e708e9a9-3442-460f-ba80-98d0fb0c8603 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:28:36.109758 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-e708e9a9-3442-460f-ba80-98d0fb0c8603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:28:36.153524 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1040/2118] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:28:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 10:28:36.158403 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcc44ed-ccd1-47ab-b6b5-9c64c3d87e77 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:36.173195 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcc44ed-ccd1-47ab-b6b5-9c64c3d87e77 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:36.189293 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cd92e8-a05e-43fb-9c56-8e43c618e0ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:36.190483 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cd92e8-a05e-43fb-9c56-8e43c618e0ad admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:36.191646 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cd92e8-a05e-43fb-9c56-8e43c618e0ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:36.191933 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cd92e8-a05e-43fb-9c56-8e43c618e0ad admin admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:36.192639 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cd92e8-a05e-43fb-9c56-8e43c618e0ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:28:36.192948 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cd92e8-a05e-43fb-9c56-8e43c618e0ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:36.194580 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cd92e8-a05e-43fb-9c56-8e43c618e0ad admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:36.221024 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1079/2119] 10.222.0.66 () {58 vars in 1153 bytes} [Mon Sep 19 10:28:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:28:36.222811 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e708e9a9-3442-460f-ba80-98d0fb0c8603 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:36.247047 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e708e9a9-3442-460f-ba80-98d0fb0c8603 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:36.267286 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a0de3d-2ccb-4978-83e1-1e4aa9b5dac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:36.268535 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a0de3d-2ccb-4978-83e1-1e4aa9b5dac5 admin admin] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:36.271521 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a0de3d-2ccb-4978-83e1-1e4aa9b5dac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:36.273128 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a0de3d-2ccb-4978-83e1-1e4aa9b5dac5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:36.274117 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a0de3d-2ccb-4978-83e1-1e4aa9b5dac5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:36.276435 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a0de3d-2ccb-4978-83e1-1e4aa9b5dac5 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:36.351841 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1041/2120] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 19 10:28:36 2022] POST /identity/v3/projects => generated 365 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:28:36.353369 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cd92e8-a05e-43fb-9c56-8e43c618e0ad admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:36.369874 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cd92e8-a05e-43fb-9c56-8e43c618e0ad admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:36.580945 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47243f6f-c342-416c-a646-2f11479081bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:36.581585 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47243f6f-c342-416c-a646-2f11479081bf admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:36.581888 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47243f6f-c342-416c-a646-2f11479081bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:36.582144 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47243f6f-c342-416c-a646-2f11479081bf admin admin] PATH_INFO: `/v3/users` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:36.582886 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47243f6f-c342-416c-a646-2f11479081bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:36.585572 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47243f6f-c342-416c-a646-2f11479081bf admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:36.618107 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1080/2121] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 19 10:28:36 2022] POST /identity/v3/users => generated 283 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:28:36.623412 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a0de3d-2ccb-4978-83e1-1e4aa9b5dac5 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:36.637807 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a0de3d-2ccb-4978-83e1-1e4aa9b5dac5 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:36.654249 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45292af-88b8-46a0-954e-d31c6ece1696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:36.655464 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45292af-88b8-46a0-954e-d31c6ece1696 admin admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:36.655745 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45292af-88b8-46a0-954e-d31c6ece1696 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:36.656017 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45292af-88b8-46a0-954e-d31c6ece1696 admin admin] PATH_INFO: `/v3/roles` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:36.656725 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45292af-88b8-46a0-954e-d31c6ece1696 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:36.658573 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45292af-88b8-46a0-954e-d31c6ece1696 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:36.677292 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1042/2122] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:28:36 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 10:28:36.678935 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47243f6f-c342-416c-a646-2f11479081bf admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:36.684552 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:28:36.694039 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47243f6f-c342-416c-a646-2f11479081bf admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:36.701181 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86837295-06b8-4b42-b5c6-af82ae87bcd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:36.701967 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86837295-06b8-4b42-b5c6-af82ae87bcd9 admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:36.702340 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86837295-06b8-4b42-b5c6-af82ae87bcd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:36.702729 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86837295-06b8-4b42-b5c6-af82ae87bcd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:36.703450 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86837295-06b8-4b42-b5c6-af82ae87bcd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:36.705175 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86837295-06b8-4b42-b5c6-af82ae87bcd9 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:36.721009 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1081/2123] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:28:36 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 10:28:36.722111 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45292af-88b8-46a0-954e-d31c6ece1696 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:36.734551 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45292af-88b8-46a0-954e-d31c6ece1696 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:36.739415 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0f9cf0-1fb0-4e6c-b9d5-1f70f88c3841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:36.740051 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0f9cf0-1fb0-4e6c-b9d5-1f70f88c3841 admin admin] REQUEST_METHOD: `PUT` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:36.740380 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0f9cf0-1fb0-4e6c-b9d5-1f70f88c3841 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:36.740661 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0f9cf0-1fb0-4e6c-b9d5-1f70f88c3841 admin admin] PATH_INFO: `/v3/projects/017b64a98d8d4481ab52471ed4ad953d/users/de5bebe61f9b4e0aa23c07e2fdf3cc3d/roles/cd5b42ed3b754b58817a62bbe74651b4` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:36.757761 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0f9cf0-1fb0-4e6c-b9d5-1f70f88c3841 admin admin] RBAC: Authorizing `identity:create_grant(project_id=017b64a98d8d4481ab52471ed4ad953d, user_id=de5bebe61f9b4e0aa23c07e2fdf3cc3d, role_id=cd5b42ed3b754b58817a62bbe74651b4)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:36.765441 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0f9cf0-1fb0-4e6c-b9d5-1f70f88c3841 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:36.776840 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:DELETE=11,keystone:SELECT=85,keystone:INSERT=4 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:28:36.785425 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1043/2124] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 19 10:28:36 2022] PUT /identity/v3/projects/017b64a98d8d4481ab52471ed4ad953d/users/de5bebe61f9b4e0aa23c07e2fdf3cc3d/roles/cd5b42ed3b754b58817a62bbe74651b4 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:28:36.795880 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1355be-5121-4a68-9a8e-32fdcda43f7a None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:36.796274 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1355be-5121-4a68-9a8e-32fdcda43f7a None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:36.796556 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1355be-5121-4a68-9a8e-32fdcda43f7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:36.830993 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-5d1355be-5121-4a68-9a8e-32fdcda43f7a None None] MFA Rules not processed for user `de5bebe61f9b4e0aa23c07e2fdf3cc3d`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:28:36.836137 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-5d1355be-5121-4a68-9a8e-32fdcda43f7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:28:36.913647 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1082/2125] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:28:36 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:28:36.929323 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0f9cf0-1fb0-4e6c-b9d5-1f70f88c3841 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:36.931140 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-2c0f9cf0-1fb0-4e6c-b9d5-1f70f88c3841 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:28:36.941943 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a0a6e8-2a74-445f-a361-e4ce094176be None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:36.942729 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a0a6e8-2a74-445f-a361-e4ce094176be None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:36.943100 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a0a6e8-2a74-445f-a361-e4ce094176be None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:36.945031 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1083/2126] 10.222.0.66 () {54 vars in 921 bytes} [Mon Sep 19 10:28:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 10:28:36.955932 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263a923a-9c2c-463f-b749-f560a69f6a6b None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:36.956263 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263a923a-9c2c-463f-b749-f560a69f6a6b None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:36.956544 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263a923a-9c2c-463f-b749-f560a69f6a6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:36.977955 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-263a923a-9c2c-463f-b749-f560a69f6a6b None None] MFA Rules not processed for user `46b78120cac64f09bd0f4cdc42424163`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:28:36.979227 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-263a923a-9c2c-463f-b749-f560a69f6a6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:28:36.990344 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0f9cf0-1fb0-4e6c-b9d5-1f70f88c3841 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:36.994882 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699f7dd3-cd77-4258-805a-9cc4e661cc9b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa4d004fd44482cae761c4b3bdfab31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:36.995498 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699f7dd3-cd77-4258-805a-9cc4e661cc9b service cinder] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:36.995777 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699f7dd3-cd77-4258-805a-9cc4e661cc9b service cinder] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:36.996057 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699f7dd3-cd77-4258-805a-9cc4e661cc9b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:37.006514 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699f7dd3-cd77-4258-805a-9cc4e661cc9b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:37.008081 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699f7dd3-cd77-4258-805a-9cc4e661cc9b service cinder] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:37.024011 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1044/2127] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:28:36 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:28:37.024960 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699f7dd3-cd77-4258-805a-9cc4e661cc9b service cinder] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:37.028313 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-699f7dd3-cd77-4258-805a-9cc4e661cc9b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:28:37.061046 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1084/2128] 10.222.0.66 () {58 vars in 1018 bytes} [Mon Sep 19 10:28:36 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 10:28:37.075191 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263a923a-9c2c-463f-b749-f560a69f6a6b None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:37.077620 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-263a923a-9c2c-463f-b749-f560a69f6a6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:28:37.102391 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263a923a-9c2c-463f-b749-f560a69f6a6b None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:37.109986 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6affa3-ea8f-4ce4-96ee-ddcff766b027 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46b78120cac64f09bd0f4cdc42424163', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:37.111569 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6affa3-ea8f-4ce4-96ee-ddcff766b027 service placement] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:37.111859 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6affa3-ea8f-4ce4-96ee-ddcff766b027 service placement] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:37.112136 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6affa3-ea8f-4ce4-96ee-ddcff766b027 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:37.121989 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6affa3-ea8f-4ce4-96ee-ddcff766b027 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:37.123628 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6affa3-ea8f-4ce4-96ee-ddcff766b027 service placement] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:37.124710 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699f7dd3-cd77-4258-805a-9cc4e661cc9b service cinder] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:37.133023 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085c74bf-6d4c-471a-a475-6085d25966ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:37.137110 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085c74bf-6d4c-471a-a475-6085d25966ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:37.138148 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1085/2129] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:28:37 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 10:28:37.140279 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085c74bf-6d4c-471a-a475-6085d25966ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:37.156619 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085c74bf-6d4c-471a-a475-6085d25966ce admin admin] PATH_INFO: `/v3/users/28727f7a16614b55b4df3e05b6b42be5` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:37.158834 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085c74bf-6d4c-471a-a475-6085d25966ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=28727f7a16614b55b4df3e05b6b42be5)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:37.162096 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085c74bf-6d4c-471a-a475-6085d25966ce admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:37.247864 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-085c74bf-6d4c-471a-a475-6085d25966ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28727f7a16614b55b4df3e05b6b42be5'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:37.265506 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-085c74bf-6d4c-471a-a475-6085d25966ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28727f7a16614b55b4df3e05b6b42be5'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:37.266891 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-085c74bf-6d4c-471a-a475-6085d25966ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28727f7a16614b55b4df3e05b6b42be5'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:37.268108 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-085c74bf-6d4c-471a-a475-6085d25966ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28727f7a16614b55b4df3e05b6b42be5'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:37.281546 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-085c74bf-6d4c-471a-a475-6085d25966ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28727f7a16614b55b4df3e05b6b42be5'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:37.317996 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1045/2130] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 19 10:28:37 2022] DELETE /identity/v3/users/28727f7a16614b55b4df3e05b6b42be5 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:28:37.491748 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6affa3-ea8f-4ce4-96ee-ddcff766b027 service placement] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:37.534838 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6affa3-ea8f-4ce4-96ee-ddcff766b027 service placement] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:37.604683 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79aaf77-1572-47e9-8f34-e9907d2d3cc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:37.605590 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79aaf77-1572-47e9-8f34-e9907d2d3cc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:37.606058 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79aaf77-1572-47e9-8f34-e9907d2d3cc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:37.606515 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79aaf77-1572-47e9-8f34-e9907d2d3cc6 admin admin] PATH_INFO: `/v3/projects/adb52f925ee84e5381450dd64b6c8d91` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:37.607701 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79aaf77-1572-47e9-8f34-e9907d2d3cc6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=adb52f925ee84e5381450dd64b6c8d91)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:37.609965 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79aaf77-1572-47e9-8f34-e9907d2d3cc6 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:37.616742 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:28:37.673709 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-f79aaf77-1572-47e9-8f34-e9907d2d3cc6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'adb52f925ee84e5381450dd64b6c8d91', 'request_id': 'req-f79aaf77-1572-47e9-8f34-e9907d2d3cc6'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:37.688816 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-f79aaf77-1572-47e9-8f34-e9907d2d3cc6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'adb52f925ee84e5381450dd64b6c8d91', 'request_id': 'req-f79aaf77-1572-47e9-8f34-e9907d2d3cc6'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:37.697640 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-f79aaf77-1572-47e9-8f34-e9907d2d3cc6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'adb52f925ee84e5381450dd64b6c8d91', 'request_id': 'req-f79aaf77-1572-47e9-8f34-e9907d2d3cc6'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:37.710015 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-f79aaf77-1572-47e9-8f34-e9907d2d3cc6 admin admin] The token cache is being invalidate because project adb52f925ee84e5381450dd64b6c8d91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 10:28:37.710350 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-f79aaf77-1572-47e9-8f34-e9907d2d3cc6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:37.711033 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-f79aaf77-1572-47e9-8f34-e9907d2d3cc6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:37.712701 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1086/2131] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 19 10:28:37 2022] DELETE /identity/v3/projects/adb52f925ee84e5381450dd64b6c8d91 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:28:37.717554 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9b4462-4d4e-42de-9611-48bdb66e9c47 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:37.717903 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9b4462-4d4e-42de-9611-48bdb66e9c47 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:37.718246 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9b4462-4d4e-42de-9611-48bdb66e9c47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:37.739331 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-5f9b4462-4d4e-42de-9611-48bdb66e9c47 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:28:37.740741 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-5f9b4462-4d4e-42de-9611-48bdb66e9c47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:28:37.758544 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:28:37.803090 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1046/2132] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:28:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 10:28:37.811364 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c56e48-457f-4821-95cf-f58b94070f7b None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:37.811647 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c56e48-457f-4821-95cf-f58b94070f7b None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:37.811926 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c56e48-457f-4821-95cf-f58b94070f7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:37.831822 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-a0c56e48-457f-4821-95cf-f58b94070f7b None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:28:37.833095 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-a0c56e48-457f-4821-95cf-f58b94070f7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:28:37.841523 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1087/2133] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:28:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:28:37.845866 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9b4462-4d4e-42de-9611-48bdb66e9c47 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:37.856557 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9b4462-4d4e-42de-9611-48bdb66e9c47 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:37.861150 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6ce58a-d2cd-4d5e-8e53-ad997e9a5662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:37.861748 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6ce58a-d2cd-4d5e-8e53-ad997e9a5662 admin admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:37.862033 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6ce58a-d2cd-4d5e-8e53-ad997e9a5662 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:37.862308 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6ce58a-d2cd-4d5e-8e53-ad997e9a5662 admin admin] PATH_INFO: `/v3/domains` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:37.862950 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6ce58a-d2cd-4d5e-8e53-ad997e9a5662 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:28:37.863252 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6ce58a-d2cd-4d5e-8e53-ad997e9a5662 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:37.864916 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6ce58a-d2cd-4d5e-8e53-ad997e9a5662 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:37.880647 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1047/2134] 10.222.0.66 () {58 vars in 1153 bytes} [Mon Sep 19 10:28:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:28:37.881739 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c56e48-457f-4821-95cf-f58b94070f7b None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:37.891539 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c56e48-457f-4821-95cf-f58b94070f7b None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:37.896630 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3fd2b0-b9f5-497a-848c-726616cee4ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:37.897246 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3fd2b0-b9f5-497a-848c-726616cee4ae admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:37.897526 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3fd2b0-b9f5-497a-848c-726616cee4ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:37.897801 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3fd2b0-b9f5-497a-848c-726616cee4ae admin admin] PATH_INFO: `/v3/projects` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:37.898436 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3fd2b0-b9f5-497a-848c-726616cee4ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:37.900426 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3fd2b0-b9f5-497a-848c-726616cee4ae admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:37.934469 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1088/2135] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 19 10:28:37 2022] POST /identity/v3/projects => generated 381 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:28:37.938885 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6ce58a-d2cd-4d5e-8e53-ad997e9a5662 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:37.951287 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6ce58a-d2cd-4d5e-8e53-ad997e9a5662 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:38.014298 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0ab353-98b9-46ac-8c92-d0f16eed5248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:38.015055 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0ab353-98b9-46ac-8c92-d0f16eed5248 admin admin] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:38.015344 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0ab353-98b9-46ac-8c92-d0f16eed5248 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:38.015620 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0ab353-98b9-46ac-8c92-d0f16eed5248 admin admin] PATH_INFO: `/v3/users` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:38.016315 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0ab353-98b9-46ac-8c92-d0f16eed5248 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:38.018261 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0ab353-98b9-46ac-8c92-d0f16eed5248 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:38.046853 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1048/2136] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 19 10:28:37 2022] POST /identity/v3/users => generated 291 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 10:28:38.050840 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3fd2b0-b9f5-497a-848c-726616cee4ae admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:38.061549 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3fd2b0-b9f5-497a-848c-726616cee4ae admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:38.066250 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5c5495-9cc8-4861-885c-5d7d59b0d4ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:38.067114 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5c5495-9cc8-4861-885c-5d7d59b0d4ee admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:38.067254 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5c5495-9cc8-4861-885c-5d7d59b0d4ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:38.067529 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5c5495-9cc8-4861-885c-5d7d59b0d4ee admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:38.068193 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5c5495-9cc8-4861-885c-5d7d59b0d4ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:38.069808 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5c5495-9cc8-4861-885c-5d7d59b0d4ee admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:38.080360 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1089/2137] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:28:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 10:28:38.084887 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0ab353-98b9-46ac-8c92-d0f16eed5248 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:38.095817 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0ab353-98b9-46ac-8c92-d0f16eed5248 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:38.100695 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16ba712-2c03-4646-b9c3-7bec2ab95b95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:38.101305 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16ba712-2c03-4646-b9c3-7bec2ab95b95 admin admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:38.101590 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16ba712-2c03-4646-b9c3-7bec2ab95b95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:38.101865 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16ba712-2c03-4646-b9c3-7bec2ab95b95 admin admin] PATH_INFO: `/v3/roles` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:38.102508 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16ba712-2c03-4646-b9c3-7bec2ab95b95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:38.104743 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16ba712-2c03-4646-b9c3-7bec2ab95b95 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:38.119125 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1049/2138] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:28:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 10:28:38.120545 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5c5495-9cc8-4861-885c-5d7d59b0d4ee admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:38.131003 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5c5495-9cc8-4861-885c-5d7d59b0d4ee admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:38.135875 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3ae75b-8894-491e-bd9e-0604aeff96d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:38.136569 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3ae75b-8894-491e-bd9e-0604aeff96d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:38.136853 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3ae75b-8894-491e-bd9e-0604aeff96d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:38.137133 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3ae75b-8894-491e-bd9e-0604aeff96d1 admin admin] PATH_INFO: `/v3/projects/d71507926e0546c4898521d2f7f89e33/users/dbdeafb3d65b4ca68fc56d594e869fc1/roles/cd5b42ed3b754b58817a62bbe74651b4` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:38.152903 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3ae75b-8894-491e-bd9e-0604aeff96d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d71507926e0546c4898521d2f7f89e33, user_id=dbdeafb3d65b4ca68fc56d594e869fc1, role_id=cd5b42ed3b754b58817a62bbe74651b4)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:38.155573 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3ae75b-8894-491e-bd9e-0604aeff96d1 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:38.169480 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1090/2139] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 19 10:28:38 2022] PUT /identity/v3/projects/d71507926e0546c4898521d2f7f89e33/users/dbdeafb3d65b4ca68fc56d594e869fc1/roles/cd5b42ed3b754b58817a62bbe74651b4 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:28:38.179970 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c39a42d-8d37-464d-9812-f438fc5b78e8 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:38.180539 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c39a42d-8d37-464d-9812-f438fc5b78e8 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:38.180539 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c39a42d-8d37-464d-9812-f438fc5b78e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:38.210475 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-7c39a42d-8d37-464d-9812-f438fc5b78e8 None None] MFA Rules not processed for user `dbdeafb3d65b4ca68fc56d594e869fc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:28:38.211710 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-7c39a42d-8d37-464d-9812-f438fc5b78e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:28:38.282448 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1050/2140] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:28:38 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:28:38.287270 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3ae75b-8894-491e-bd9e-0604aeff96d1 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:38.358531 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3ae75b-8894-491e-bd9e-0604aeff96d1 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:38.363602 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb95e4a4-5947-4f74-b2c2-a881b533bbd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:38.364355 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb95e4a4-5947-4f74-b2c2-a881b533bbd3 admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:38.364621 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb95e4a4-5947-4f74-b2c2-a881b533bbd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:38.364984 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb95e4a4-5947-4f74-b2c2-a881b533bbd3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:38.365568 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb95e4a4-5947-4f74-b2c2-a881b533bbd3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:38.367692 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb95e4a4-5947-4f74-b2c2-a881b533bbd3 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:38.420628 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1091/2141] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 19 10:28:38 2022] POST /identity/v3/projects => generated 379 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:28:38.422168 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c39a42d-8d37-464d-9812-f438fc5b78e8 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:38.437795 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c39a42d-8d37-464d-9812-f438fc5b78e8 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:38.457582 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:28:38.511142 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66fe57e-4673-440d-86e9-b65df77df13f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:38.511753 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66fe57e-4673-440d-86e9-b65df77df13f admin admin] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:38.512313 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66fe57e-4673-440d-86e9-b65df77df13f admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:38.512456 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66fe57e-4673-440d-86e9-b65df77df13f admin admin] PATH_INFO: `/v3/users` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:38.512983 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66fe57e-4673-440d-86e9-b65df77df13f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:38.515136 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66fe57e-4673-440d-86e9-b65df77df13f admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:38.537694 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1051/2142] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 19 10:28:38 2022] POST /identity/v3/users => generated 296 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:28:38.541811 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb95e4a4-5947-4f74-b2c2-a881b533bbd3 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:38.552556 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb95e4a4-5947-4f74-b2c2-a881b533bbd3 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:38.557145 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692ff133-8601-494c-82f8-ce57407c6925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:38.557743 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692ff133-8601-494c-82f8-ce57407c6925 admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:38.558024 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692ff133-8601-494c-82f8-ce57407c6925 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:38.558293 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692ff133-8601-494c-82f8-ce57407c6925 admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:38.558925 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692ff133-8601-494c-82f8-ce57407c6925 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:38.560548 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692ff133-8601-494c-82f8-ce57407c6925 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:38.579295 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1092/2143] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:28:38 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 10:28:38.582573 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66fe57e-4673-440d-86e9-b65df77df13f admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:38.596882 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66fe57e-4673-440d-86e9-b65df77df13f admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:38.602069 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2d566c-87c5-4455-a804-2bb5135aed93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:38.602750 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2d566c-87c5-4455-a804-2bb5135aed93 admin admin] REQUEST_METHOD: `PUT` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:38.603036 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2d566c-87c5-4455-a804-2bb5135aed93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:38.603487 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2d566c-87c5-4455-a804-2bb5135aed93 admin admin] PATH_INFO: `/v3/projects/68f8b9e63f9d4d43888e662a8dbc00fb/users/c2133187aab84cf2948115fcb69a84ce/roles/5c8b89fae4fa45bd944cbeaf442136e1` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:38.620242 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2d566c-87c5-4455-a804-2bb5135aed93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68f8b9e63f9d4d43888e662a8dbc00fb, user_id=c2133187aab84cf2948115fcb69a84ce, role_id=5c8b89fae4fa45bd944cbeaf442136e1)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:38.622941 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2d566c-87c5-4455-a804-2bb5135aed93 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:38.637433 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1052/2144] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 19 10:28:38 2022] PUT /identity/v3/projects/68f8b9e63f9d4d43888e662a8dbc00fb/users/c2133187aab84cf2948115fcb69a84ce/roles/5c8b89fae4fa45bd944cbeaf442136e1 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:28:38.641297 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692ff133-8601-494c-82f8-ce57407c6925 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:38.647612 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:28:38.652450 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692ff133-8601-494c-82f8-ce57407c6925 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:38.711963 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2c29a7-4060-489b-8cda-fe3190c203b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:38.712602 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2c29a7-4060-489b-8cda-fe3190c203b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:38.713521 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2c29a7-4060-489b-8cda-fe3190c203b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:38.713799 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2c29a7-4060-489b-8cda-fe3190c203b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:38.714433 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2c29a7-4060-489b-8cda-fe3190c203b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:38.716024 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2c29a7-4060-489b-8cda-fe3190c203b8 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:38.725885 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1093/2145] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:28:38 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 10:28:38.730115 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2d566c-87c5-4455-a804-2bb5135aed93 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:38.740248 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2d566c-87c5-4455-a804-2bb5135aed93 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:38.744871 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c76417-88ab-4f17-b636-0ced5ee24874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:38.745523 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c76417-88ab-4f17-b636-0ced5ee24874 admin admin] REQUEST_METHOD: `PUT` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:38.745805 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c76417-88ab-4f17-b636-0ced5ee24874 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:38.746084 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c76417-88ab-4f17-b636-0ced5ee24874 admin admin] PATH_INFO: `/v3/projects/68f8b9e63f9d4d43888e662a8dbc00fb/users/c2133187aab84cf2948115fcb69a84ce/roles/5c8b89fae4fa45bd944cbeaf442136e1` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:38.747966 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c76417-88ab-4f17-b636-0ced5ee24874 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68f8b9e63f9d4d43888e662a8dbc00fb, user_id=c2133187aab84cf2948115fcb69a84ce, role_id=5c8b89fae4fa45bd944cbeaf442136e1)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:38.750634 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c76417-88ab-4f17-b636-0ced5ee24874 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:38.761333 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1053/2146] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 19 10:28:38 2022] PUT /identity/v3/projects/68f8b9e63f9d4d43888e662a8dbc00fb/users/c2133187aab84cf2948115fcb69a84ce/roles/5c8b89fae4fa45bd944cbeaf442136e1 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:28:38.772849 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fe50d7-e886-4796-91f1-f16cc3ef64dc None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:38.773137 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fe50d7-e886-4796-91f1-f16cc3ef64dc None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:38.773414 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fe50d7-e886-4796-91f1-f16cc3ef64dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:38.804311 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-35fe50d7-e886-4796-91f1-f16cc3ef64dc None None] MFA Rules not processed for user `c2133187aab84cf2948115fcb69a84ce`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:28:38.805605 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-35fe50d7-e886-4796-91f1-f16cc3ef64dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:28:38.877506 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1094/2147] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:28:38 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:28:38.893243 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c76417-88ab-4f17-b636-0ced5ee24874 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:38.895868 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-b0c76417-88ab-4f17-b636-0ced5ee24874 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:28:38.959022 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c76417-88ab-4f17-b636-0ced5ee24874 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:38.962982 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db6162a-b08d-4995-99d4-f541f4ebd420 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa4d004fd44482cae761c4b3bdfab31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:38.963609 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db6162a-b08d-4995-99d4-f541f4ebd420 service cinder] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:38.963887 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db6162a-b08d-4995-99d4-f541f4ebd420 service cinder] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:38.964178 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db6162a-b08d-4995-99d4-f541f4ebd420 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:38.976141 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db6162a-b08d-4995-99d4-f541f4ebd420 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:38.977633 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db6162a-b08d-4995-99d4-f541f4ebd420 service cinder] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:38.987368 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1054/2148] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:28:38 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:28:39.070305 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fe50d7-e886-4796-91f1-f16cc3ef64dc None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:39.080389 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fe50d7-e886-4796-91f1-f16cc3ef64dc None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:39.083914 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f62ab3e-d114-4689-b80c-c7854d13273a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa4d004fd44482cae761c4b3bdfab31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:39.084531 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f62ab3e-d114-4689-b80c-c7854d13273a service cinder] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:39.084808 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f62ab3e-d114-4689-b80c-c7854d13273a service cinder] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:39.085077 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f62ab3e-d114-4689-b80c-c7854d13273a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:39.141241 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f62ab3e-d114-4689-b80c-c7854d13273a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:39.142709 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f62ab3e-d114-4689-b80c-c7854d13273a service cinder] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:39.151546 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1095/2149] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:28:39 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:28:41.159908 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db6162a-b08d-4995-99d4-f541f4ebd420 service cinder] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:41.161636 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-9db6162a-b08d-4995-99d4-f541f4ebd420 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:28:41.229824 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db6162a-b08d-4995-99d4-f541f4ebd420 service cinder] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:41.234439 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93202c8-8c7e-432b-8f1d-45fb8e4cc248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:41.235084 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93202c8-8c7e-432b-8f1d-45fb8e4cc248 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:41.235370 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93202c8-8c7e-432b-8f1d-45fb8e4cc248 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:41.235645 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93202c8-8c7e-432b-8f1d-45fb8e4cc248 admin admin] PATH_INFO: `/v3/users/e41d62d37f2c45b6bff0a3ce5752bc41` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:41.236836 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93202c8-8c7e-432b-8f1d-45fb8e4cc248 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e41d62d37f2c45b6bff0a3ce5752bc41)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:41.238775 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93202c8-8c7e-432b-8f1d-45fb8e4cc248 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:41.260339 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:28:41.302300 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-b93202c8-8c7e-432b-8f1d-45fb8e4cc248 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e41d62d37f2c45b6bff0a3ce5752bc41'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:41.310963 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-b93202c8-8c7e-432b-8f1d-45fb8e4cc248 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e41d62d37f2c45b6bff0a3ce5752bc41'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:41.311575 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-b93202c8-8c7e-432b-8f1d-45fb8e4cc248 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e41d62d37f2c45b6bff0a3ce5752bc41'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:41.312301 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-b93202c8-8c7e-432b-8f1d-45fb8e4cc248 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e41d62d37f2c45b6bff0a3ce5752bc41'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:41.319380 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-b93202c8-8c7e-432b-8f1d-45fb8e4cc248 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e41d62d37f2c45b6bff0a3ce5752bc41'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:41.338017 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1055/2150] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 19 10:28:41 2022] DELETE /identity/v3/users/e41d62d37f2c45b6bff0a3ce5752bc41 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:28:41.342414 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0532f7a6-c838-4fee-8b8d-09b21119237e None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:41.342865 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0532f7a6-c838-4fee-8b8d-09b21119237e None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:41.342955 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0532f7a6-c838-4fee-8b8d-09b21119237e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:41.361530 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-0532f7a6-c838-4fee-8b8d-09b21119237e None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:28:41.362719 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-0532f7a6-c838-4fee-8b8d-09b21119237e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:28:41.382005 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:28:41.424233 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1096/2151] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:28:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:28:41.434592 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93202c8-8c7e-432b-8f1d-45fb8e4cc248 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:41.436060 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-b93202c8-8c7e-432b-8f1d-45fb8e4cc248 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:28:41.493677 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93202c8-8c7e-432b-8f1d-45fb8e4cc248 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:41.497935 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10123b6e-a9a3-4695-a541-0945fcf1dc1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c1289b015854c6bb6aee8fed6b807db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:41.498540 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10123b6e-a9a3-4695-a541-0945fcf1dc1f service neutron] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:41.498820 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10123b6e-a9a3-4695-a541-0945fcf1dc1f service neutron] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:41.499095 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10123b6e-a9a3-4695-a541-0945fcf1dc1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:41.508298 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10123b6e-a9a3-4695-a541-0945fcf1dc1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:41.509764 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10123b6e-a9a3-4695-a541-0945fcf1dc1f service neutron] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:41.519098 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1056/2152] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:28:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:28:41.802938 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0532f7a6-c838-4fee-8b8d-09b21119237e None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:41.804599 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-0532f7a6-c838-4fee-8b8d-09b21119237e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:28:41.827217 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0532f7a6-c838-4fee-8b8d-09b21119237e None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:41.832017 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b5009e-e1d1-416f-a468-e73c7564ddf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:41.832941 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b5009e-e1d1-416f-a468-e73c7564ddf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:41.833171 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b5009e-e1d1-416f-a468-e73c7564ddf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:41.834011 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b5009e-e1d1-416f-a468-e73c7564ddf4 admin admin] PATH_INFO: `/v3/projects/fba4c72bafeb46a58a4db385b6a1f043` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:41.835563 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b5009e-e1d1-416f-a468-e73c7564ddf4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fba4c72bafeb46a58a4db385b6a1f043)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:41.836683 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b5009e-e1d1-416f-a468-e73c7564ddf4 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:41.883372 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-84b5009e-e1d1-416f-a468-e73c7564ddf4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fba4c72bafeb46a58a4db385b6a1f043', 'request_id': 'req-84b5009e-e1d1-416f-a468-e73c7564ddf4'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:41.891218 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-84b5009e-e1d1-416f-a468-e73c7564ddf4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fba4c72bafeb46a58a4db385b6a1f043', 'request_id': 'req-84b5009e-e1d1-416f-a468-e73c7564ddf4'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:41.898366 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-84b5009e-e1d1-416f-a468-e73c7564ddf4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fba4c72bafeb46a58a4db385b6a1f043', 'request_id': 'req-84b5009e-e1d1-416f-a468-e73c7564ddf4'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:41.909845 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-84b5009e-e1d1-416f-a468-e73c7564ddf4 admin admin] The token cache is being invalidate because project fba4c72bafeb46a58a4db385b6a1f043 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 10:28:41.910134 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-84b5009e-e1d1-416f-a468-e73c7564ddf4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:41.910778 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-84b5009e-e1d1-416f-a468-e73c7564ddf4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:41.912305 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1097/2153] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 19 10:28:41 2022] DELETE /identity/v3/projects/fba4c72bafeb46a58a4db385b6a1f043 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:28:41.917570 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f607c986-dc18-4c25-8300-075d4673ef96 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:41.917930 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f607c986-dc18-4c25-8300-075d4673ef96 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:41.918274 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f607c986-dc18-4c25-8300-075d4673ef96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:41.939845 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-f607c986-dc18-4c25-8300-075d4673ef96 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:28:41.941082 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-f607c986-dc18-4c25-8300-075d4673ef96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:28:42.000725 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1057/2154] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:28:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:28:42.008631 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175837ce-b3bb-48a3-bc47-fa5b359391f7 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:42.008927 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175837ce-b3bb-48a3-bc47-fa5b359391f7 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:42.009207 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175837ce-b3bb-48a3-bc47-fa5b359391f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:42.029982 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-175837ce-b3bb-48a3-bc47-fa5b359391f7 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:28:42.031197 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-175837ce-b3bb-48a3-bc47-fa5b359391f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:28:42.039637 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1098/2155] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:28:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:28:42.043997 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f607c986-dc18-4c25-8300-075d4673ef96 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:42.053884 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f607c986-dc18-4c25-8300-075d4673ef96 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:42.058872 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7d18d3-c4fb-4d1c-9d13-d6165876ff40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:42.059463 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7d18d3-c4fb-4d1c-9d13-d6165876ff40 admin admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:42.059742 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7d18d3-c4fb-4d1c-9d13-d6165876ff40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:42.060041 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7d18d3-c4fb-4d1c-9d13-d6165876ff40 admin admin] PATH_INFO: `/v3/domains` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:42.060707 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7d18d3-c4fb-4d1c-9d13-d6165876ff40 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:28:42.061013 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7d18d3-c4fb-4d1c-9d13-d6165876ff40 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:42.062633 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7d18d3-c4fb-4d1c-9d13-d6165876ff40 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:42.080797 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1058/2156] 10.222.0.66 () {58 vars in 1153 bytes} [Mon Sep 19 10:28:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:28:42.081565 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175837ce-b3bb-48a3-bc47-fa5b359391f7 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:42.092057 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175837ce-b3bb-48a3-bc47-fa5b359391f7 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:42.096842 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf25275-743f-42f0-a137-610821a9fb95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:42.097443 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf25275-743f-42f0-a137-610821a9fb95 admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:42.097722 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf25275-743f-42f0-a137-610821a9fb95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:42.097984 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf25275-743f-42f0-a137-610821a9fb95 admin admin] PATH_INFO: `/v3/projects` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:42.098613 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf25275-743f-42f0-a137-610821a9fb95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:42.100550 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf25275-743f-42f0-a137-610821a9fb95 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:42.133454 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1099/2157] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 19 10:28:42 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 10:28:42.135787 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7d18d3-c4fb-4d1c-9d13-d6165876ff40 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:42.157462 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7d18d3-c4fb-4d1c-9d13-d6165876ff40 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:42.178959 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:28:42.208572 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf25275-743f-42f0-a137-610821a9fb95 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:42.210462 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-ccf25275-743f-42f0-a137-610821a9fb95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:28:42.222001 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7b7835-6bc4-4f05-9ba9-2d2c37640179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:42.222616 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7b7835-6bc4-4f05-9ba9-2d2c37640179 admin admin] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:42.222892 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7b7835-6bc4-4f05-9ba9-2d2c37640179 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:42.223184 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7b7835-6bc4-4f05-9ba9-2d2c37640179 admin admin] PATH_INFO: `/v3/users` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:42.223804 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7b7835-6bc4-4f05-9ba9-2d2c37640179 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:42.225814 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7b7835-6bc4-4f05-9ba9-2d2c37640179 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:42.252874 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1059/2158] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 19 10:28:42 2022] POST /identity/v3/users => generated 293 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:28:42.254190 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7b7835-6bc4-4f05-9ba9-2d2c37640179 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:42.264051 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7b7835-6bc4-4f05-9ba9-2d2c37640179 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:42.268927 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ec1091-2354-4804-bd04-f2501c730dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:42.269555 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ec1091-2354-4804-bd04-f2501c730dcb admin admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:42.269861 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ec1091-2354-4804-bd04-f2501c730dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:42.270108 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ec1091-2354-4804-bd04-f2501c730dcb admin admin] PATH_INFO: `/v3/roles` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:42.270743 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ec1091-2354-4804-bd04-f2501c730dcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:42.271251 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf25275-743f-42f0-a137-610821a9fb95 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:42.272422 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ec1091-2354-4804-bd04-f2501c730dcb admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:42.275910 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc09933-48fe-422f-86e8-8a5bbce31d32 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa4d004fd44482cae761c4b3bdfab31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:42.276606 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc09933-48fe-422f-86e8-8a5bbce31d32 service cinder] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:42.276886 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc09933-48fe-422f-86e8-8a5bbce31d32 service cinder] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:42.277163 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc09933-48fe-422f-86e8-8a5bbce31d32 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:42.279420 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-ddc09933-48fe-422f-86e8-8a5bbce31d32 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:28:42.285311 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1060/2159] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:28:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 10:28:42.289163 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ec1091-2354-4804-bd04-f2501c730dcb admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:42.301343 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ec1091-2354-4804-bd04-f2501c730dcb admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:42.305755 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d80477-245a-4029-a319-2c43b0834f55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:42.306358 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d80477-245a-4029-a319-2c43b0834f55 admin admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:42.307825 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d80477-245a-4029-a319-2c43b0834f55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:42.307825 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d80477-245a-4029-a319-2c43b0834f55 admin admin] PATH_INFO: `/v3/roles` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:42.308902 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d80477-245a-4029-a319-2c43b0834f55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:42.310195 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d80477-245a-4029-a319-2c43b0834f55 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:42.322558 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1061/2160] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:28:42 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 10:28:42.325907 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:28:42.328519 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d80477-245a-4029-a319-2c43b0834f55 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:42.343136 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d80477-245a-4029-a319-2c43b0834f55 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:42.352505 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb37a685-4aa1-4792-9f84-379730873dba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:42.353232 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb37a685-4aa1-4792-9f84-379730873dba admin admin] REQUEST_METHOD: `PUT` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:42.354023 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb37a685-4aa1-4792-9f84-379730873dba admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:42.354368 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb37a685-4aa1-4792-9f84-379730873dba admin admin] PATH_INFO: `/v3/projects/c53ed724d80a49acb6a4d0308807859e/users/c4d6d94b77c34dbb9fc6b72a7fc6f080/roles/cd5b42ed3b754b58817a62bbe74651b4` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:42.375078 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb37a685-4aa1-4792-9f84-379730873dba admin admin] RBAC: Authorizing `identity:create_grant(project_id=c53ed724d80a49acb6a4d0308807859e, user_id=c4d6d94b77c34dbb9fc6b72a7fc6f080, role_id=cd5b42ed3b754b58817a62bbe74651b4)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:42.375364 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc09933-48fe-422f-86e8-8a5bbce31d32 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:42.376879 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc09933-48fe-422f-86e8-8a5bbce31d32 service cinder] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:42.378619 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb37a685-4aa1-4792-9f84-379730873dba admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:42.390756 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1100/2161] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:28:42 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 10:28:42.403582 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1062/2162] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 19 10:28:42 2022] PUT /identity/v3/projects/c53ed724d80a49acb6a4d0308807859e/users/c4d6d94b77c34dbb9fc6b72a7fc6f080/roles/cd5b42ed3b754b58817a62bbe74651b4 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:28:42.408319 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9e337c-820f-4a61-97fa-eb4d5dbc0bf8 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:42.408644 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9e337c-820f-4a61-97fa-eb4d5dbc0bf8 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:42.408998 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9e337c-820f-4a61-97fa-eb4d5dbc0bf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:42.454359 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-ab9e337c-820f-4a61-97fa-eb4d5dbc0bf8 None None] MFA Rules not processed for user `c4d6d94b77c34dbb9fc6b72a7fc6f080`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:28:42.456029 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-ab9e337c-820f-4a61-97fa-eb4d5dbc0bf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:28:42.555053 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1101/2163] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:28:42 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:28:42.560466 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb37a685-4aa1-4792-9f84-379730873dba admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:42.637647 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb37a685-4aa1-4792-9f84-379730873dba admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:42.642614 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad877af2-4ba5-4bf0-b6d0-a29932c11664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:42.643161 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad877af2-4ba5-4bf0-b6d0-a29932c11664 admin admin] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:42.643452 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad877af2-4ba5-4bf0-b6d0-a29932c11664 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:42.643733 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad877af2-4ba5-4bf0-b6d0-a29932c11664 admin admin] PATH_INFO: `/v3/projects` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:42.644410 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad877af2-4ba5-4bf0-b6d0-a29932c11664 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:42.646400 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad877af2-4ba5-4bf0-b6d0-a29932c11664 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:42.677680 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1063/2164] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 19 10:28:42 2022] POST /identity/v3/projects => generated 383 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:28:42.682056 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9e337c-820f-4a61-97fa-eb4d5dbc0bf8 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:42.693140 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9e337c-820f-4a61-97fa-eb4d5dbc0bf8 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:42.754505 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f352a4-d7cd-4e1e-acad-04c79cdc52cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:42.755120 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f352a4-d7cd-4e1e-acad-04c79cdc52cb admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:42.755399 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f352a4-d7cd-4e1e-acad-04c79cdc52cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:42.755672 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f352a4-d7cd-4e1e-acad-04c79cdc52cb admin admin] PATH_INFO: `/v3/users` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:42.756352 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f352a4-d7cd-4e1e-acad-04c79cdc52cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:42.758332 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f352a4-d7cd-4e1e-acad-04c79cdc52cb admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:42.781199 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1102/2165] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 19 10:28:42 2022] POST /identity/v3/users => generated 292 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 10:28:42.785367 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad877af2-4ba5-4bf0-b6d0-a29932c11664 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:42.797146 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad877af2-4ba5-4bf0-b6d0-a29932c11664 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:42.801937 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566bcb7b-14de-42ee-817b-1772099bad14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:42.802538 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566bcb7b-14de-42ee-817b-1772099bad14 admin admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:42.802830 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566bcb7b-14de-42ee-817b-1772099bad14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:42.803095 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566bcb7b-14de-42ee-817b-1772099bad14 admin admin] PATH_INFO: `/v3/roles` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:42.803741 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566bcb7b-14de-42ee-817b-1772099bad14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:42.805422 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566bcb7b-14de-42ee-817b-1772099bad14 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:42.816350 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1064/2166] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:28:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 10:28:42.820750 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f352a4-d7cd-4e1e-acad-04c79cdc52cb admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:42.830410 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f352a4-d7cd-4e1e-acad-04c79cdc52cb admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:42.835077 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a090c292-3029-49ed-9438-88842995649b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:42.835660 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a090c292-3029-49ed-9438-88842995649b admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:42.835925 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a090c292-3029-49ed-9438-88842995649b admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:42.836252 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a090c292-3029-49ed-9438-88842995649b admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:42.836865 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a090c292-3029-49ed-9438-88842995649b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:42.838944 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a090c292-3029-49ed-9438-88842995649b admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:42.849777 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1103/2167] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:28:42 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 10:28:42.854438 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566bcb7b-14de-42ee-817b-1772099bad14 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:42.865315 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566bcb7b-14de-42ee-817b-1772099bad14 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:42.870089 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4571781-1a06-41ef-a91f-55a81c3c8603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:42.870736 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4571781-1a06-41ef-a91f-55a81c3c8603 admin admin] REQUEST_METHOD: `PUT` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:42.871022 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4571781-1a06-41ef-a91f-55a81c3c8603 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:42.871302 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4571781-1a06-41ef-a91f-55a81c3c8603 admin admin] PATH_INFO: `/v3/projects/4dbcc022fadd468f99049cb4cf60bb70/users/5f9bc762cf6c454ca49c51a509d1a32b/roles/cd5b42ed3b754b58817a62bbe74651b4` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:42.886682 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4571781-1a06-41ef-a91f-55a81c3c8603 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4dbcc022fadd468f99049cb4cf60bb70, user_id=5f9bc762cf6c454ca49c51a509d1a32b, role_id=cd5b42ed3b754b58817a62bbe74651b4)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:42.889493 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4571781-1a06-41ef-a91f-55a81c3c8603 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:42.907847 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1065/2168] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 19 10:28:42 2022] PUT /identity/v3/projects/4dbcc022fadd468f99049cb4cf60bb70/users/5f9bc762cf6c454ca49c51a509d1a32b/roles/cd5b42ed3b754b58817a62bbe74651b4 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:28:42.919647 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa40a7ad-2089-4cd2-aabc-e7781f7d4c57 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:42.920223 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa40a7ad-2089-4cd2-aabc-e7781f7d4c57 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:42.920501 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa40a7ad-2089-4cd2-aabc-e7781f7d4c57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:42.951035 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-fa40a7ad-2089-4cd2-aabc-e7781f7d4c57 None None] MFA Rules not processed for user `5f9bc762cf6c454ca49c51a509d1a32b`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:28:42.952334 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-fa40a7ad-2089-4cd2-aabc-e7781f7d4c57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:28:42.982046 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:28:43.027448 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1104/2169] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:28:42 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:28:43.032674 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4571781-1a06-41ef-a91f-55a81c3c8603 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:43.052044 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:28:43.101376 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4571781-1a06-41ef-a91f-55a81c3c8603 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:43.107152 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df26a5d-fbae-4c81-92be-0edc2a4d72ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:43.107818 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df26a5d-fbae-4c81-92be-0edc2a4d72ca admin admin] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:43.108108 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df26a5d-fbae-4c81-92be-0edc2a4d72ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:43.108439 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df26a5d-fbae-4c81-92be-0edc2a4d72ca admin admin] PATH_INFO: `/v3/projects` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:43.109180 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df26a5d-fbae-4c81-92be-0edc2a4d72ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:43.111416 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df26a5d-fbae-4c81-92be-0edc2a4d72ca admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:43.148578 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa40a7ad-2089-4cd2-aabc-e7781f7d4c57 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:43.150859 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-fa40a7ad-2089-4cd2-aabc-e7781f7d4c57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:28:43.162116 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1066/2170] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 19 10:28:43 2022] POST /identity/v3/projects => generated 383 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:28:43.163216 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df26a5d-fbae-4c81-92be-0edc2a4d72ca admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:43.166718 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa40a7ad-2089-4cd2-aabc-e7781f7d4c57 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:43.246893 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8859872c-dc22-4ce2-830b-3d67429ce5c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:43.247532 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8859872c-dc22-4ce2-830b-3d67429ce5c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:43.247810 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8859872c-dc22-4ce2-830b-3d67429ce5c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:43.248080 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8859872c-dc22-4ce2-830b-3d67429ce5c3 admin admin] PATH_INFO: `/v3/users/ce0dc2310b864d3b8e93e817f632a975` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:43.249627 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8859872c-dc22-4ce2-830b-3d67429ce5c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce0dc2310b864d3b8e93e817f632a975)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:43.251620 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8859872c-dc22-4ce2-830b-3d67429ce5c3 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:43.253615 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df26a5d-fbae-4c81-92be-0edc2a4d72ca admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:43.272267 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e474f6-fb02-4f14-9550-390d9d141f8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:43.272267 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e474f6-fb02-4f14-9550-390d9d141f8e admin admin] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:43.272267 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e474f6-fb02-4f14-9550-390d9d141f8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:43.272267 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e474f6-fb02-4f14-9550-390d9d141f8e admin admin] PATH_INFO: `/v3/users` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:43.272629 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e474f6-fb02-4f14-9550-390d9d141f8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:43.272629 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e474f6-fb02-4f14-9550-390d9d141f8e admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:43.294677 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1067/2171] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 19 10:28:43 2022] POST /identity/v3/users => generated 298 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:28:43.296062 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e474f6-fb02-4f14-9550-390d9d141f8e admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:43.307266 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e474f6-fb02-4f14-9550-390d9d141f8e admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:43.309288 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-8859872c-dc22-4ce2-830b-3d67429ce5c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce0dc2310b864d3b8e93e817f632a975'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:43.313648 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5bc01d-affa-4716-9502-9c418e881f97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:43.314859 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5bc01d-affa-4716-9502-9c418e881f97 admin admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:43.315206 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5bc01d-affa-4716-9502-9c418e881f97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:43.315555 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5bc01d-affa-4716-9502-9c418e881f97 admin admin] PATH_INFO: `/v3/roles` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:43.316268 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5bc01d-affa-4716-9502-9c418e881f97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:43.317398 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-8859872c-dc22-4ce2-830b-3d67429ce5c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce0dc2310b864d3b8e93e817f632a975'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:43.318025 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-8859872c-dc22-4ce2-830b-3d67429ce5c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce0dc2310b864d3b8e93e817f632a975'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:43.318199 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5bc01d-affa-4716-9502-9c418e881f97 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:43.318702 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-8859872c-dc22-4ce2-830b-3d67429ce5c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce0dc2310b864d3b8e93e817f632a975'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:43.327381 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-8859872c-dc22-4ce2-830b-3d67429ce5c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce0dc2310b864d3b8e93e817f632a975'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:43.332224 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1068/2172] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:28:43 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 10:28:43.336223 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5bc01d-affa-4716-9502-9c418e881f97 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:43.338308 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-0b5bc01d-affa-4716-9502-9c418e881f97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:28:43.347229 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1105/2173] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 19 10:28:43 2022] DELETE /identity/v3/users/ce0dc2310b864d3b8e93e817f632a975 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:28:43.351725 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127cd849-e742-4964-9af5-e5694745501e None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:43.351910 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5bc01d-affa-4716-9502-9c418e881f97 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:43.352189 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127cd849-e742-4964-9af5-e5694745501e None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:43.352480 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127cd849-e742-4964-9af5-e5694745501e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:43.373158 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-127cd849-e742-4964-9af5-e5694745501e None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:28:43.374621 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-127cd849-e742-4964-9af5-e5694745501e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:28:43.415448 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1e983c-7d3e-41c9-b1d3-791c2c452e1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:43.416034 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1e983c-7d3e-41c9-b1d3-791c2c452e1f admin admin] REQUEST_METHOD: `PUT` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:43.416356 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1e983c-7d3e-41c9-b1d3-791c2c452e1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:43.416643 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1e983c-7d3e-41c9-b1d3-791c2c452e1f admin admin] PATH_INFO: `/v3/projects/0a30c976e334428082a20258dae9e0fa/users/0866375699b64eb893de2eb206ace280/roles/5c8b89fae4fa45bd944cbeaf442136e1` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:43.420596 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:28:43.433933 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1e983c-7d3e-41c9-b1d3-791c2c452e1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a30c976e334428082a20258dae9e0fa, user_id=0866375699b64eb893de2eb206ace280, role_id=5c8b89fae4fa45bd944cbeaf442136e1)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:43.437179 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1e983c-7d3e-41c9-b1d3-791c2c452e1f admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:43.443224 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1106/2174] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:28:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 10:28:43.451670 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1069/2175] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 19 10:28:43 2022] PUT /identity/v3/projects/0a30c976e334428082a20258dae9e0fa/users/0866375699b64eb893de2eb206ace280/roles/5c8b89fae4fa45bd944cbeaf442136e1 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 10:28:43.455505 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127cd849-e742-4964-9af5-e5694745501e None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:43.456857 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1e983c-7d3e-41c9-b1d3-791c2c452e1f admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:43.458518 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-fe1e983c-7d3e-41c9-b1d3-791c2c452e1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:28:43.464077 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:28:43.466307 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127cd849-e742-4964-9af5-e5694745501e None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:43.518883 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1e983c-7d3e-41c9-b1d3-791c2c452e1f admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:43.522500 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edba46b-13c4-4a7f-a803-de7dc2d7bff2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c1289b015854c6bb6aee8fed6b807db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:43.523115 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edba46b-13c4-4a7f-a803-de7dc2d7bff2 service neutron] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:43.523555 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edba46b-13c4-4a7f-a803-de7dc2d7bff2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:43.523837 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edba46b-13c4-4a7f-a803-de7dc2d7bff2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:43.528333 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516895af-4c3a-4ca9-9bd9-e0ca639bf27b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:43.529055 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516895af-4c3a-4ca9-9bd9-e0ca639bf27b admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:43.529458 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516895af-4c3a-4ca9-9bd9-e0ca639bf27b admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:43.529874 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516895af-4c3a-4ca9-9bd9-e0ca639bf27b admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:43.530622 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516895af-4c3a-4ca9-9bd9-e0ca639bf27b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:43.532345 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516895af-4c3a-4ca9-9bd9-e0ca639bf27b admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:43.542900 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edba46b-13c4-4a7f-a803-de7dc2d7bff2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:43.544487 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1107/2176] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:28:43 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 10:28:43.546113 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edba46b-13c4-4a7f-a803-de7dc2d7bff2 service neutron] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:43.548549 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516895af-4c3a-4ca9-9bd9-e0ca639bf27b admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:43.559752 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516895af-4c3a-4ca9-9bd9-e0ca639bf27b admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:43.564953 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1070/2177] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:28:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 10:28:43.565983 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a5e617-3e59-4fc4-828b-4c9f55503cd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:43.566719 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a5e617-3e59-4fc4-828b-4c9f55503cd8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:43.566997 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a5e617-3e59-4fc4-828b-4c9f55503cd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:43.567269 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a5e617-3e59-4fc4-828b-4c9f55503cd8 admin admin] PATH_INFO: `/v3/projects/0a30c976e334428082a20258dae9e0fa/users/0866375699b64eb893de2eb206ace280/roles/5c8b89fae4fa45bd944cbeaf442136e1` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:43.569466 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a5e617-3e59-4fc4-828b-4c9f55503cd8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a30c976e334428082a20258dae9e0fa, user_id=0866375699b64eb893de2eb206ace280, role_id=5c8b89fae4fa45bd944cbeaf442136e1)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:43.572785 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a5e617-3e59-4fc4-828b-4c9f55503cd8 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:43.585530 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1108/2178] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 19 10:28:43 2022] PUT /identity/v3/projects/0a30c976e334428082a20258dae9e0fa/users/0866375699b64eb893de2eb206ace280/roles/5c8b89fae4fa45bd944cbeaf442136e1 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:28:43.607372 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2f72b2-143d-4a3b-9298-b8665688e253 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:43.607669 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2f72b2-143d-4a3b-9298-b8665688e253 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:43.607945 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2f72b2-143d-4a3b-9298-b8665688e253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:43.664622 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-db2f72b2-143d-4a3b-9298-b8665688e253 None None] MFA Rules not processed for user `0866375699b64eb893de2eb206ace280`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:28:43.666421 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-db2f72b2-143d-4a3b-9298-b8665688e253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:28:43.822234 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1071/2179] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:28:43 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:28:43.829960 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a5e617-3e59-4fc4-828b-4c9f55503cd8 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:43.831729 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-52a5e617-3e59-4fc4-828b-4c9f55503cd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:28:43.913125 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a5e617-3e59-4fc4-828b-4c9f55503cd8 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:43.919771 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5625e80a-654a-4dad-8c52-0ceaf338e343 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa4d004fd44482cae761c4b3bdfab31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:43.920922 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5625e80a-654a-4dad-8c52-0ceaf338e343 service cinder] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:43.921441 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5625e80a-654a-4dad-8c52-0ceaf338e343 service cinder] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:43.921957 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5625e80a-654a-4dad-8c52-0ceaf338e343 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:43.925675 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-5625e80a-654a-4dad-8c52-0ceaf338e343 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:28:44.000758 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5625e80a-654a-4dad-8c52-0ceaf338e343 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:44.002211 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5625e80a-654a-4dad-8c52-0ceaf338e343 service cinder] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:44.012114 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1109/2180] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:28:43 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:28:44.107546 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2f72b2-143d-4a3b-9298-b8665688e253 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:44.109291 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-db2f72b2-143d-4a3b-9298-b8665688e253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:28:44.208677 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2f72b2-143d-4a3b-9298-b8665688e253 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:44.216306 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeef5888-2932-4902-9700-f77c4816d29b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:44.217172 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeef5888-2932-4902-9700-f77c4816d29b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:44.217623 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeef5888-2932-4902-9700-f77c4816d29b admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:44.217928 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeef5888-2932-4902-9700-f77c4816d29b admin admin] PATH_INFO: `/v3/projects/ae01639234e24f4eb457a2e6087e2623` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:44.219277 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeef5888-2932-4902-9700-f77c4816d29b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae01639234e24f4eb457a2e6087e2623)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:44.221736 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeef5888-2932-4902-9700-f77c4816d29b admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:44.271877 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:28:44.289579 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-eeef5888-2932-4902-9700-f77c4816d29b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae01639234e24f4eb457a2e6087e2623', 'request_id': 'req-eeef5888-2932-4902-9700-f77c4816d29b'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:44.298488 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-eeef5888-2932-4902-9700-f77c4816d29b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae01639234e24f4eb457a2e6087e2623', 'request_id': 'req-eeef5888-2932-4902-9700-f77c4816d29b'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:44.310517 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-eeef5888-2932-4902-9700-f77c4816d29b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae01639234e24f4eb457a2e6087e2623', 'request_id': 'req-eeef5888-2932-4902-9700-f77c4816d29b'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:44.332628 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-eeef5888-2932-4902-9700-f77c4816d29b admin admin] The token cache is being invalidate because project ae01639234e24f4eb457a2e6087e2623 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 10:28:44.332918 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-eeef5888-2932-4902-9700-f77c4816d29b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:44.333663 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-eeef5888-2932-4902-9700-f77c4816d29b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:44.335306 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1072/2181] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 19 10:28:44 2022] DELETE /identity/v3/projects/ae01639234e24f4eb457a2e6087e2623 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:28:44.341071 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d829bc-f154-430d-8d21-52bff6c899fb None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:44.341398 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d829bc-f154-430d-8d21-52bff6c899fb None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:44.341848 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d829bc-f154-430d-8d21-52bff6c899fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:44.378931 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-06d829bc-f154-430d-8d21-52bff6c899fb None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:28:44.380212 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-06d829bc-f154-430d-8d21-52bff6c899fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:28:44.415049 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:28:44.465895 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1110/2182] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:28:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:28:44.477171 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b454806-3d7a-41d9-88fa-f723b51100e8 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:44.477520 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b454806-3d7a-41d9-88fa-f723b51100e8 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:44.477810 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b454806-3d7a-41d9-88fa-f723b51100e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:44.499462 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-0b454806-3d7a-41d9-88fa-f723b51100e8 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:28:44.500760 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-0b454806-3d7a-41d9-88fa-f723b51100e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:28:44.508921 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1073/2183] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:28:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:28:44.515099 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d829bc-f154-430d-8d21-52bff6c899fb None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:44.529447 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d829bc-f154-430d-8d21-52bff6c899fb None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:44.534391 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b236940-f143-4f04-babd-d4d4ce32942f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:44.535010 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b236940-f143-4f04-babd-d4d4ce32942f admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:44.535290 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b236940-f143-4f04-babd-d4d4ce32942f admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:44.535560 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b236940-f143-4f04-babd-d4d4ce32942f admin admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:44.536247 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b236940-f143-4f04-babd-d4d4ce32942f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:28:44.536551 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b236940-f143-4f04-babd-d4d4ce32942f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:44.538169 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b236940-f143-4f04-babd-d4d4ce32942f admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:44.551599 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1111/2184] 10.222.0.66 () {58 vars in 1153 bytes} [Mon Sep 19 10:28:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:28:44.556228 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b454806-3d7a-41d9-88fa-f723b51100e8 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:44.573562 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b454806-3d7a-41d9-88fa-f723b51100e8 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:44.578806 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57032f35-cced-45c7-a961-8ed2f252aafa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:44.579416 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57032f35-cced-45c7-a961-8ed2f252aafa admin admin] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:44.579721 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57032f35-cced-45c7-a961-8ed2f252aafa admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:44.579994 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57032f35-cced-45c7-a961-8ed2f252aafa admin admin] PATH_INFO: `/v3/projects` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:44.580674 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57032f35-cced-45c7-a961-8ed2f252aafa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:44.582735 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57032f35-cced-45c7-a961-8ed2f252aafa admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:44.612009 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1074/2185] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 19 10:28:44 2022] POST /identity/v3/projects => generated 361 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 10:28:44.617156 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b236940-f143-4f04-babd-d4d4ce32942f admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:44.631692 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b236940-f143-4f04-babd-d4d4ce32942f admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:44.696377 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec95881f-f78c-4bf6-91bb-b05402ef38f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:44.697587 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec95881f-f78c-4bf6-91bb-b05402ef38f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:44.697916 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec95881f-f78c-4bf6-91bb-b05402ef38f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:44.698189 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec95881f-f78c-4bf6-91bb-b05402ef38f1 admin admin] PATH_INFO: `/v3/users` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:44.698841 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec95881f-f78c-4bf6-91bb-b05402ef38f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:44.701354 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec95881f-f78c-4bf6-91bb-b05402ef38f1 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:44.735122 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1112/2186] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 19 10:28:44 2022] POST /identity/v3/users => generated 281 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:28:44.735235 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57032f35-cced-45c7-a961-8ed2f252aafa admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:44.741307 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57032f35-cced-45c7-a961-8ed2f252aafa admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:44.746138 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4d4a98-f524-4006-a604-b8231a468c68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:44.746746 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4d4a98-f524-4006-a604-b8231a468c68 admin admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:44.747026 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4d4a98-f524-4006-a604-b8231a468c68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:44.747416 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4d4a98-f524-4006-a604-b8231a468c68 admin admin] PATH_INFO: `/v3/roles` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:44.747951 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4d4a98-f524-4006-a604-b8231a468c68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:44.749547 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4d4a98-f524-4006-a604-b8231a468c68 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:44.763433 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1075/2187] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:28:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 10:28:44.764657 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec95881f-f78c-4bf6-91bb-b05402ef38f1 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:44.782215 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec95881f-f78c-4bf6-91bb-b05402ef38f1 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:44.787409 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5ceb74-06c0-4e37-83f3-1328ea5eff4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:44.787916 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5ceb74-06c0-4e37-83f3-1328ea5eff4a admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:44.788261 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5ceb74-06c0-4e37-83f3-1328ea5eff4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:44.788543 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5ceb74-06c0-4e37-83f3-1328ea5eff4a admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:44.789197 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5ceb74-06c0-4e37-83f3-1328ea5eff4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:44.791074 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5ceb74-06c0-4e37-83f3-1328ea5eff4a admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:44.804384 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1113/2188] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:28:44 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 10:28:44.809739 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4d4a98-f524-4006-a604-b8231a468c68 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:44.820376 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4d4a98-f524-4006-a604-b8231a468c68 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:44.825953 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c91991-1f6f-4bea-80b7-1d5ed992f050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:44.826625 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c91991-1f6f-4bea-80b7-1d5ed992f050 admin admin] REQUEST_METHOD: `PUT` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:44.826908 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c91991-1f6f-4bea-80b7-1d5ed992f050 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:44.827185 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c91991-1f6f-4bea-80b7-1d5ed992f050 admin admin] PATH_INFO: `/v3/projects/879cc92179d1406ba87d24b783ae13a4/users/5541504cca1f490b86a7ad2a7a4c7e28/roles/cd5b42ed3b754b58817a62bbe74651b4` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:44.847751 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c91991-1f6f-4bea-80b7-1d5ed992f050 admin admin] RBAC: Authorizing `identity:create_grant(project_id=879cc92179d1406ba87d24b783ae13a4, user_id=5541504cca1f490b86a7ad2a7a4c7e28, role_id=cd5b42ed3b754b58817a62bbe74651b4)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:44.848618 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c91991-1f6f-4bea-80b7-1d5ed992f050 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:44.872233 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1076/2189] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 19 10:28:44 2022] PUT /identity/v3/projects/879cc92179d1406ba87d24b783ae13a4/users/5541504cca1f490b86a7ad2a7a4c7e28/roles/cd5b42ed3b754b58817a62bbe74651b4 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:28:44.881934 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7241c5-fa27-4829-9c28-a82a0623a960 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:44.882382 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7241c5-fa27-4829-9c28-a82a0623a960 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:44.882667 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7241c5-fa27-4829-9c28-a82a0623a960 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:44.917898 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-ec7241c5-fa27-4829-9c28-a82a0623a960 None None] MFA Rules not processed for user `5541504cca1f490b86a7ad2a7a4c7e28`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:28:44.919415 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-ec7241c5-fa27-4829-9c28-a82a0623a960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:28:44.994876 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1114/2190] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:28:44 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:28:45.035539 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c91991-1f6f-4bea-80b7-1d5ed992f050 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:45.037556 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-b5c91991-1f6f-4bea-80b7-1d5ed992f050 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:28:45.106993 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c91991-1f6f-4bea-80b7-1d5ed992f050 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:45.111641 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdfa094-fb56-46a9-a53c-5e7e5cecadac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa4d004fd44482cae761c4b3bdfab31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:45.112321 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdfa094-fb56-46a9-a53c-5e7e5cecadac service cinder] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:45.112608 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdfa094-fb56-46a9-a53c-5e7e5cecadac service cinder] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:45.113049 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdfa094-fb56-46a9-a53c-5e7e5cecadac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:45.124345 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdfa094-fb56-46a9-a53c-5e7e5cecadac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:45.125985 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdfa094-fb56-46a9-a53c-5e7e5cecadac service cinder] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:45.137197 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1077/2191] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:28:45 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 10:28:45.153964 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7241c5-fa27-4829-9c28-a82a0623a960 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:45.197066 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:28:45.247324 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7241c5-fa27-4829-9c28-a82a0623a960 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:45.252378 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f5045c-f1ba-4a54-a630-9d09a76220d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:45.253526 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f5045c-f1ba-4a54-a630-9d09a76220d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:45.253882 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f5045c-f1ba-4a54-a630-9d09a76220d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:45.254254 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f5045c-f1ba-4a54-a630-9d09a76220d9 admin admin] PATH_INFO: `/v3/users/5541504cca1f490b86a7ad2a7a4c7e28` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:45.255492 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f5045c-f1ba-4a54-a630-9d09a76220d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5541504cca1f490b86a7ad2a7a4c7e28)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:45.257533 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f5045c-f1ba-4a54-a630-9d09a76220d9 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:45.306050 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-60f5045c-f1ba-4a54-a630-9d09a76220d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5541504cca1f490b86a7ad2a7a4c7e28'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:45.314548 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-60f5045c-f1ba-4a54-a630-9d09a76220d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5541504cca1f490b86a7ad2a7a4c7e28'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:45.315361 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-60f5045c-f1ba-4a54-a630-9d09a76220d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5541504cca1f490b86a7ad2a7a4c7e28'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:45.316039 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-60f5045c-f1ba-4a54-a630-9d09a76220d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5541504cca1f490b86a7ad2a7a4c7e28'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:45.323648 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-60f5045c-f1ba-4a54-a630-9d09a76220d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5541504cca1f490b86a7ad2a7a4c7e28'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:45.340744 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1115/2192] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 19 10:28:45 2022] DELETE /identity/v3/users/5541504cca1f490b86a7ad2a7a4c7e28 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:28:45.345348 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f168b898-7f57-4d16-b2f2-59861f66c6f0 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:45.345848 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f168b898-7f57-4d16-b2f2-59861f66c6f0 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:45.345962 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f168b898-7f57-4d16-b2f2-59861f66c6f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:45.365626 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-f168b898-7f57-4d16-b2f2-59861f66c6f0 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:28:45.366875 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-f168b898-7f57-4d16-b2f2-59861f66c6f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:28:45.418599 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:28:45.429554 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1078/2193] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:28:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:28:45.439803 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f5045c-f1ba-4a54-a630-9d09a76220d9 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:45.441163 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-60f5045c-f1ba-4a54-a630-9d09a76220d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:28:45.499495 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f5045c-f1ba-4a54-a630-9d09a76220d9 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:45.503274 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46804471-e877-44a4-a02a-eaade3755ebd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c1289b015854c6bb6aee8fed6b807db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:45.503884 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46804471-e877-44a4-a02a-eaade3755ebd service neutron] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:45.504194 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46804471-e877-44a4-a02a-eaade3755ebd service neutron] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:45.504470 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46804471-e877-44a4-a02a-eaade3755ebd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:45.513386 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46804471-e877-44a4-a02a-eaade3755ebd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:45.514818 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46804471-e877-44a4-a02a-eaade3755ebd service neutron] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:45.524686 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1116/2194] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:28:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:28:45.788578 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f168b898-7f57-4d16-b2f2-59861f66c6f0 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:45.790028 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-f168b898-7f57-4d16-b2f2-59861f66c6f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:28:45.803285 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f168b898-7f57-4d16-b2f2-59861f66c6f0 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:45.808128 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6681545c-96f1-456a-ab83-aadd76997ad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:45.808801 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6681545c-96f1-456a-ab83-aadd76997ad7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:45.809080 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6681545c-96f1-456a-ab83-aadd76997ad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:45.809370 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6681545c-96f1-456a-ab83-aadd76997ad7 admin admin] PATH_INFO: `/v3/projects/879cc92179d1406ba87d24b783ae13a4` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:45.810609 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6681545c-96f1-456a-ab83-aadd76997ad7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=879cc92179d1406ba87d24b783ae13a4)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:45.812598 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6681545c-96f1-456a-ab83-aadd76997ad7 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:45.869165 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-6681545c-96f1-456a-ab83-aadd76997ad7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '879cc92179d1406ba87d24b783ae13a4', 'request_id': 'req-6681545c-96f1-456a-ab83-aadd76997ad7'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:45.875489 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-6681545c-96f1-456a-ab83-aadd76997ad7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '879cc92179d1406ba87d24b783ae13a4', 'request_id': 'req-6681545c-96f1-456a-ab83-aadd76997ad7'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:45.887549 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-6681545c-96f1-456a-ab83-aadd76997ad7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '879cc92179d1406ba87d24b783ae13a4', 'request_id': 'req-6681545c-96f1-456a-ab83-aadd76997ad7'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:45.899179 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-6681545c-96f1-456a-ab83-aadd76997ad7 admin admin] The token cache is being invalidate because project 879cc92179d1406ba87d24b783ae13a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 10:28:45.899466 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-6681545c-96f1-456a-ab83-aadd76997ad7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:45.900659 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-6681545c-96f1-456a-ab83-aadd76997ad7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:45.902165 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1079/2195] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 19 10:28:45 2022] DELETE /identity/v3/projects/879cc92179d1406ba87d24b783ae13a4 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:28:45.907066 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0a10e3-9d86-4f03-9658-af6beb16c74e None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:45.907352 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0a10e3-9d86-4f03-9658-af6beb16c74e None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:45.907642 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0a10e3-9d86-4f03-9658-af6beb16c74e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:45.927895 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-ea0a10e3-9d86-4f03-9658-af6beb16c74e None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:28:45.929227 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-ea0a10e3-9d86-4f03-9658-af6beb16c74e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:28:45.969099 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:28:45.991120 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1117/2196] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:28:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:28:45.999453 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c6ca6a-cf65-41f5-9889-a8f86d3406d5 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:45.999860 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c6ca6a-cf65-41f5-9889-a8f86d3406d5 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:46.000142 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c6ca6a-cf65-41f5-9889-a8f86d3406d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:46.023543 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-10c6ca6a-cf65-41f5-9889-a8f86d3406d5 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:28:46.024779 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-10c6ca6a-cf65-41f5-9889-a8f86d3406d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:28:46.033254 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1080/2197] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:28:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:28:46.037633 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0a10e3-9d86-4f03-9658-af6beb16c74e None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:46.047647 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0a10e3-9d86-4f03-9658-af6beb16c74e None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:46.052285 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe1283d-d53c-4c6b-b62d-4e873bae003e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:46.052888 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe1283d-d53c-4c6b-b62d-4e873bae003e admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:46.053176 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe1283d-d53c-4c6b-b62d-4e873bae003e admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:46.053454 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe1283d-d53c-4c6b-b62d-4e873bae003e admin admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:46.054098 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe1283d-d53c-4c6b-b62d-4e873bae003e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:28:46.054404 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe1283d-d53c-4c6b-b62d-4e873bae003e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:46.055995 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe1283d-d53c-4c6b-b62d-4e873bae003e admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:46.068367 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1118/2198] 10.222.0.66 () {58 vars in 1153 bytes} [Mon Sep 19 10:28:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:28:46.073327 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c6ca6a-cf65-41f5-9889-a8f86d3406d5 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:46.083134 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c6ca6a-cf65-41f5-9889-a8f86d3406d5 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:46.088541 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df5534a-0f27-40c5-9311-e3d92064d61c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:46.089232 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df5534a-0f27-40c5-9311-e3d92064d61c admin admin] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:46.089536 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df5534a-0f27-40c5-9311-e3d92064d61c admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:46.089695 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df5534a-0f27-40c5-9311-e3d92064d61c admin admin] PATH_INFO: `/v3/projects` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:46.090342 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df5534a-0f27-40c5-9311-e3d92064d61c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:46.092281 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df5534a-0f27-40c5-9311-e3d92064d61c admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:46.120795 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1081/2199] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 19 10:28:46 2022] POST /identity/v3/projects => generated 375 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 10:28:46.125201 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe1283d-d53c-4c6b-b62d-4e873bae003e admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:46.136109 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe1283d-d53c-4c6b-b62d-4e873bae003e admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:46.195455 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16771b3c-dd0b-479f-9f1e-c9081682c6c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:46.196078 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16771b3c-dd0b-479f-9f1e-c9081682c6c2 admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:46.196383 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16771b3c-dd0b-479f-9f1e-c9081682c6c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:46.196690 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16771b3c-dd0b-479f-9f1e-c9081682c6c2 admin admin] PATH_INFO: `/v3/users` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:46.197787 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16771b3c-dd0b-479f-9f1e-c9081682c6c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:46.199838 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16771b3c-dd0b-479f-9f1e-c9081682c6c2 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:46.226573 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1119/2200] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 19 10:28:46 2022] POST /identity/v3/users => generated 288 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:28:46.229882 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df5534a-0f27-40c5-9311-e3d92064d61c admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:46.248540 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df5534a-0f27-40c5-9311-e3d92064d61c admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:46.253351 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51a6b7b-afe1-4b41-b4bb-ec3a8c252957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:46.253963 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51a6b7b-afe1-4b41-b4bb-ec3a8c252957 admin admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:46.254247 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51a6b7b-afe1-4b41-b4bb-ec3a8c252957 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:46.254523 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51a6b7b-afe1-4b41-b4bb-ec3a8c252957 admin admin] PATH_INFO: `/v3/roles` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:46.255171 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51a6b7b-afe1-4b41-b4bb-ec3a8c252957 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:46.256863 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51a6b7b-afe1-4b41-b4bb-ec3a8c252957 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:46.267684 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1082/2201] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:28:46 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 10:28:46.271719 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16771b3c-dd0b-479f-9f1e-c9081682c6c2 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:46.282775 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16771b3c-dd0b-479f-9f1e-c9081682c6c2 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:46.288065 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1178d1c2-e405-4670-becf-83ee43d7728e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:46.288701 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1178d1c2-e405-4670-becf-83ee43d7728e admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:46.288986 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1178d1c2-e405-4670-becf-83ee43d7728e admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:46.289265 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1178d1c2-e405-4670-becf-83ee43d7728e admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:46.289915 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1178d1c2-e405-4670-becf-83ee43d7728e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:46.291551 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1178d1c2-e405-4670-becf-83ee43d7728e admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:46.303888 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1120/2202] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:28:46 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 10:28:46.308963 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51a6b7b-afe1-4b41-b4bb-ec3a8c252957 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:46.319594 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51a6b7b-afe1-4b41-b4bb-ec3a8c252957 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:46.324930 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae08ff47-4d88-4c14-b520-b92b78486207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:46.325625 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae08ff47-4d88-4c14-b520-b92b78486207 admin admin] REQUEST_METHOD: `PUT` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:46.325900 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae08ff47-4d88-4c14-b520-b92b78486207 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:46.326176 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae08ff47-4d88-4c14-b520-b92b78486207 admin admin] PATH_INFO: `/v3/projects/deea41c4dc2840038bcc07817baa8ad6/users/848901d5ce034dbf842894c0e7e9a593/roles/cd5b42ed3b754b58817a62bbe74651b4` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:46.346482 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae08ff47-4d88-4c14-b520-b92b78486207 admin admin] RBAC: Authorizing `identity:create_grant(project_id=deea41c4dc2840038bcc07817baa8ad6, user_id=848901d5ce034dbf842894c0e7e9a593, role_id=cd5b42ed3b754b58817a62bbe74651b4)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:46.349302 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae08ff47-4d88-4c14-b520-b92b78486207 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:46.365952 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1083/2203] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 19 10:28:46 2022] PUT /identity/v3/projects/deea41c4dc2840038bcc07817baa8ad6/users/848901d5ce034dbf842894c0e7e9a593/roles/cd5b42ed3b754b58817a62bbe74651b4 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:28:46.377593 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58af0976-fa75-457a-9a96-c2f7a5af189b None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:46.377976 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58af0976-fa75-457a-9a96-c2f7a5af189b None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:46.378314 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58af0976-fa75-457a-9a96-c2f7a5af189b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:46.411820 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-58af0976-fa75-457a-9a96-c2f7a5af189b None None] MFA Rules not processed for user `848901d5ce034dbf842894c0e7e9a593`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:28:46.413097 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-58af0976-fa75-457a-9a96-c2f7a5af189b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:28:46.480475 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1121/2204] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:28:46 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:28:46.491463 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae08ff47-4d88-4c14-b520-b92b78486207 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:46.493159 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-ae08ff47-4d88-4c14-b520-b92b78486207 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:28:46.555765 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae08ff47-4d88-4c14-b520-b92b78486207 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:46.561059 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7b5dda-1b62-412c-b2a1-c7988ff2ec02 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa4d004fd44482cae761c4b3bdfab31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:46.562356 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7b5dda-1b62-412c-b2a1-c7988ff2ec02 service cinder] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:46.562643 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7b5dda-1b62-412c-b2a1-c7988ff2ec02 service cinder] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:46.562923 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7b5dda-1b62-412c-b2a1-c7988ff2ec02 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:46.571945 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7b5dda-1b62-412c-b2a1-c7988ff2ec02 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:46.573920 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7b5dda-1b62-412c-b2a1-c7988ff2ec02 service cinder] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:46.584073 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1084/2205] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:28:46 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:28:46.705294 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58af0976-fa75-457a-9a96-c2f7a5af189b None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:46.706770 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-58af0976-fa75-457a-9a96-c2f7a5af189b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:28:46.719366 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58af0976-fa75-457a-9a96-c2f7a5af189b None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:46.723068 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d9c3d7-85dd-4c47-9efc-3d701c125f1b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa4d004fd44482cae761c4b3bdfab31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:46.723684 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d9c3d7-85dd-4c47-9efc-3d701c125f1b service cinder] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:46.723967 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d9c3d7-85dd-4c47-9efc-3d701c125f1b service cinder] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:46.724274 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d9c3d7-85dd-4c47-9efc-3d701c125f1b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:46.726190 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-54d9c3d7-85dd-4c47-9efc-3d701c125f1b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:28:46.768139 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:28:46.801619 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d9c3d7-85dd-4c47-9efc-3d701c125f1b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:46.803440 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d9c3d7-85dd-4c47-9efc-3d701c125f1b service cinder] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:46.814643 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1122/2206] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:28:46 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:28:47.779054 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7b5dda-1b62-412c-b2a1-c7988ff2ec02 service cinder] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:47.788870 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7b5dda-1b62-412c-b2a1-c7988ff2ec02 service cinder] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:47.792920 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c985152-9fff-4655-830c-7c9460529746 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa4d004fd44482cae761c4b3bdfab31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:47.794196 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c985152-9fff-4655-830c-7c9460529746 service cinder] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:47.794196 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c985152-9fff-4655-830c-7c9460529746 service cinder] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:47.794196 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c985152-9fff-4655-830c-7c9460529746 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:47.796410 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-9c985152-9fff-4655-830c-7c9460529746 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:28:47.819536 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:28:47.880971 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c985152-9fff-4655-830c-7c9460529746 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:47.882785 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c985152-9fff-4655-830c-7c9460529746 service cinder] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:47.896787 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1085/2207] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:28:47 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:28:49.476278 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d9c3d7-85dd-4c47-9efc-3d701c125f1b service cinder] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:49.477721 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-54d9c3d7-85dd-4c47-9efc-3d701c125f1b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:28:49.543321 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d9c3d7-85dd-4c47-9efc-3d701c125f1b service cinder] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:49.548054 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f057e0-123d-452d-a5d1-45b5bfb7a2a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:49.548936 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f057e0-123d-452d-a5d1-45b5bfb7a2a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:49.549218 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f057e0-123d-452d-a5d1-45b5bfb7a2a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:49.549488 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f057e0-123d-452d-a5d1-45b5bfb7a2a8 admin admin] PATH_INFO: `/v3/users/dbdeafb3d65b4ca68fc56d594e869fc1` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:49.550632 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f057e0-123d-452d-a5d1-45b5bfb7a2a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dbdeafb3d65b4ca68fc56d594e869fc1)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:49.552584 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f057e0-123d-452d-a5d1-45b5bfb7a2a8 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:49.599978 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-b6f057e0-123d-452d-a5d1-45b5bfb7a2a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dbdeafb3d65b4ca68fc56d594e869fc1'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:49.607935 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-b6f057e0-123d-452d-a5d1-45b5bfb7a2a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dbdeafb3d65b4ca68fc56d594e869fc1'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:49.608604 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-b6f057e0-123d-452d-a5d1-45b5bfb7a2a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dbdeafb3d65b4ca68fc56d594e869fc1'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:49.609239 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-b6f057e0-123d-452d-a5d1-45b5bfb7a2a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dbdeafb3d65b4ca68fc56d594e869fc1'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:49.617172 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-b6f057e0-123d-452d-a5d1-45b5bfb7a2a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dbdeafb3d65b4ca68fc56d594e869fc1'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:49.637855 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1123/2208] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 19 10:28:49 2022] DELETE /identity/v3/users/dbdeafb3d65b4ca68fc56d594e869fc1 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:28:49.642462 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d66d141-85ec-48b9-a1c0-eafea160ba46 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:49.642975 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d66d141-85ec-48b9-a1c0-eafea160ba46 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:49.643362 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d66d141-85ec-48b9-a1c0-eafea160ba46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:49.663113 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-2d66d141-85ec-48b9-a1c0-eafea160ba46 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:28:49.664369 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-2d66d141-85ec-48b9-a1c0-eafea160ba46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:28:49.731665 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1086/2209] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:28:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 10:28:49.741317 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f057e0-123d-452d-a5d1-45b5bfb7a2a8 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:49.742815 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-b6f057e0-123d-452d-a5d1-45b5bfb7a2a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:28:49.803292 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f057e0-123d-452d-a5d1-45b5bfb7a2a8 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:49.807486 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7375d868-6981-45df-8b69-9fa45a3a5a6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c1289b015854c6bb6aee8fed6b807db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:49.808097 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7375d868-6981-45df-8b69-9fa45a3a5a6c service neutron] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:49.808404 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7375d868-6981-45df-8b69-9fa45a3a5a6c service neutron] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:49.808674 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7375d868-6981-45df-8b69-9fa45a3a5a6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:49.817758 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7375d868-6981-45df-8b69-9fa45a3a5a6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:49.819172 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7375d868-6981-45df-8b69-9fa45a3a5a6c service neutron] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:49.823157 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:28:49.830038 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1124/2210] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:28:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:28:50.138865 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d66d141-85ec-48b9-a1c0-eafea160ba46 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:50.140372 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-2d66d141-85ec-48b9-a1c0-eafea160ba46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:28:50.154781 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d66d141-85ec-48b9-a1c0-eafea160ba46 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:50.160795 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a443ce-b290-4411-8252-bf70c53be2f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:50.161884 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a443ce-b290-4411-8252-bf70c53be2f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:50.162157 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a443ce-b290-4411-8252-bf70c53be2f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:50.163781 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a443ce-b290-4411-8252-bf70c53be2f0 admin admin] PATH_INFO: `/v3/projects/d71507926e0546c4898521d2f7f89e33` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:50.169489 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a443ce-b290-4411-8252-bf70c53be2f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d71507926e0546c4898521d2f7f89e33)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:50.172824 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a443ce-b290-4411-8252-bf70c53be2f0 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:50.254064 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-c2a443ce-b290-4411-8252-bf70c53be2f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd71507926e0546c4898521d2f7f89e33', 'request_id': 'req-c2a443ce-b290-4411-8252-bf70c53be2f0'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:50.263966 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-c2a443ce-b290-4411-8252-bf70c53be2f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd71507926e0546c4898521d2f7f89e33', 'request_id': 'req-c2a443ce-b290-4411-8252-bf70c53be2f0'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:50.274066 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-c2a443ce-b290-4411-8252-bf70c53be2f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd71507926e0546c4898521d2f7f89e33', 'request_id': 'req-c2a443ce-b290-4411-8252-bf70c53be2f0'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:50.291982 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-c2a443ce-b290-4411-8252-bf70c53be2f0 admin admin] The token cache is being invalidate because project d71507926e0546c4898521d2f7f89e33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 10:28:50.292310 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-c2a443ce-b290-4411-8252-bf70c53be2f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:50.293153 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-c2a443ce-b290-4411-8252-bf70c53be2f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:50.295865 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1087/2211] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 19 10:28:50 2022] DELETE /identity/v3/projects/d71507926e0546c4898521d2f7f89e33 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:28:50.299859 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7375d868-6981-45df-8b69-9fa45a3a5a6c service neutron] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:50.312134 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7375d868-6981-45df-8b69-9fa45a3a5a6c service neutron] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:50.398812 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99ef060-2f4a-41e3-a767-ed35272686ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:50.399973 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99ef060-2f4a-41e3-a767-ed35272686ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:50.399973 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99ef060-2f4a-41e3-a767-ed35272686ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:50.400305 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99ef060-2f4a-41e3-a767-ed35272686ba admin admin] PATH_INFO: `/v3/users/c2133187aab84cf2948115fcb69a84ce` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:50.401517 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99ef060-2f4a-41e3-a767-ed35272686ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2133187aab84cf2948115fcb69a84ce)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:50.404206 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99ef060-2f4a-41e3-a767-ed35272686ba admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:50.476864 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-a99ef060-2f4a-41e3-a767-ed35272686ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2133187aab84cf2948115fcb69a84ce'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:50.504799 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-a99ef060-2f4a-41e3-a767-ed35272686ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2133187aab84cf2948115fcb69a84ce'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:50.505470 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-a99ef060-2f4a-41e3-a767-ed35272686ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2133187aab84cf2948115fcb69a84ce'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:50.506126 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-a99ef060-2f4a-41e3-a767-ed35272686ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2133187aab84cf2948115fcb69a84ce'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:50.515389 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-a99ef060-2f4a-41e3-a767-ed35272686ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2133187aab84cf2948115fcb69a84ce'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:50.543670 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1125/2212] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 19 10:28:50 2022] DELETE /identity/v3/users/c2133187aab84cf2948115fcb69a84ce => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:28:50.863552 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a443ce-b290-4411-8252-bf70c53be2f0 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:50.865111 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-c2a443ce-b290-4411-8252-bf70c53be2f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:28:50.878789 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a443ce-b290-4411-8252-bf70c53be2f0 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:50.955529 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:28:50.980751 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3205aed-1e36-4b52-9a32-3bdd0f46148a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:50.981520 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3205aed-1e36-4b52-9a32-3bdd0f46148a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:50.981798 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3205aed-1e36-4b52-9a32-3bdd0f46148a admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:50.982067 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3205aed-1e36-4b52-9a32-3bdd0f46148a admin admin] PATH_INFO: `/v3/projects/68f8b9e63f9d4d43888e662a8dbc00fb` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:50.983518 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3205aed-1e36-4b52-9a32-3bdd0f46148a admin admin] RBAC: Authorizing `identity:delete_project(project_id=68f8b9e63f9d4d43888e662a8dbc00fb)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:50.985490 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3205aed-1e36-4b52-9a32-3bdd0f46148a admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:51.032899 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-e3205aed-1e36-4b52-9a32-3bdd0f46148a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68f8b9e63f9d4d43888e662a8dbc00fb', 'request_id': 'req-e3205aed-1e36-4b52-9a32-3bdd0f46148a'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:51.039293 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-e3205aed-1e36-4b52-9a32-3bdd0f46148a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68f8b9e63f9d4d43888e662a8dbc00fb', 'request_id': 'req-e3205aed-1e36-4b52-9a32-3bdd0f46148a'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:51.046254 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-e3205aed-1e36-4b52-9a32-3bdd0f46148a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68f8b9e63f9d4d43888e662a8dbc00fb', 'request_id': 'req-e3205aed-1e36-4b52-9a32-3bdd0f46148a'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:51.056991 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-e3205aed-1e36-4b52-9a32-3bdd0f46148a admin admin] The token cache is being invalidate because project 68f8b9e63f9d4d43888e662a8dbc00fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 10:28:51.057277 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-e3205aed-1e36-4b52-9a32-3bdd0f46148a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:51.057904 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-e3205aed-1e36-4b52-9a32-3bdd0f46148a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:51.059376 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1088/2213] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 19 10:28:50 2022] DELETE /identity/v3/projects/68f8b9e63f9d4d43888e662a8dbc00fb => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:28:51.064762 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a4c106-bda5-41c4-bfc7-7bcdbf87663a None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:51.064992 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a4c106-bda5-41c4-bfc7-7bcdbf87663a None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:51.065271 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a4c106-bda5-41c4-bfc7-7bcdbf87663a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:51.085112 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-94a4c106-bda5-41c4-bfc7-7bcdbf87663a None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:28:51.086379 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-94a4c106-bda5-41c4-bfc7-7bcdbf87663a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:28:51.145843 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1126/2214] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:28:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:28:51.153646 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcc7482-41c6-4a95-a4d2-8f7f9d52df14 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:51.153966 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcc7482-41c6-4a95-a4d2-8f7f9d52df14 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:51.154197 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcc7482-41c6-4a95-a4d2-8f7f9d52df14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:51.174435 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-bfcc7482-41c6-4a95-a4d2-8f7f9d52df14 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:28:51.175644 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-bfcc7482-41c6-4a95-a4d2-8f7f9d52df14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:28:51.184313 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1089/2215] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:28:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:28:51.188414 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a4c106-bda5-41c4-bfc7-7bcdbf87663a None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:51.198126 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a4c106-bda5-41c4-bfc7-7bcdbf87663a None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:51.202707 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34938bb9-c0da-4560-9dec-719ec6985f80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:51.203311 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34938bb9-c0da-4560-9dec-719ec6985f80 admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:51.203594 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34938bb9-c0da-4560-9dec-719ec6985f80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:51.203872 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34938bb9-c0da-4560-9dec-719ec6985f80 admin admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:51.204555 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34938bb9-c0da-4560-9dec-719ec6985f80 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:28:51.204861 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34938bb9-c0da-4560-9dec-719ec6985f80 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:51.206458 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34938bb9-c0da-4560-9dec-719ec6985f80 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:51.217985 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1127/2216] 10.222.0.66 () {58 vars in 1153 bytes} [Mon Sep 19 10:28:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:28:51.222130 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcc7482-41c6-4a95-a4d2-8f7f9d52df14 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:51.232003 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcc7482-41c6-4a95-a4d2-8f7f9d52df14 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:51.236732 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acaafd4-fa15-4a78-a347-578b907d6149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:51.237328 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acaafd4-fa15-4a78-a347-578b907d6149 admin admin] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:51.237611 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acaafd4-fa15-4a78-a347-578b907d6149 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:51.237887 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acaafd4-fa15-4a78-a347-578b907d6149 admin admin] PATH_INFO: `/v3/projects` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:51.238526 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acaafd4-fa15-4a78-a347-578b907d6149 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:51.240465 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acaafd4-fa15-4a78-a347-578b907d6149 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:51.268050 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1090/2217] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 19 10:28:51 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:28:51.272341 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34938bb9-c0da-4560-9dec-719ec6985f80 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:51.278991 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:28:51.284513 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34938bb9-c0da-4560-9dec-719ec6985f80 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:51.347684 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b09c21-5841-48d5-a4fd-9d8522faa241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:51.348225 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b09c21-5841-48d5-a4fd-9d8522faa241 admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:51.348511 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b09c21-5841-48d5-a4fd-9d8522faa241 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:51.348787 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b09c21-5841-48d5-a4fd-9d8522faa241 admin admin] PATH_INFO: `/v3/users` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:51.349443 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b09c21-5841-48d5-a4fd-9d8522faa241 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:51.351505 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b09c21-5841-48d5-a4fd-9d8522faa241 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:51.375461 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1128/2218] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 19 10:28:51 2022] POST /identity/v3/users => generated 287 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:28:51.380317 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acaafd4-fa15-4a78-a347-578b907d6149 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:51.390772 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acaafd4-fa15-4a78-a347-578b907d6149 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:51.395511 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215a8273-56e9-40bf-b83b-260cc68fa3eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:51.396106 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215a8273-56e9-40bf-b83b-260cc68fa3eb admin admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:51.396420 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215a8273-56e9-40bf-b83b-260cc68fa3eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:51.396692 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215a8273-56e9-40bf-b83b-260cc68fa3eb admin admin] PATH_INFO: `/v3/roles` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:51.397328 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215a8273-56e9-40bf-b83b-260cc68fa3eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:51.398982 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215a8273-56e9-40bf-b83b-260cc68fa3eb admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:51.408800 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1091/2219] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:28:51 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 10:28:51.412834 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b09c21-5841-48d5-a4fd-9d8522faa241 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:51.423507 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b09c21-5841-48d5-a4fd-9d8522faa241 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:51.428194 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9f8df9-9e11-4d2d-a57d-ad05a883e7a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:51.428797 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9f8df9-9e11-4d2d-a57d-ad05a883e7a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:51.429085 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9f8df9-9e11-4d2d-a57d-ad05a883e7a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:51.429358 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9f8df9-9e11-4d2d-a57d-ad05a883e7a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:51.429989 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9f8df9-9e11-4d2d-a57d-ad05a883e7a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:51.432227 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9f8df9-9e11-4d2d-a57d-ad05a883e7a0 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:51.442853 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1129/2220] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:28:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 10:28:51.446927 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215a8273-56e9-40bf-b83b-260cc68fa3eb admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:51.456797 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215a8273-56e9-40bf-b83b-260cc68fa3eb admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:51.461388 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2cdd6b-27e4-4048-981d-0d92eeb968e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:51.462031 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2cdd6b-27e4-4048-981d-0d92eeb968e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:51.462307 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2cdd6b-27e4-4048-981d-0d92eeb968e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:51.462579 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2cdd6b-27e4-4048-981d-0d92eeb968e5 admin admin] PATH_INFO: `/v3/projects/ea9e1db18b0243d08c75d94cf74bcf09/users/00a6f69c0a3940fa80e799dec0d429b4/roles/cd5b42ed3b754b58817a62bbe74651b4` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:51.476868 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2cdd6b-27e4-4048-981d-0d92eeb968e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea9e1db18b0243d08c75d94cf74bcf09, user_id=00a6f69c0a3940fa80e799dec0d429b4, role_id=cd5b42ed3b754b58817a62bbe74651b4)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:51.480097 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2cdd6b-27e4-4048-981d-0d92eeb968e5 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:51.494448 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1092/2221] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 19 10:28:51 2022] PUT /identity/v3/projects/ea9e1db18b0243d08c75d94cf74bcf09/users/00a6f69c0a3940fa80e799dec0d429b4/roles/cd5b42ed3b754b58817a62bbe74651b4 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:28:51.505908 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dcb7f2-093e-4f07-a155-6171ddca8f01 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:51.506372 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dcb7f2-093e-4f07-a155-6171ddca8f01 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:51.506490 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dcb7f2-093e-4f07-a155-6171ddca8f01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:51.534950 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-c9dcb7f2-093e-4f07-a155-6171ddca8f01 None None] MFA Rules not processed for user `00a6f69c0a3940fa80e799dec0d429b4`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:28:51.536243 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-c9dcb7f2-093e-4f07-a155-6171ddca8f01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:28:51.608089 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1130/2222] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:28:51 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:28:51.612647 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2cdd6b-27e4-4048-981d-0d92eeb968e5 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:51.686245 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2cdd6b-27e4-4048-981d-0d92eeb968e5 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:51.692210 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4c6961-d7d4-4791-99ce-c707ba946af4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:51.692830 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4c6961-d7d4-4791-99ce-c707ba946af4 admin admin] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:51.693111 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4c6961-d7d4-4791-99ce-c707ba946af4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:51.693381 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4c6961-d7d4-4791-99ce-c707ba946af4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:51.694031 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4c6961-d7d4-4791-99ce-c707ba946af4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:51.696060 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4c6961-d7d4-4791-99ce-c707ba946af4 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:51.707697 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:28:51.726678 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1093/2223] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 19 10:28:51 2022] POST /identity/v3/projects => generated 373 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:28:51.731590 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dcb7f2-093e-4f07-a155-6171ddca8f01 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:51.742515 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dcb7f2-093e-4f07-a155-6171ddca8f01 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:51.802039 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec46baea-a54a-4a5d-8342-0495cc7687c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:51.802655 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec46baea-a54a-4a5d-8342-0495cc7687c2 admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:51.802935 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec46baea-a54a-4a5d-8342-0495cc7687c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:51.803212 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec46baea-a54a-4a5d-8342-0495cc7687c2 admin admin] PATH_INFO: `/v3/users` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:51.803842 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec46baea-a54a-4a5d-8342-0495cc7687c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:51.805808 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec46baea-a54a-4a5d-8342-0495cc7687c2 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:51.827739 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1131/2224] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 19 10:28:51 2022] POST /identity/v3/users => generated 293 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:28:51.831688 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4c6961-d7d4-4791-99ce-c707ba946af4 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:51.843052 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4c6961-d7d4-4791-99ce-c707ba946af4 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:51.848223 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcec1e87-992f-4eb6-9763-6141c2d9f5a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:51.848943 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcec1e87-992f-4eb6-9763-6141c2d9f5a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:51.849205 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcec1e87-992f-4eb6-9763-6141c2d9f5a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:51.849479 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcec1e87-992f-4eb6-9763-6141c2d9f5a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:51.850182 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcec1e87-992f-4eb6-9763-6141c2d9f5a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:51.851842 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcec1e87-992f-4eb6-9763-6141c2d9f5a8 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:51.863752 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1094/2225] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:28:51 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 10:28:51.868061 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec46baea-a54a-4a5d-8342-0495cc7687c2 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:51.873381 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:28:51.878859 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec46baea-a54a-4a5d-8342-0495cc7687c2 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:51.885232 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b8bd15-79cc-41dd-98ec-654e58f89b93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:51.885927 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b8bd15-79cc-41dd-98ec-654e58f89b93 admin admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:51.886211 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b8bd15-79cc-41dd-98ec-654e58f89b93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:51.886519 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b8bd15-79cc-41dd-98ec-654e58f89b93 admin admin] PATH_INFO: `/v3/projects/162b4ebc268c4da58c6c43fcb0a95a4d/users/b97362a2052d49578d1398904d41035f/roles/5c8b89fae4fa45bd944cbeaf442136e1` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:51.902641 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b8bd15-79cc-41dd-98ec-654e58f89b93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=162b4ebc268c4da58c6c43fcb0a95a4d, user_id=b97362a2052d49578d1398904d41035f, role_id=5c8b89fae4fa45bd944cbeaf442136e1)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:51.905456 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b8bd15-79cc-41dd-98ec-654e58f89b93 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:51.919739 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1132/2226] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 19 10:28:51 2022] PUT /identity/v3/projects/162b4ebc268c4da58c6c43fcb0a95a4d/users/b97362a2052d49578d1398904d41035f/roles/5c8b89fae4fa45bd944cbeaf442136e1 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 10:28:51.924444 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcec1e87-992f-4eb6-9763-6141c2d9f5a8 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:51.934576 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcec1e87-992f-4eb6-9763-6141c2d9f5a8 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:51.991427 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9607adc3-13dc-4138-9de8-7991a56ec2c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:51.992048 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9607adc3-13dc-4138-9de8-7991a56ec2c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:51.992366 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9607adc3-13dc-4138-9de8-7991a56ec2c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:51.992644 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9607adc3-13dc-4138-9de8-7991a56ec2c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:51.993298 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9607adc3-13dc-4138-9de8-7991a56ec2c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:51.995128 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9607adc3-13dc-4138-9de8-7991a56ec2c8 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:52.010385 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1095/2227] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:28:51 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 10:28:52.014817 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b8bd15-79cc-41dd-98ec-654e58f89b93 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:52.029920 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b8bd15-79cc-41dd-98ec-654e58f89b93 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:52.034764 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a41d1ee-3d79-4735-a7dd-8d3033f352a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:52.035440 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a41d1ee-3d79-4735-a7dd-8d3033f352a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:52.035724 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a41d1ee-3d79-4735-a7dd-8d3033f352a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:52.036004 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a41d1ee-3d79-4735-a7dd-8d3033f352a1 admin admin] PATH_INFO: `/v3/projects/162b4ebc268c4da58c6c43fcb0a95a4d/users/b97362a2052d49578d1398904d41035f/roles/5c8b89fae4fa45bd944cbeaf442136e1` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:52.038064 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a41d1ee-3d79-4735-a7dd-8d3033f352a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=162b4ebc268c4da58c6c43fcb0a95a4d, user_id=b97362a2052d49578d1398904d41035f, role_id=5c8b89fae4fa45bd944cbeaf442136e1)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:52.040764 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a41d1ee-3d79-4735-a7dd-8d3033f352a1 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:52.052244 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1133/2228] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 19 10:28:52 2022] PUT /identity/v3/projects/162b4ebc268c4da58c6c43fcb0a95a4d/users/b97362a2052d49578d1398904d41035f/roles/5c8b89fae4fa45bd944cbeaf442136e1 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:28:52.062949 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf7ab5a-affc-4532-9e85-3ed2f156bc01 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:52.063328 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf7ab5a-affc-4532-9e85-3ed2f156bc01 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:52.063667 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf7ab5a-affc-4532-9e85-3ed2f156bc01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:52.093639 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-3bf7ab5a-affc-4532-9e85-3ed2f156bc01 None None] MFA Rules not processed for user `b97362a2052d49578d1398904d41035f`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:28:52.094951 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-3bf7ab5a-affc-4532-9e85-3ed2f156bc01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:28:52.175776 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1096/2229] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:28:52 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:28:52.187248 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a41d1ee-3d79-4735-a7dd-8d3033f352a1 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:52.189132 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-8a41d1ee-3d79-4735-a7dd-8d3033f352a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:28:52.247186 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a41d1ee-3d79-4735-a7dd-8d3033f352a1 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:52.251018 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7977a3b-e3f5-486f-b6cf-e5b0d25b044c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa4d004fd44482cae761c4b3bdfab31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:52.251627 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7977a3b-e3f5-486f-b6cf-e5b0d25b044c service cinder] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:52.251909 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7977a3b-e3f5-486f-b6cf-e5b0d25b044c service cinder] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:52.252208 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7977a3b-e3f5-486f-b6cf-e5b0d25b044c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:52.262018 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7977a3b-e3f5-486f-b6cf-e5b0d25b044c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:52.263445 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7977a3b-e3f5-486f-b6cf-e5b0d25b044c service cinder] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:52.273324 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1134/2230] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:28:52 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 10:28:52.678529 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf7ab5a-affc-4532-9e85-3ed2f156bc01 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:52.756126 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf7ab5a-affc-4532-9e85-3ed2f156bc01 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:52.769090 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204fb246-5b01-4407-a48c-9384f5aac29b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:52.770487 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204fb246-5b01-4407-a48c-9384f5aac29b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:52.773172 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204fb246-5b01-4407-a48c-9384f5aac29b admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:52.773520 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204fb246-5b01-4407-a48c-9384f5aac29b admin admin] PATH_INFO: `/v3/users/00a6f69c0a3940fa80e799dec0d429b4` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:52.775141 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204fb246-5b01-4407-a48c-9384f5aac29b admin admin] RBAC: Authorizing `identity:delete_user(user_id=00a6f69c0a3940fa80e799dec0d429b4)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:52.777725 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204fb246-5b01-4407-a48c-9384f5aac29b admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:52.792629 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:28:52.838663 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-204fb246-5b01-4407-a48c-9384f5aac29b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00a6f69c0a3940fa80e799dec0d429b4'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:52.847857 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-204fb246-5b01-4407-a48c-9384f5aac29b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00a6f69c0a3940fa80e799dec0d429b4'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:52.848659 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-204fb246-5b01-4407-a48c-9384f5aac29b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00a6f69c0a3940fa80e799dec0d429b4'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:52.849409 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-204fb246-5b01-4407-a48c-9384f5aac29b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00a6f69c0a3940fa80e799dec0d429b4'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:52.858363 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-204fb246-5b01-4407-a48c-9384f5aac29b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00a6f69c0a3940fa80e799dec0d429b4'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:52.887651 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1097/2231] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 19 10:28:52 2022] DELETE /identity/v3/users/00a6f69c0a3940fa80e799dec0d429b4 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:28:52.890242 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3f2f1d-abfa-44af-a41e-89d653c93f33 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:52.890636 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3f2f1d-abfa-44af-a41e-89d653c93f33 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:52.890926 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3f2f1d-abfa-44af-a41e-89d653c93f33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:52.913594 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-fb3f2f1d-abfa-44af-a41e-89d653c93f33 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:28:52.914815 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-fb3f2f1d-abfa-44af-a41e-89d653c93f33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:28:53.029399 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1135/2232] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:28:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 10:28:53.038503 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204fb246-5b01-4407-a48c-9384f5aac29b admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:53.041277 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-204fb246-5b01-4407-a48c-9384f5aac29b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:28:53.104528 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204fb246-5b01-4407-a48c-9384f5aac29b admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:53.109498 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46755c4e-452e-4e41-a70a-2b36ab725f50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c1289b015854c6bb6aee8fed6b807db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:53.110118 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46755c4e-452e-4e41-a70a-2b36ab725f50 service neutron] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:53.110401 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46755c4e-452e-4e41-a70a-2b36ab725f50 service neutron] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:53.110680 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46755c4e-452e-4e41-a70a-2b36ab725f50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:53.120226 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46755c4e-452e-4e41-a70a-2b36ab725f50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:53.121672 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46755c4e-452e-4e41-a70a-2b36ab725f50 service neutron] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:53.131772 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1098/2233] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:28:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:28:53.683720 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3f2f1d-abfa-44af-a41e-89d653c93f33 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:53.685676 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-fb3f2f1d-abfa-44af-a41e-89d653c93f33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:28:53.699865 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3f2f1d-abfa-44af-a41e-89d653c93f33 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:53.704808 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4154ac29-ed30-4698-a5ff-78839c83703b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:53.705612 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4154ac29-ed30-4698-a5ff-78839c83703b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:53.705889 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4154ac29-ed30-4698-a5ff-78839c83703b admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:53.706163 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4154ac29-ed30-4698-a5ff-78839c83703b admin admin] PATH_INFO: `/v3/projects/ea9e1db18b0243d08c75d94cf74bcf09` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:53.707301 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4154ac29-ed30-4698-a5ff-78839c83703b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea9e1db18b0243d08c75d94cf74bcf09)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:53.709484 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4154ac29-ed30-4698-a5ff-78839c83703b admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:53.758569 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-4154ac29-ed30-4698-a5ff-78839c83703b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea9e1db18b0243d08c75d94cf74bcf09', 'request_id': 'req-4154ac29-ed30-4698-a5ff-78839c83703b'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:53.765532 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-4154ac29-ed30-4698-a5ff-78839c83703b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea9e1db18b0243d08c75d94cf74bcf09', 'request_id': 'req-4154ac29-ed30-4698-a5ff-78839c83703b'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:53.772864 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-4154ac29-ed30-4698-a5ff-78839c83703b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea9e1db18b0243d08c75d94cf74bcf09', 'request_id': 'req-4154ac29-ed30-4698-a5ff-78839c83703b'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:53.775378 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:28:53.785945 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-4154ac29-ed30-4698-a5ff-78839c83703b admin admin] The token cache is being invalidate because project ea9e1db18b0243d08c75d94cf74bcf09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 10:28:53.786235 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-4154ac29-ed30-4698-a5ff-78839c83703b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:53.786906 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-4154ac29-ed30-4698-a5ff-78839c83703b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:53.788668 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1136/2234] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 19 10:28:53 2022] DELETE /identity/v3/projects/ea9e1db18b0243d08c75d94cf74bcf09 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:28:53.792932 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46755c4e-452e-4e41-a70a-2b36ab725f50 service neutron] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:53.803029 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46755c4e-452e-4e41-a70a-2b36ab725f50 service neutron] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:53.869196 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b722718d-4e98-462f-aded-fd615a389615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:53.869862 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b722718d-4e98-462f-aded-fd615a389615 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:53.870164 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b722718d-4e98-462f-aded-fd615a389615 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:53.870424 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b722718d-4e98-462f-aded-fd615a389615 admin admin] PATH_INFO: `/v3/users/b97362a2052d49578d1398904d41035f` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:53.871648 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b722718d-4e98-462f-aded-fd615a389615 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b97362a2052d49578d1398904d41035f)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:53.873666 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b722718d-4e98-462f-aded-fd615a389615 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:53.905806 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:28:53.928761 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-b722718d-4e98-462f-aded-fd615a389615 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b97362a2052d49578d1398904d41035f'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:53.938287 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-b722718d-4e98-462f-aded-fd615a389615 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b97362a2052d49578d1398904d41035f'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:53.939064 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-b722718d-4e98-462f-aded-fd615a389615 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b97362a2052d49578d1398904d41035f'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:53.939756 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-b722718d-4e98-462f-aded-fd615a389615 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b97362a2052d49578d1398904d41035f'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:53.948367 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-b722718d-4e98-462f-aded-fd615a389615 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b97362a2052d49578d1398904d41035f'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:53.968206 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1099/2235] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 19 10:28:53 2022] DELETE /identity/v3/users/b97362a2052d49578d1398904d41035f => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:28:54.292595 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4154ac29-ed30-4698-a5ff-78839c83703b admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:54.294117 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-4154ac29-ed30-4698-a5ff-78839c83703b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:28:54.310107 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4154ac29-ed30-4698-a5ff-78839c83703b admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:54.391337 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66b27a1-14f1-4f79-b75b-dd05c6d381f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:54.392469 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66b27a1-14f1-4f79-b75b-dd05c6d381f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:54.392948 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66b27a1-14f1-4f79-b75b-dd05c6d381f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:54.393210 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66b27a1-14f1-4f79-b75b-dd05c6d381f0 admin admin] PATH_INFO: `/v3/projects/162b4ebc268c4da58c6c43fcb0a95a4d` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:54.395701 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66b27a1-14f1-4f79-b75b-dd05c6d381f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=162b4ebc268c4da58c6c43fcb0a95a4d)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:54.397497 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66b27a1-14f1-4f79-b75b-dd05c6d381f0 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:54.461568 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-f66b27a1-14f1-4f79-b75b-dd05c6d381f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '162b4ebc268c4da58c6c43fcb0a95a4d', 'request_id': 'req-f66b27a1-14f1-4f79-b75b-dd05c6d381f0'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:54.470222 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-f66b27a1-14f1-4f79-b75b-dd05c6d381f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '162b4ebc268c4da58c6c43fcb0a95a4d', 'request_id': 'req-f66b27a1-14f1-4f79-b75b-dd05c6d381f0'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:54.478393 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-f66b27a1-14f1-4f79-b75b-dd05c6d381f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '162b4ebc268c4da58c6c43fcb0a95a4d', 'request_id': 'req-f66b27a1-14f1-4f79-b75b-dd05c6d381f0'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:54.488970 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-f66b27a1-14f1-4f79-b75b-dd05c6d381f0 admin admin] The token cache is being invalidate because project 162b4ebc268c4da58c6c43fcb0a95a4d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 10:28:54.489255 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-f66b27a1-14f1-4f79-b75b-dd05c6d381f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:54.489882 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-f66b27a1-14f1-4f79-b75b-dd05c6d381f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:54.491399 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1137/2236] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 19 10:28:54 2022] DELETE /identity/v3/projects/162b4ebc268c4da58c6c43fcb0a95a4d => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:28:54.496962 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c08058-0f3a-46d1-b75f-23615f40bd8e None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:54.497323 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c08058-0f3a-46d1-b75f-23615f40bd8e None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:54.497555 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c08058-0f3a-46d1-b75f-23615f40bd8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:54.516893 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-d9c08058-0f3a-46d1-b75f-23615f40bd8e None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:28:54.518072 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-d9c08058-0f3a-46d1-b75f-23615f40bd8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:28:54.577712 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1100/2237] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:28:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:28:54.585646 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14d9028-700e-433a-829b-b816b4be92a9 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:54.585989 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14d9028-700e-433a-829b-b816b4be92a9 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:54.586249 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14d9028-700e-433a-829b-b816b4be92a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:54.607242 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-c14d9028-700e-433a-829b-b816b4be92a9 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:28:54.608503 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-c14d9028-700e-433a-829b-b816b4be92a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:28:54.616775 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1138/2238] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:28:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:28:54.621177 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c08058-0f3a-46d1-b75f-23615f40bd8e None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:54.630957 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c08058-0f3a-46d1-b75f-23615f40bd8e None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:54.636074 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db89752d-5f6d-49b6-be35-1931b197f8b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:54.636728 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db89752d-5f6d-49b6-be35-1931b197f8b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:54.637111 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db89752d-5f6d-49b6-be35-1931b197f8b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:54.637367 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db89752d-5f6d-49b6-be35-1931b197f8b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:54.638150 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db89752d-5f6d-49b6-be35-1931b197f8b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:28:54.638462 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db89752d-5f6d-49b6-be35-1931b197f8b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:54.640084 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db89752d-5f6d-49b6-be35-1931b197f8b0 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:54.656522 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1101/2239] 10.222.0.66 () {58 vars in 1153 bytes} [Mon Sep 19 10:28:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:28:54.657614 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14d9028-700e-433a-829b-b816b4be92a9 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:54.667416 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14d9028-700e-433a-829b-b816b4be92a9 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:54.673119 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3e99e3-6046-4230-b97b-124a27f8fa8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:54.674196 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3e99e3-6046-4230-b97b-124a27f8fa8d admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:54.674196 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3e99e3-6046-4230-b97b-124a27f8fa8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:54.674401 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3e99e3-6046-4230-b97b-124a27f8fa8d admin admin] PATH_INFO: `/v3/projects` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:54.675035 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3e99e3-6046-4230-b97b-124a27f8fa8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:54.676986 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3e99e3-6046-4230-b97b-124a27f8fa8d admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:54.714480 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1139/2240] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 19 10:28:54 2022] POST /identity/v3/projects => generated 361 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 10:28:54.720754 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db89752d-5f6d-49b6-be35-1931b197f8b0 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:54.732509 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db89752d-5f6d-49b6-be35-1931b197f8b0 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:54.803590 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9264541-63d1-46e5-aa11-97cd08c4eb32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:54.804346 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9264541-63d1-46e5-aa11-97cd08c4eb32 admin admin] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:54.804730 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9264541-63d1-46e5-aa11-97cd08c4eb32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:54.805082 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9264541-63d1-46e5-aa11-97cd08c4eb32 admin admin] PATH_INFO: `/v3/users` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:54.805851 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9264541-63d1-46e5-aa11-97cd08c4eb32 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:54.807913 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9264541-63d1-46e5-aa11-97cd08c4eb32 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:54.832283 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1102/2241] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 19 10:28:54 2022] POST /identity/v3/users => generated 281 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:28:54.833535 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3e99e3-6046-4230-b97b-124a27f8fa8d admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:54.844833 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3e99e3-6046-4230-b97b-124a27f8fa8d admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:54.849585 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887aed01-e533-4ba1-87e1-0cbaebc424af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:54.850189 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887aed01-e533-4ba1-87e1-0cbaebc424af admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:54.850472 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887aed01-e533-4ba1-87e1-0cbaebc424af admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:54.850749 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887aed01-e533-4ba1-87e1-0cbaebc424af admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:54.851389 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887aed01-e533-4ba1-87e1-0cbaebc424af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:54.854532 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887aed01-e533-4ba1-87e1-0cbaebc424af admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:54.865074 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1140/2242] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:28:54 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 10:28:54.869339 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9264541-63d1-46e5-aa11-97cd08c4eb32 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:54.879488 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9264541-63d1-46e5-aa11-97cd08c4eb32 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:54.884097 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f9b821-f6fc-4299-88e2-6c4256087882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:54.884731 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f9b821-f6fc-4299-88e2-6c4256087882 admin admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:54.885008 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f9b821-f6fc-4299-88e2-6c4256087882 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:54.885281 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f9b821-f6fc-4299-88e2-6c4256087882 admin admin] PATH_INFO: `/v3/roles` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:54.885924 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f9b821-f6fc-4299-88e2-6c4256087882 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:54.887582 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f9b821-f6fc-4299-88e2-6c4256087882 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:54.898534 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1103/2243] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:28:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 10:28:54.903391 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887aed01-e533-4ba1-87e1-0cbaebc424af admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:54.913568 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887aed01-e533-4ba1-87e1-0cbaebc424af admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:54.918874 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422f6770-39ec-451a-9829-84f701974e05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:54.919585 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422f6770-39ec-451a-9829-84f701974e05 admin admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:54.919792 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422f6770-39ec-451a-9829-84f701974e05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:54.920374 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422f6770-39ec-451a-9829-84f701974e05 admin admin] PATH_INFO: `/v3/projects/ad2204f4e5714edc9545f0d6b7aa20d0/users/6a0fed438ae2459993fac7f19e4ce518/roles/cd5b42ed3b754b58817a62bbe74651b4` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:54.934610 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422f6770-39ec-451a-9829-84f701974e05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad2204f4e5714edc9545f0d6b7aa20d0, user_id=6a0fed438ae2459993fac7f19e4ce518, role_id=cd5b42ed3b754b58817a62bbe74651b4)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:54.937282 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422f6770-39ec-451a-9829-84f701974e05 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:54.951817 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1141/2244] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 19 10:28:54 2022] PUT /identity/v3/projects/ad2204f4e5714edc9545f0d6b7aa20d0/users/6a0fed438ae2459993fac7f19e4ce518/roles/cd5b42ed3b754b58817a62bbe74651b4 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:28:54.964020 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df616ef-291d-48fb-b2dd-ab67d012c440 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:54.964519 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df616ef-291d-48fb-b2dd-ab67d012c440 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:54.964635 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df616ef-291d-48fb-b2dd-ab67d012c440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:54.984546 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:28:54.995415 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-7df616ef-291d-48fb-b2dd-ab67d012c440 None None] MFA Rules not processed for user `6a0fed438ae2459993fac7f19e4ce518`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:28:54.997046 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-7df616ef-291d-48fb-b2dd-ab67d012c440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:28:55.061442 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1104/2245] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:28:54 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:28:55.065983 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422f6770-39ec-451a-9829-84f701974e05 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:55.085541 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=89,keystone:DELETE=8,keystone:INSERT=3 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:28:55.128504 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422f6770-39ec-451a-9829-84f701974e05 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:55.133346 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad5807b-c88c-4634-a62d-aca499e24d9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:55.133929 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad5807b-c88c-4634-a62d-aca499e24d9b admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:55.134689 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad5807b-c88c-4634-a62d-aca499e24d9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:55.134956 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad5807b-c88c-4634-a62d-aca499e24d9b admin admin] PATH_INFO: `/v3/projects` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:55.135584 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad5807b-c88c-4634-a62d-aca499e24d9b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:55.137511 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad5807b-c88c-4634-a62d-aca499e24d9b admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:55.172211 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1142/2246] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 19 10:28:55 2022] POST /identity/v3/projects => generated 365 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:28:55.173343 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df616ef-291d-48fb-b2dd-ab67d012c440 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:55.184108 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df616ef-291d-48fb-b2dd-ab67d012c440 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:55.242529 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ab00df-0bbc-46f9-867f-8872b547d3c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:55.243144 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ab00df-0bbc-46f9-867f-8872b547d3c5 admin admin] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:55.243768 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ab00df-0bbc-46f9-867f-8872b547d3c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:55.243768 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ab00df-0bbc-46f9-867f-8872b547d3c5 admin admin] PATH_INFO: `/v3/users` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:55.244442 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ab00df-0bbc-46f9-867f-8872b547d3c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:55.246387 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ab00df-0bbc-46f9-867f-8872b547d3c5 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:55.267542 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1105/2247] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 19 10:28:55 2022] POST /identity/v3/users => generated 289 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:28:55.271640 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad5807b-c88c-4634-a62d-aca499e24d9b admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:55.282575 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad5807b-c88c-4634-a62d-aca499e24d9b admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:55.287480 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01186cf-b9a8-476c-9844-71f4e60c52e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:55.288085 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01186cf-b9a8-476c-9844-71f4e60c52e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:55.288405 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01186cf-b9a8-476c-9844-71f4e60c52e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:55.288683 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01186cf-b9a8-476c-9844-71f4e60c52e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:55.289326 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01186cf-b9a8-476c-9844-71f4e60c52e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:55.291146 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01186cf-b9a8-476c-9844-71f4e60c52e7 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:55.302135 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1143/2248] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:28:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 10:28:55.306942 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ab00df-0bbc-46f9-867f-8872b547d3c5 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:55.318024 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ab00df-0bbc-46f9-867f-8872b547d3c5 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:55.323491 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075bc046-a38c-4c5d-8a22-7b83d1ba361a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:55.324151 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075bc046-a38c-4c5d-8a22-7b83d1ba361a admin admin] REQUEST_METHOD: `PUT` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:55.324477 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075bc046-a38c-4c5d-8a22-7b83d1ba361a admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:55.324745 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075bc046-a38c-4c5d-8a22-7b83d1ba361a admin admin] PATH_INFO: `/v3/projects/9c5ece4166b548988036506a01b974ca/users/b26b85d27bad42aea19c99c6fb30432d/roles/5c8b89fae4fa45bd944cbeaf442136e1` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:55.340149 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075bc046-a38c-4c5d-8a22-7b83d1ba361a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c5ece4166b548988036506a01b974ca, user_id=b26b85d27bad42aea19c99c6fb30432d, role_id=5c8b89fae4fa45bd944cbeaf442136e1)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:55.342782 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075bc046-a38c-4c5d-8a22-7b83d1ba361a admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:55.357351 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1106/2249] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 19 10:28:55 2022] PUT /identity/v3/projects/9c5ece4166b548988036506a01b974ca/users/b26b85d27bad42aea19c99c6fb30432d/roles/5c8b89fae4fa45bd944cbeaf442136e1 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 10:28:55.361355 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01186cf-b9a8-476c-9844-71f4e60c52e7 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:55.373160 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01186cf-b9a8-476c-9844-71f4e60c52e7 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:55.418593 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075bc046-a38c-4c5d-8a22-7b83d1ba361a admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:55.420621 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-075bc046-a38c-4c5d-8a22-7b83d1ba361a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:28:55.440590 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001e5889-8d21-4d96-abcc-2166c414b079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:55.441315 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001e5889-8d21-4d96-abcc-2166c414b079 admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:55.442507 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001e5889-8d21-4d96-abcc-2166c414b079 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:55.443022 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001e5889-8d21-4d96-abcc-2166c414b079 admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:55.443726 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001e5889-8d21-4d96-abcc-2166c414b079 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:55.447151 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001e5889-8d21-4d96-abcc-2166c414b079 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:55.469228 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1144/2250] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:28:55 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 10:28:55.470337 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001e5889-8d21-4d96-abcc-2166c414b079 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:55.481431 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001e5889-8d21-4d96-abcc-2166c414b079 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:55.487135 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cccd01-d6c4-4cbc-a23c-bb9a4cc9d9d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:55.487980 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cccd01-d6c4-4cbc-a23c-bb9a4cc9d9d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:55.488292 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cccd01-d6c4-4cbc-a23c-bb9a4cc9d9d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:55.488567 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cccd01-d6c4-4cbc-a23c-bb9a4cc9d9d5 admin admin] PATH_INFO: `/v3/projects/9c5ece4166b548988036506a01b974ca/users/b26b85d27bad42aea19c99c6fb30432d/roles/5c8b89fae4fa45bd944cbeaf442136e1` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:55.490488 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cccd01-d6c4-4cbc-a23c-bb9a4cc9d9d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c5ece4166b548988036506a01b974ca, user_id=b26b85d27bad42aea19c99c6fb30432d, role_id=5c8b89fae4fa45bd944cbeaf442136e1)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:55.490769 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075bc046-a38c-4c5d-8a22-7b83d1ba361a admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:55.493337 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cccd01-d6c4-4cbc-a23c-bb9a4cc9d9d5 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:55.496029 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a385c30-c878-40ec-981e-e600c7b1a0f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:55.496857 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a385c30-c878-40ec-981e-e600c7b1a0f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:55.497467 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a385c30-c878-40ec-981e-e600c7b1a0f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:55.497752 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a385c30-c878-40ec-981e-e600c7b1a0f2 admin admin] PATH_INFO: `/v3/users/c4d6d94b77c34dbb9fc6b72a7fc6f080` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:55.499024 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a385c30-c878-40ec-981e-e600c7b1a0f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4d6d94b77c34dbb9fc6b72a7fc6f080)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:55.501378 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a385c30-c878-40ec-981e-e600c7b1a0f2 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:55.504733 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1145/2251] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 19 10:28:55 2022] PUT /identity/v3/projects/9c5ece4166b548988036506a01b974ca/users/b26b85d27bad42aea19c99c6fb30432d/roles/5c8b89fae4fa45bd944cbeaf442136e1 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:28:55.510816 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:28:55.515747 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada6ba78-8ed1-4793-b5d1-e5218c122d65 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:55.516082 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada6ba78-8ed1-4793-b5d1-e5218c122d65 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:55.516425 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada6ba78-8ed1-4793-b5d1-e5218c122d65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:55.546926 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-ada6ba78-8ed1-4793-b5d1-e5218c122d65 None None] MFA Rules not processed for user `b26b85d27bad42aea19c99c6fb30432d`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:28:55.548207 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-ada6ba78-8ed1-4793-b5d1-e5218c122d65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:28:55.557362 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-7a385c30-c878-40ec-981e-e600c7b1a0f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4d6d94b77c34dbb9fc6b72a7fc6f080'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:55.566892 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-7a385c30-c878-40ec-981e-e600c7b1a0f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4d6d94b77c34dbb9fc6b72a7fc6f080'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:55.567640 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-7a385c30-c878-40ec-981e-e600c7b1a0f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4d6d94b77c34dbb9fc6b72a7fc6f080'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:55.568775 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-7a385c30-c878-40ec-981e-e600c7b1a0f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4d6d94b77c34dbb9fc6b72a7fc6f080'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:55.578259 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-7a385c30-c878-40ec-981e-e600c7b1a0f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4d6d94b77c34dbb9fc6b72a7fc6f080'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:55.597648 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1107/2252] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 19 10:28:55 2022] DELETE /identity/v3/users/c4d6d94b77c34dbb9fc6b72a7fc6f080 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 10:28:55.601950 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f116dcb4-0606-4a8c-aff6-95cb530f7e93 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:55.602263 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f116dcb4-0606-4a8c-aff6-95cb530f7e93 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:55.602638 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f116dcb4-0606-4a8c-aff6-95cb530f7e93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:55.622152 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-f116dcb4-0606-4a8c-aff6-95cb530f7e93 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:28:55.622380 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:28:55.623409 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-f116dcb4-0606-4a8c-aff6-95cb530f7e93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:28:55.626919 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1146/2253] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:28:55 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:28:55.639503 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada6ba78-8ed1-4793-b5d1-e5218c122d65 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:55.641381 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-ada6ba78-8ed1-4793-b5d1-e5218c122d65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:28:55.697303 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1108/2254] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:28:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 10:28:55.706575 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f116dcb4-0606-4a8c-aff6-95cb530f7e93 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:55.707912 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-f116dcb4-0606-4a8c-aff6-95cb530f7e93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:28:55.715160 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada6ba78-8ed1-4793-b5d1-e5218c122d65 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:55.766985 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f116dcb4-0606-4a8c-aff6-95cb530f7e93 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:55.767246 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6284b62b-848f-4b10-adf6-e748b028ade1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa4d004fd44482cae761c4b3bdfab31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:55.767904 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6284b62b-848f-4b10-adf6-e748b028ade1 service cinder] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:55.768241 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6284b62b-848f-4b10-adf6-e748b028ade1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:55.768518 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6284b62b-848f-4b10-adf6-e748b028ade1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:55.770699 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329f0cb6-ecd3-448d-856b-5e9fd28a323c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c1289b015854c6bb6aee8fed6b807db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:55.771293 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329f0cb6-ecd3-448d-856b-5e9fd28a323c service neutron] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:55.771570 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329f0cb6-ecd3-448d-856b-5e9fd28a323c service neutron] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:55.771838 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329f0cb6-ecd3-448d-856b-5e9fd28a323c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:55.781196 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329f0cb6-ecd3-448d-856b-5e9fd28a323c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:55.782626 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329f0cb6-ecd3-448d-856b-5e9fd28a323c service neutron] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:55.793134 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1109/2255] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:28:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 10:28:55.834890 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6284b62b-848f-4b10-adf6-e748b028ade1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:55.836446 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6284b62b-848f-4b10-adf6-e748b028ade1 service cinder] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:55.857253 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1147/2256] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:28:55 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 10:28:56.151323 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329f0cb6-ecd3-448d-856b-5e9fd28a323c service neutron] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:56.153094 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-329f0cb6-ecd3-448d-856b-5e9fd28a323c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:28:56.175320 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329f0cb6-ecd3-448d-856b-5e9fd28a323c service neutron] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:56.180099 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc20a7d-6c51-4e28-988d-ba5c29b9c343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:56.180773 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc20a7d-6c51-4e28-988d-ba5c29b9c343 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:56.181733 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc20a7d-6c51-4e28-988d-ba5c29b9c343 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:56.182012 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc20a7d-6c51-4e28-988d-ba5c29b9c343 admin admin] PATH_INFO: `/v3/projects/c53ed724d80a49acb6a4d0308807859e` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:56.183135 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc20a7d-6c51-4e28-988d-ba5c29b9c343 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c53ed724d80a49acb6a4d0308807859e)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:56.185092 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc20a7d-6c51-4e28-988d-ba5c29b9c343 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:56.218343 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:28:56.257316 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-2fc20a7d-6c51-4e28-988d-ba5c29b9c343 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c53ed724d80a49acb6a4d0308807859e', 'request_id': 'req-2fc20a7d-6c51-4e28-988d-ba5c29b9c343'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:56.265199 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-2fc20a7d-6c51-4e28-988d-ba5c29b9c343 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c53ed724d80a49acb6a4d0308807859e', 'request_id': 'req-2fc20a7d-6c51-4e28-988d-ba5c29b9c343'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:56.276125 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-2fc20a7d-6c51-4e28-988d-ba5c29b9c343 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c53ed724d80a49acb6a4d0308807859e', 'request_id': 'req-2fc20a7d-6c51-4e28-988d-ba5c29b9c343'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:56.289489 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-2fc20a7d-6c51-4e28-988d-ba5c29b9c343 admin admin] The token cache is being invalidate because project c53ed724d80a49acb6a4d0308807859e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 10:28:56.289891 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-2fc20a7d-6c51-4e28-988d-ba5c29b9c343 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:56.290852 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-2fc20a7d-6c51-4e28-988d-ba5c29b9c343 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:56.296639 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1110/2257] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 19 10:28:56 2022] DELETE /identity/v3/projects/c53ed724d80a49acb6a4d0308807859e => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:28:56.298326 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6284b62b-848f-4b10-adf6-e748b028ade1 service cinder] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:56.311183 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6284b62b-848f-4b10-adf6-e748b028ade1 service cinder] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:56.379396 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685b9de2-873f-4cdd-8d33-a1337a81e602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:56.380299 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685b9de2-873f-4cdd-8d33-a1337a81e602 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:56.380658 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685b9de2-873f-4cdd-8d33-a1337a81e602 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:56.381008 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685b9de2-873f-4cdd-8d33-a1337a81e602 admin admin] PATH_INFO: `/v3/users/5f9bc762cf6c454ca49c51a509d1a32b` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:56.382471 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685b9de2-873f-4cdd-8d33-a1337a81e602 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f9bc762cf6c454ca49c51a509d1a32b)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:56.385265 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685b9de2-873f-4cdd-8d33-a1337a81e602 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:56.391926 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:28:56.412819 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc20a7d-6c51-4e28-988d-ba5c29b9c343 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:56.413868 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-2fc20a7d-6c51-4e28-988d-ba5c29b9c343 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:28:56.428229 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc20a7d-6c51-4e28-988d-ba5c29b9c343 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:56.434159 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb7406d-cfc4-487e-b153-9121d63be67f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:56.434961 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb7406d-cfc4-487e-b153-9121d63be67f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:56.435124 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb7406d-cfc4-487e-b153-9121d63be67f admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:56.435401 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb7406d-cfc4-487e-b153-9121d63be67f admin admin] PATH_INFO: `/v3/users/6a0fed438ae2459993fac7f19e4ce518` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:56.436762 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb7406d-cfc4-487e-b153-9121d63be67f admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a0fed438ae2459993fac7f19e4ce518)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:56.438896 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb7406d-cfc4-487e-b153-9121d63be67f admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:56.445823 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-685b9de2-873f-4cdd-8d33-a1337a81e602 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f9bc762cf6c454ca49c51a509d1a32b'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:56.454440 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-685b9de2-873f-4cdd-8d33-a1337a81e602 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f9bc762cf6c454ca49c51a509d1a32b'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:56.455482 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-685b9de2-873f-4cdd-8d33-a1337a81e602 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f9bc762cf6c454ca49c51a509d1a32b'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:56.456530 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-685b9de2-873f-4cdd-8d33-a1337a81e602 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f9bc762cf6c454ca49c51a509d1a32b'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:56.472389 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-685b9de2-873f-4cdd-8d33-a1337a81e602 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f9bc762cf6c454ca49c51a509d1a32b'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:56.505645 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1148/2258] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 19 10:28:56 2022] DELETE /identity/v3/users/5f9bc762cf6c454ca49c51a509d1a32b => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:28:56.505845 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-ebb7406d-cfc4-487e-b153-9121d63be67f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a0fed438ae2459993fac7f19e4ce518'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:56.528398 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-ebb7406d-cfc4-487e-b153-9121d63be67f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a0fed438ae2459993fac7f19e4ce518'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:56.529758 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-ebb7406d-cfc4-487e-b153-9121d63be67f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a0fed438ae2459993fac7f19e4ce518'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:56.530399 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-ebb7406d-cfc4-487e-b153-9121d63be67f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a0fed438ae2459993fac7f19e4ce518'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:56.544795 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-ebb7406d-cfc4-487e-b153-9121d63be67f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a0fed438ae2459993fac7f19e4ce518'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:56.575728 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1111/2259] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 19 10:28:56 2022] DELETE /identity/v3/users/6a0fed438ae2459993fac7f19e4ce518 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:28:56.580290 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c95da7a-002a-4340-b4d1-2104f0b7d17f None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:56.580684 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c95da7a-002a-4340-b4d1-2104f0b7d17f None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:56.581027 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c95da7a-002a-4340-b4d1-2104f0b7d17f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:56.613811 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-9c95da7a-002a-4340-b4d1-2104f0b7d17f None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:28:56.615208 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-9c95da7a-002a-4340-b4d1-2104f0b7d17f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:28:56.731799 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1149/2260] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:28:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:28:56.741774 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb7406d-cfc4-487e-b153-9121d63be67f admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:56.743459 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-ebb7406d-cfc4-487e-b153-9121d63be67f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:28:56.848930 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb7406d-cfc4-487e-b153-9121d63be67f admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:56.853617 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fd96e1-6a18-4408-b13f-5dfbd6d5cff3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c1289b015854c6bb6aee8fed6b807db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:56.854238 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fd96e1-6a18-4408-b13f-5dfbd6d5cff3 service neutron] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:56.854519 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fd96e1-6a18-4408-b13f-5dfbd6d5cff3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:56.854789 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fd96e1-6a18-4408-b13f-5dfbd6d5cff3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:56.876141 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fd96e1-6a18-4408-b13f-5dfbd6d5cff3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:56.877950 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fd96e1-6a18-4408-b13f-5dfbd6d5cff3 service neutron] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:56.891851 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1112/2261] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:28:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:28:56.906199 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c95da7a-002a-4340-b4d1-2104f0b7d17f None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:56.907928 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-9c95da7a-002a-4340-b4d1-2104f0b7d17f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:28:56.936844 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c95da7a-002a-4340-b4d1-2104f0b7d17f None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:56.942294 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79773d98-4c7c-49dd-b1f9-dd19ba827151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:56.942946 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79773d98-4c7c-49dd-b1f9-dd19ba827151 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:56.943254 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79773d98-4c7c-49dd-b1f9-dd19ba827151 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:56.943530 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79773d98-4c7c-49dd-b1f9-dd19ba827151 admin admin] PATH_INFO: `/v3/projects/4dbcc022fadd468f99049cb4cf60bb70` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:56.944876 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79773d98-4c7c-49dd-b1f9-dd19ba827151 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4dbcc022fadd468f99049cb4cf60bb70)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:56.947978 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79773d98-4c7c-49dd-b1f9-dd19ba827151 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:57.001274 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-79773d98-4c7c-49dd-b1f9-dd19ba827151 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4dbcc022fadd468f99049cb4cf60bb70', 'request_id': 'req-79773d98-4c7c-49dd-b1f9-dd19ba827151'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:57.008013 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-79773d98-4c7c-49dd-b1f9-dd19ba827151 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4dbcc022fadd468f99049cb4cf60bb70', 'request_id': 'req-79773d98-4c7c-49dd-b1f9-dd19ba827151'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:57.016499 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-79773d98-4c7c-49dd-b1f9-dd19ba827151 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4dbcc022fadd468f99049cb4cf60bb70', 'request_id': 'req-79773d98-4c7c-49dd-b1f9-dd19ba827151'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:57.028134 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-79773d98-4c7c-49dd-b1f9-dd19ba827151 admin admin] The token cache is being invalidate because project 4dbcc022fadd468f99049cb4cf60bb70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 10:28:57.028497 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-79773d98-4c7c-49dd-b1f9-dd19ba827151 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:57.029152 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-79773d98-4c7c-49dd-b1f9-dd19ba827151 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:57.035137 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1150/2262] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 19 10:28:56 2022] DELETE /identity/v3/projects/4dbcc022fadd468f99049cb4cf60bb70 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:28:57.036606 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fd96e1-6a18-4408-b13f-5dfbd6d5cff3 service neutron] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:57.047259 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fd96e1-6a18-4408-b13f-5dfbd6d5cff3 service neutron] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:57.071090 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:28:57.117769 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f507a0-f41d-4bd9-a519-ea6507f405fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:57.118999 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f507a0-f41d-4bd9-a519-ea6507f405fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:57.119197 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f507a0-f41d-4bd9-a519-ea6507f405fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:57.119438 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f507a0-f41d-4bd9-a519-ea6507f405fe admin admin] PATH_INFO: `/v3/users/0866375699b64eb893de2eb206ace280` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:57.120818 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f507a0-f41d-4bd9-a519-ea6507f405fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=0866375699b64eb893de2eb206ace280)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:57.122798 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f507a0-f41d-4bd9-a519-ea6507f405fe admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:57.188425 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-04f507a0-f41d-4bd9-a519-ea6507f405fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0866375699b64eb893de2eb206ace280'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:57.200835 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79773d98-4c7c-49dd-b1f9-dd19ba827151 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:57.202793 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-79773d98-4c7c-49dd-b1f9-dd19ba827151 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:28:57.220128 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79773d98-4c7c-49dd-b1f9-dd19ba827151 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:57.237260 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-04f507a0-f41d-4bd9-a519-ea6507f405fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0866375699b64eb893de2eb206ace280'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:57.237506 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3735b3bf-2d1d-4c22-8349-2b4246aa1dc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:57.238217 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3735b3bf-2d1d-4c22-8349-2b4246aa1dc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:57.238500 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3735b3bf-2d1d-4c22-8349-2b4246aa1dc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:57.238811 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-04f507a0-f41d-4bd9-a519-ea6507f405fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0866375699b64eb893de2eb206ace280'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:57.238966 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3735b3bf-2d1d-4c22-8349-2b4246aa1dc4 admin admin] PATH_INFO: `/v3/projects/ad2204f4e5714edc9545f0d6b7aa20d0` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:57.240291 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-04f507a0-f41d-4bd9-a519-ea6507f405fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0866375699b64eb893de2eb206ace280'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:57.240763 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3735b3bf-2d1d-4c22-8349-2b4246aa1dc4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad2204f4e5714edc9545f0d6b7aa20d0)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:57.243938 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3735b3bf-2d1d-4c22-8349-2b4246aa1dc4 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:57.247519 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:28:57.253870 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-04f507a0-f41d-4bd9-a519-ea6507f405fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0866375699b64eb893de2eb206ace280'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:57.294403 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1113/2263] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 19 10:28:57 2022] DELETE /identity/v3/users/0866375699b64eb893de2eb206ace280 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:28:57.365267 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-3735b3bf-2d1d-4c22-8349-2b4246aa1dc4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad2204f4e5714edc9545f0d6b7aa20d0', 'request_id': 'req-3735b3bf-2d1d-4c22-8349-2b4246aa1dc4'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:57.380249 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-3735b3bf-2d1d-4c22-8349-2b4246aa1dc4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad2204f4e5714edc9545f0d6b7aa20d0', 'request_id': 'req-3735b3bf-2d1d-4c22-8349-2b4246aa1dc4'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:57.392460 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-3735b3bf-2d1d-4c22-8349-2b4246aa1dc4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad2204f4e5714edc9545f0d6b7aa20d0', 'request_id': 'req-3735b3bf-2d1d-4c22-8349-2b4246aa1dc4'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:57.410350 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-3735b3bf-2d1d-4c22-8349-2b4246aa1dc4 admin admin] The token cache is being invalidate because project ad2204f4e5714edc9545f0d6b7aa20d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 10:28:57.410766 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-3735b3bf-2d1d-4c22-8349-2b4246aa1dc4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:57.411630 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-3735b3bf-2d1d-4c22-8349-2b4246aa1dc4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:57.413506 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1151/2264] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 19 10:28:57 2022] DELETE /identity/v3/projects/ad2204f4e5714edc9545f0d6b7aa20d0 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:28:57.418066 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f507a0-f41d-4bd9-a519-ea6507f405fe admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:57.419779 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-04f507a0-f41d-4bd9-a519-ea6507f405fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:28:57.530857 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f507a0-f41d-4bd9-a519-ea6507f405fe admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:57.595810 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:28:57.610000 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc0005e-ebbe-4d70-827c-79f934d5c061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:57.611032 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc0005e-ebbe-4d70-827c-79f934d5c061 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:57.614089 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc0005e-ebbe-4d70-827c-79f934d5c061 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:57.614964 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc0005e-ebbe-4d70-827c-79f934d5c061 admin admin] PATH_INFO: `/v3/users/b26b85d27bad42aea19c99c6fb30432d` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:57.616746 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc0005e-ebbe-4d70-827c-79f934d5c061 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b26b85d27bad42aea19c99c6fb30432d)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:57.620204 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc0005e-ebbe-4d70-827c-79f934d5c061 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:57.679763 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3735b3bf-2d1d-4c22-8349-2b4246aa1dc4 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:57.681360 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-3735b3bf-2d1d-4c22-8349-2b4246aa1dc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:28:57.697892 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-7cc0005e-ebbe-4d70-827c-79f934d5c061 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b26b85d27bad42aea19c99c6fb30432d'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:57.706721 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-7cc0005e-ebbe-4d70-827c-79f934d5c061 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b26b85d27bad42aea19c99c6fb30432d'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:57.707497 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-7cc0005e-ebbe-4d70-827c-79f934d5c061 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b26b85d27bad42aea19c99c6fb30432d'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:57.708235 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-7cc0005e-ebbe-4d70-827c-79f934d5c061 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b26b85d27bad42aea19c99c6fb30432d'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:57.710042 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3735b3bf-2d1d-4c22-8349-2b4246aa1dc4 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:57.716147 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c088ae-0c68-4945-81a4-131aad891f53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:57.716813 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c088ae-0c68-4945-81a4-131aad891f53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:57.717458 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c088ae-0c68-4945-81a4-131aad891f53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:57.717732 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c088ae-0c68-4945-81a4-131aad891f53 admin admin] PATH_INFO: `/v3/projects/0a30c976e334428082a20258dae9e0fa` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:57.717830 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-7cc0005e-ebbe-4d70-827c-79f934d5c061 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b26b85d27bad42aea19c99c6fb30432d'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:57.718912 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c088ae-0c68-4945-81a4-131aad891f53 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a30c976e334428082a20258dae9e0fa)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:57.720869 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c088ae-0c68-4945-81a4-131aad891f53 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:57.737367 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1114/2265] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 19 10:28:57 2022] DELETE /identity/v3/users/b26b85d27bad42aea19c99c6fb30432d => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 10:28:57.771105 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-a3c088ae-0c68-4945-81a4-131aad891f53 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a30c976e334428082a20258dae9e0fa', 'request_id': 'req-a3c088ae-0c68-4945-81a4-131aad891f53'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:57.778981 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-a3c088ae-0c68-4945-81a4-131aad891f53 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a30c976e334428082a20258dae9e0fa', 'request_id': 'req-a3c088ae-0c68-4945-81a4-131aad891f53'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:57.787508 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-a3c088ae-0c68-4945-81a4-131aad891f53 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a30c976e334428082a20258dae9e0fa', 'request_id': 'req-a3c088ae-0c68-4945-81a4-131aad891f53'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:57.800662 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-a3c088ae-0c68-4945-81a4-131aad891f53 admin admin] The token cache is being invalidate because project 0a30c976e334428082a20258dae9e0fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 10:28:57.800954 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-a3c088ae-0c68-4945-81a4-131aad891f53 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:57.801869 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-a3c088ae-0c68-4945-81a4-131aad891f53 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:57.803540 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1152/2266] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 19 10:28:57 2022] DELETE /identity/v3/projects/0a30c976e334428082a20258dae9e0fa => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:28:58.072902 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc0005e-ebbe-4d70-827c-79f934d5c061 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:58.074273 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-7cc0005e-ebbe-4d70-827c-79f934d5c061 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:28:58.162861 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc0005e-ebbe-4d70-827c-79f934d5c061 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:58.261009 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29f485f-c640-4888-a6d0-121abb841de0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:58.263371 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29f485f-c640-4888-a6d0-121abb841de0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:58.263371 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29f485f-c640-4888-a6d0-121abb841de0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:58.263371 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29f485f-c640-4888-a6d0-121abb841de0 admin admin] PATH_INFO: `/v3/projects/9c5ece4166b548988036506a01b974ca` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:58.265005 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29f485f-c640-4888-a6d0-121abb841de0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c5ece4166b548988036506a01b974ca)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:58.269076 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29f485f-c640-4888-a6d0-121abb841de0 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:58.303269 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:28:58.330960 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-c29f485f-c640-4888-a6d0-121abb841de0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c5ece4166b548988036506a01b974ca', 'request_id': 'req-c29f485f-c640-4888-a6d0-121abb841de0'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:58.337548 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-c29f485f-c640-4888-a6d0-121abb841de0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c5ece4166b548988036506a01b974ca', 'request_id': 'req-c29f485f-c640-4888-a6d0-121abb841de0'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:58.344970 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-c29f485f-c640-4888-a6d0-121abb841de0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c5ece4166b548988036506a01b974ca', 'request_id': 'req-c29f485f-c640-4888-a6d0-121abb841de0'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:58.355440 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-c29f485f-c640-4888-a6d0-121abb841de0 admin admin] The token cache is being invalidate because project 9c5ece4166b548988036506a01b974ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 10:28:58.355722 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-c29f485f-c640-4888-a6d0-121abb841de0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:58.356380 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-c29f485f-c640-4888-a6d0-121abb841de0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:28:58.358378 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1115/2267] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 19 10:28:58 2022] DELETE /identity/v3/projects/9c5ece4166b548988036506a01b974ca => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:28:58.363971 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a8db9a-42cf-4f79-95e0-4b65e72ad23a None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:58.364303 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a8db9a-42cf-4f79-95e0-4b65e72ad23a None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:58.364590 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a8db9a-42cf-4f79-95e0-4b65e72ad23a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:58.388653 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-37a8db9a-42cf-4f79-95e0-4b65e72ad23a None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:28:58.389910 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-37a8db9a-42cf-4f79-95e0-4b65e72ad23a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:28:58.462993 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1153/2268] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:28:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:28:58.473694 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993b024f-f03b-449e-ac0a-16891883df3d None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:58.473991 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993b024f-f03b-449e-ac0a-16891883df3d None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:58.474876 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993b024f-f03b-449e-ac0a-16891883df3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:58.496859 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-993b024f-f03b-449e-ac0a-16891883df3d None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:28:58.498094 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-993b024f-f03b-449e-ac0a-16891883df3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:28:58.506651 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1116/2269] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:28:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:28:58.511730 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a8db9a-42cf-4f79-95e0-4b65e72ad23a None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:58.521487 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a8db9a-42cf-4f79-95e0-4b65e72ad23a None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:58.526170 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1cc268-e8bb-47e5-bcda-b37e70f6f605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:58.526788 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1cc268-e8bb-47e5-bcda-b37e70f6f605 admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:58.527070 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1cc268-e8bb-47e5-bcda-b37e70f6f605 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:58.527348 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1cc268-e8bb-47e5-bcda-b37e70f6f605 admin admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:58.528000 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1cc268-e8bb-47e5-bcda-b37e70f6f605 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:28:58.528346 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1cc268-e8bb-47e5-bcda-b37e70f6f605 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:58.529960 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1cc268-e8bb-47e5-bcda-b37e70f6f605 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:58.542421 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1154/2270] 10.222.0.66 () {58 vars in 1153 bytes} [Mon Sep 19 10:28:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:28:58.546938 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993b024f-f03b-449e-ac0a-16891883df3d None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:58.557067 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993b024f-f03b-449e-ac0a-16891883df3d None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:58.561776 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462f8ec1-9fa6-4b90-b06e-bc9474f73420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:58.562387 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462f8ec1-9fa6-4b90-b06e-bc9474f73420 admin admin] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:58.562674 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462f8ec1-9fa6-4b90-b06e-bc9474f73420 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:58.562941 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462f8ec1-9fa6-4b90-b06e-bc9474f73420 admin admin] PATH_INFO: `/v3/projects` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:58.563577 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462f8ec1-9fa6-4b90-b06e-bc9474f73420 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:58.565534 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462f8ec1-9fa6-4b90-b06e-bc9474f73420 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:58.598294 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1117/2271] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 19 10:28:58 2022] POST /identity/v3/projects => generated 381 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:28:58.603645 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1cc268-e8bb-47e5-bcda-b37e70f6f605 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:58.609532 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:28:58.616270 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1cc268-e8bb-47e5-bcda-b37e70f6f605 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:58.682525 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b071ec85-c75a-4b1f-9b6c-9ce4365737f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:58.683127 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b071ec85-c75a-4b1f-9b6c-9ce4365737f4 admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:58.683407 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b071ec85-c75a-4b1f-9b6c-9ce4365737f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:58.683680 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b071ec85-c75a-4b1f-9b6c-9ce4365737f4 admin admin] PATH_INFO: `/v3/users` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:58.684365 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b071ec85-c75a-4b1f-9b6c-9ce4365737f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:58.686329 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b071ec85-c75a-4b1f-9b6c-9ce4365737f4 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:58.717971 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1155/2272] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 19 10:28:58 2022] POST /identity/v3/users => generated 291 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:28:58.720062 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462f8ec1-9fa6-4b90-b06e-bc9474f73420 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:58.730427 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462f8ec1-9fa6-4b90-b06e-bc9474f73420 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:58.734979 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cadada-13ca-4a94-9f11-190dc948279f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:58.735568 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cadada-13ca-4a94-9f11-190dc948279f admin admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:58.735847 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cadada-13ca-4a94-9f11-190dc948279f admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:58.736116 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cadada-13ca-4a94-9f11-190dc948279f admin admin] PATH_INFO: `/v3/roles` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:58.736775 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cadada-13ca-4a94-9f11-190dc948279f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:58.738399 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cadada-13ca-4a94-9f11-190dc948279f admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:58.748207 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1118/2273] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:28:58 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 10:28:58.752252 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b071ec85-c75a-4b1f-9b6c-9ce4365737f4 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:58.763063 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b071ec85-c75a-4b1f-9b6c-9ce4365737f4 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:58.767735 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdba353d-1631-41c3-854c-38a84a3988d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:58.768372 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdba353d-1631-41c3-854c-38a84a3988d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:58.768656 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdba353d-1631-41c3-854c-38a84a3988d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:58.768962 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdba353d-1631-41c3-854c-38a84a3988d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:58.769621 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdba353d-1631-41c3-854c-38a84a3988d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:58.771230 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdba353d-1631-41c3-854c-38a84a3988d3 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:58.782695 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1156/2274] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:28:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 10:28:58.786898 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cadada-13ca-4a94-9f11-190dc948279f admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:58.797080 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cadada-13ca-4a94-9f11-190dc948279f admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:58.801698 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fe24ee-b567-42a5-b8cc-0bab4a95eb94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:58.802343 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fe24ee-b567-42a5-b8cc-0bab4a95eb94 admin admin] REQUEST_METHOD: `PUT` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:58.802626 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fe24ee-b567-42a5-b8cc-0bab4a95eb94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:58.802906 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fe24ee-b567-42a5-b8cc-0bab4a95eb94 admin admin] PATH_INFO: `/v3/projects/79a439936abc4ddea562e0faea17717a/users/3ef46d72192e44f5aabd99af49f9c5c1/roles/cd5b42ed3b754b58817a62bbe74651b4` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:58.818599 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fe24ee-b567-42a5-b8cc-0bab4a95eb94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79a439936abc4ddea562e0faea17717a, user_id=3ef46d72192e44f5aabd99af49f9c5c1, role_id=cd5b42ed3b754b58817a62bbe74651b4)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:58.821312 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fe24ee-b567-42a5-b8cc-0bab4a95eb94 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:58.834788 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1119/2275] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 19 10:28:58 2022] PUT /identity/v3/projects/79a439936abc4ddea562e0faea17717a/users/3ef46d72192e44f5aabd99af49f9c5c1/roles/cd5b42ed3b754b58817a62bbe74651b4 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:28:58.846792 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f5d0fd-3cf9-4ba1-9a11-1362e758c126 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:58.847084 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f5d0fd-3cf9-4ba1-9a11-1362e758c126 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:58.847365 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f5d0fd-3cf9-4ba1-9a11-1362e758c126 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:58.876088 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-b6f5d0fd-3cf9-4ba1-9a11-1362e758c126 None None] MFA Rules not processed for user `3ef46d72192e44f5aabd99af49f9c5c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:28:58.877337 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-b6f5d0fd-3cf9-4ba1-9a11-1362e758c126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:28:58.945857 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1157/2276] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:28:58 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:28:58.950642 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fe24ee-b567-42a5-b8cc-0bab4a95eb94 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:59.013854 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fe24ee-b567-42a5-b8cc-0bab4a95eb94 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:59.018509 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e264cac-fc3e-40d4-9192-b5d2276ddf15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:59.019114 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e264cac-fc3e-40d4-9192-b5d2276ddf15 admin admin] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:59.019396 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e264cac-fc3e-40d4-9192-b5d2276ddf15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:59.019669 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e264cac-fc3e-40d4-9192-b5d2276ddf15 admin admin] PATH_INFO: `/v3/projects` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:59.020326 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e264cac-fc3e-40d4-9192-b5d2276ddf15 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:59.022268 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e264cac-fc3e-40d4-9192-b5d2276ddf15 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:59.050014 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1120/2277] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 19 10:28:58 2022] POST /identity/v3/projects => generated 381 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:28:59.054220 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f5d0fd-3cf9-4ba1-9a11-1362e758c126 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:59.065410 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f5d0fd-3cf9-4ba1-9a11-1362e758c126 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:59.122183 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e6705e-78ab-49e5-b0f1-54e7ffd7cbd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:59.122903 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e6705e-78ab-49e5-b0f1-54e7ffd7cbd9 admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:59.123255 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e6705e-78ab-49e5-b0f1-54e7ffd7cbd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:59.123599 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e6705e-78ab-49e5-b0f1-54e7ffd7cbd9 admin admin] PATH_INFO: `/v3/users` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:59.124385 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e6705e-78ab-49e5-b0f1-54e7ffd7cbd9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:59.126333 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e6705e-78ab-49e5-b0f1-54e7ffd7cbd9 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:59.149227 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:28:59.158852 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1158/2278] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 19 10:28:59 2022] POST /identity/v3/users => generated 297 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:28:59.159783 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e264cac-fc3e-40d4-9192-b5d2276ddf15 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:59.170911 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e264cac-fc3e-40d4-9192-b5d2276ddf15 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:59.176427 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47fdc05-7792-4949-81f8-e135cd875702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:59.177566 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47fdc05-7792-4949-81f8-e135cd875702 admin admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:59.177566 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47fdc05-7792-4949-81f8-e135cd875702 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:59.177742 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47fdc05-7792-4949-81f8-e135cd875702 admin admin] PATH_INFO: `/v3/roles` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:59.178358 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47fdc05-7792-4949-81f8-e135cd875702 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:59.179974 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47fdc05-7792-4949-81f8-e135cd875702 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:59.193191 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1121/2279] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:28:59 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 10:28:59.198009 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e6705e-78ab-49e5-b0f1-54e7ffd7cbd9 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:59.208719 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e6705e-78ab-49e5-b0f1-54e7ffd7cbd9 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:59.213922 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb91cb56-6d58-42d3-a6f2-5c0ad7df42d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:59.214585 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb91cb56-6d58-42d3-a6f2-5c0ad7df42d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:59.214888 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb91cb56-6d58-42d3-a6f2-5c0ad7df42d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:59.215162 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb91cb56-6d58-42d3-a6f2-5c0ad7df42d2 admin admin] PATH_INFO: `/v3/projects/2cc273c49bce4fbf80ad7c98d1951d4c/users/aad70710737b4990872c48432f847105/roles/5c8b89fae4fa45bd944cbeaf442136e1` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:59.230948 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb91cb56-6d58-42d3-a6f2-5c0ad7df42d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2cc273c49bce4fbf80ad7c98d1951d4c, user_id=aad70710737b4990872c48432f847105, role_id=5c8b89fae4fa45bd944cbeaf442136e1)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:59.233749 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb91cb56-6d58-42d3-a6f2-5c0ad7df42d2 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:59.248356 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1159/2280] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 19 10:28:59 2022] PUT /identity/v3/projects/2cc273c49bce4fbf80ad7c98d1951d4c/users/aad70710737b4990872c48432f847105/roles/5c8b89fae4fa45bd944cbeaf442136e1 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 10:28:59.252506 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47fdc05-7792-4949-81f8-e135cd875702 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:59.263247 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47fdc05-7792-4949-81f8-e135cd875702 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:59.275966 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:28:59.329274 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b5f17d-5680-4615-a467-12e3f02421e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:59.330052 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b5f17d-5680-4615-a467-12e3f02421e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:59.330341 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b5f17d-5680-4615-a467-12e3f02421e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:59.330616 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b5f17d-5680-4615-a467-12e3f02421e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:59.331609 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b5f17d-5680-4615-a467-12e3f02421e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:59.333325 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b5f17d-5680-4615-a467-12e3f02421e9 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:59.344351 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1122/2281] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:28:59 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 10:28:59.365415 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb91cb56-6d58-42d3-a6f2-5c0ad7df42d2 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:59.378297 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb91cb56-6d58-42d3-a6f2-5c0ad7df42d2 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:59.385065 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6b55ec-0efd-4bd8-9eec-d7b86b260990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:59.385897 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6b55ec-0efd-4bd8-9eec-d7b86b260990 admin admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:59.386446 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6b55ec-0efd-4bd8-9eec-d7b86b260990 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:59.386606 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6b55ec-0efd-4bd8-9eec-d7b86b260990 admin admin] PATH_INFO: `/v3/projects/2cc273c49bce4fbf80ad7c98d1951d4c/users/aad70710737b4990872c48432f847105/roles/5c8b89fae4fa45bd944cbeaf442136e1` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:59.389451 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6b55ec-0efd-4bd8-9eec-d7b86b260990 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2cc273c49bce4fbf80ad7c98d1951d4c, user_id=aad70710737b4990872c48432f847105, role_id=5c8b89fae4fa45bd944cbeaf442136e1)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:59.392594 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6b55ec-0efd-4bd8-9eec-d7b86b260990 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:59.412657 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1160/2282] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 19 10:28:59 2022] PUT /identity/v3/projects/2cc273c49bce4fbf80ad7c98d1951d4c/users/aad70710737b4990872c48432f847105/roles/5c8b89fae4fa45bd944cbeaf442136e1 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:28:59.423670 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84ae86d-3169-458b-af56-91d0d32879ba None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:59.424039 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84ae86d-3169-458b-af56-91d0d32879ba None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:59.424428 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84ae86d-3169-458b-af56-91d0d32879ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:59.463450 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-f84ae86d-3169-458b-af56-91d0d32879ba None None] MFA Rules not processed for user `aad70710737b4990872c48432f847105`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:28:59.464648 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-f84ae86d-3169-458b-af56-91d0d32879ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:28:59.537461 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1123/2283] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:28:59 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 10:28:59.549125 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6b55ec-0efd-4bd8-9eec-d7b86b260990 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:28:59.551071 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-fc6b55ec-0efd-4bd8-9eec-d7b86b260990 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:28:59.613510 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6b55ec-0efd-4bd8-9eec-d7b86b260990 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:28:59.617214 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd0cd9a-397f-4849-bc23-99b8c89ee03e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa4d004fd44482cae761c4b3bdfab31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:28:59.617841 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd0cd9a-397f-4849-bc23-99b8c89ee03e service cinder] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:28:59.618120 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd0cd9a-397f-4849-bc23-99b8c89ee03e service cinder] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:28:59.619005 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd0cd9a-397f-4849-bc23-99b8c89ee03e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:28:59.629006 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd0cd9a-397f-4849-bc23-99b8c89ee03e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:28:59.630442 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd0cd9a-397f-4849-bc23-99b8c89ee03e service cinder] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:28:59.640771 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1161/2284] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:28:59 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:29:00.062359 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84ae86d-3169-458b-af56-91d0d32879ba None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:29:00.125983 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84ae86d-3169-458b-af56-91d0d32879ba None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:29:00.130545 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be2dc71-fef4-429a-b324-41f8185027ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:29:00.131181 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be2dc71-fef4-429a-b324-41f8185027ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:29:00.131463 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be2dc71-fef4-429a-b324-41f8185027ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:29:00.131738 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be2dc71-fef4-429a-b324-41f8185027ed admin admin] PATH_INFO: `/v3/users/3ef46d72192e44f5aabd99af49f9c5c1` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:29:00.132887 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be2dc71-fef4-429a-b324-41f8185027ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ef46d72192e44f5aabd99af49f9c5c1)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:29:00.135446 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be2dc71-fef4-429a-b324-41f8185027ed admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:29:00.178977 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:29:00.185026 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-8be2dc71-fef4-429a-b324-41f8185027ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ef46d72192e44f5aabd99af49f9c5c1'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:29:00.192739 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-8be2dc71-fef4-429a-b324-41f8185027ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ef46d72192e44f5aabd99af49f9c5c1'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:29:00.193363 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-8be2dc71-fef4-429a-b324-41f8185027ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ef46d72192e44f5aabd99af49f9c5c1'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:29:00.194105 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-8be2dc71-fef4-429a-b324-41f8185027ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ef46d72192e44f5aabd99af49f9c5c1'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:29:00.201364 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-8be2dc71-fef4-429a-b324-41f8185027ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ef46d72192e44f5aabd99af49f9c5c1'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:29:00.218333 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1124/2285] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 19 10:29:00 2022] DELETE /identity/v3/users/3ef46d72192e44f5aabd99af49f9c5c1 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:29:00.222838 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669ebc99-0093-454e-8fa1-5c65632eade7 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:29:00.223115 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669ebc99-0093-454e-8fa1-5c65632eade7 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:29:00.223392 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669ebc99-0093-454e-8fa1-5c65632eade7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:29:00.242952 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-669ebc99-0093-454e-8fa1-5c65632eade7 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:29:00.244770 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-669ebc99-0093-454e-8fa1-5c65632eade7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:29:00.309320 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1162/2286] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:29:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:29:00.319756 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be2dc71-fef4-429a-b324-41f8185027ed admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:29:00.321382 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-8be2dc71-fef4-429a-b324-41f8185027ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:29:00.382681 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be2dc71-fef4-429a-b324-41f8185027ed admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:29:00.386697 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa379939-ad36-4c0e-b164-bc0ea1a62695 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c1289b015854c6bb6aee8fed6b807db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:29:00.387490 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa379939-ad36-4c0e-b164-bc0ea1a62695 service neutron] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:29:00.387669 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa379939-ad36-4c0e-b164-bc0ea1a62695 service neutron] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:29:00.387905 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa379939-ad36-4c0e-b164-bc0ea1a62695 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:29:00.397555 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa379939-ad36-4c0e-b164-bc0ea1a62695 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:29:00.398976 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa379939-ad36-4c0e-b164-bc0ea1a62695 service neutron] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:29:00.408544 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1125/2287] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:29:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:29:00.831847 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669ebc99-0093-454e-8fa1-5c65632eade7 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:29:00.833390 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-669ebc99-0093-454e-8fa1-5c65632eade7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:29:00.846442 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669ebc99-0093-454e-8fa1-5c65632eade7 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:29:00.866898 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f35004f-6a83-470e-936e-1a919135b88c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:29:00.867713 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f35004f-6a83-470e-936e-1a919135b88c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:29:00.868003 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f35004f-6a83-470e-936e-1a919135b88c admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:29:00.868369 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f35004f-6a83-470e-936e-1a919135b88c admin admin] PATH_INFO: `/v3/projects/79a439936abc4ddea562e0faea17717a` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:29:00.869768 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f35004f-6a83-470e-936e-1a919135b88c admin admin] RBAC: Authorizing `identity:delete_project(project_id=79a439936abc4ddea562e0faea17717a)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:29:00.872024 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f35004f-6a83-470e-936e-1a919135b88c admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:29:00.935019 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-9f35004f-6a83-470e-936e-1a919135b88c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79a439936abc4ddea562e0faea17717a', 'request_id': 'req-9f35004f-6a83-470e-936e-1a919135b88c'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:29:00.943630 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-9f35004f-6a83-470e-936e-1a919135b88c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79a439936abc4ddea562e0faea17717a', 'request_id': 'req-9f35004f-6a83-470e-936e-1a919135b88c'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:29:00.976950 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-9f35004f-6a83-470e-936e-1a919135b88c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79a439936abc4ddea562e0faea17717a', 'request_id': 'req-9f35004f-6a83-470e-936e-1a919135b88c'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:29:00.981015 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:29:01.013541 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-9f35004f-6a83-470e-936e-1a919135b88c admin admin] The token cache is being invalidate because project 79a439936abc4ddea562e0faea17717a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 10:29:01.013834 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-9f35004f-6a83-470e-936e-1a919135b88c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:29:01.016708 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-9f35004f-6a83-470e-936e-1a919135b88c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:29:01.018193 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1163/2288] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 19 10:29:00 2022] DELETE /identity/v3/projects/79a439936abc4ddea562e0faea17717a => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:29:01.025078 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa379939-ad36-4c0e-b164-bc0ea1a62695 service neutron] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:29:01.044056 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa379939-ad36-4c0e-b164-bc0ea1a62695 service neutron] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:29:01.135000 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a38b023-3ddd-4250-ad25-8a12dca43daf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:29:01.136246 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a38b023-3ddd-4250-ad25-8a12dca43daf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:29:01.136591 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a38b023-3ddd-4250-ad25-8a12dca43daf admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:29:01.137709 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a38b023-3ddd-4250-ad25-8a12dca43daf admin admin] PATH_INFO: `/v3/users/aad70710737b4990872c48432f847105` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:29:01.139134 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a38b023-3ddd-4250-ad25-8a12dca43daf admin admin] RBAC: Authorizing `identity:delete_user(user_id=aad70710737b4990872c48432f847105)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:29:01.141328 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a38b023-3ddd-4250-ad25-8a12dca43daf admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:29:01.195791 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-5a38b023-3ddd-4250-ad25-8a12dca43daf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aad70710737b4990872c48432f847105'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:29:01.204618 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-5a38b023-3ddd-4250-ad25-8a12dca43daf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aad70710737b4990872c48432f847105'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:29:01.205337 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-5a38b023-3ddd-4250-ad25-8a12dca43daf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aad70710737b4990872c48432f847105'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:29:01.205971 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-5a38b023-3ddd-4250-ad25-8a12dca43daf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aad70710737b4990872c48432f847105'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:29:01.222231 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-5a38b023-3ddd-4250-ad25-8a12dca43daf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aad70710737b4990872c48432f847105'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:29:01.223931 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:29:01.251292 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1126/2289] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 19 10:29:01 2022] DELETE /identity/v3/users/aad70710737b4990872c48432f847105 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 10:29:01.550077 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f35004f-6a83-470e-936e-1a919135b88c admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:29:01.551811 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-9f35004f-6a83-470e-936e-1a919135b88c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:29:01.567842 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f35004f-6a83-470e-936e-1a919135b88c admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:29:01.627895 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2861cedf-8bb3-47bb-9179-fe8b7eb28ab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:29:01.628554 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2861cedf-8bb3-47bb-9179-fe8b7eb28ab8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:29:01.628833 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2861cedf-8bb3-47bb-9179-fe8b7eb28ab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:29:01.629105 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2861cedf-8bb3-47bb-9179-fe8b7eb28ab8 admin admin] PATH_INFO: `/v3/projects/2cc273c49bce4fbf80ad7c98d1951d4c` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:29:01.630219 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2861cedf-8bb3-47bb-9179-fe8b7eb28ab8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2cc273c49bce4fbf80ad7c98d1951d4c)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:29:01.632117 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2861cedf-8bb3-47bb-9179-fe8b7eb28ab8 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:29:01.684773 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-2861cedf-8bb3-47bb-9179-fe8b7eb28ab8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2cc273c49bce4fbf80ad7c98d1951d4c', 'request_id': 'req-2861cedf-8bb3-47bb-9179-fe8b7eb28ab8'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:29:01.691215 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-2861cedf-8bb3-47bb-9179-fe8b7eb28ab8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2cc273c49bce4fbf80ad7c98d1951d4c', 'request_id': 'req-2861cedf-8bb3-47bb-9179-fe8b7eb28ab8'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:29:01.699276 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-2861cedf-8bb3-47bb-9179-fe8b7eb28ab8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2cc273c49bce4fbf80ad7c98d1951d4c', 'request_id': 'req-2861cedf-8bb3-47bb-9179-fe8b7eb28ab8'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:29:01.710832 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-2861cedf-8bb3-47bb-9179-fe8b7eb28ab8 admin admin] The token cache is being invalidate because project 2cc273c49bce4fbf80ad7c98d1951d4c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 10:29:01.711120 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-2861cedf-8bb3-47bb-9179-fe8b7eb28ab8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:29:01.711739 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-2861cedf-8bb3-47bb-9179-fe8b7eb28ab8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:29:01.713295 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1164/2290] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 19 10:29:01 2022] DELETE /identity/v3/projects/2cc273c49bce4fbf80ad7c98d1951d4c => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:29:01.719021 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e23d144-d14e-4166-ab5c-3706fa2fda73 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:29:01.719481 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e23d144-d14e-4166-ab5c-3706fa2fda73 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:29:01.719571 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e23d144-d14e-4166-ab5c-3706fa2fda73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:29:01.739539 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-9e23d144-d14e-4166-ab5c-3706fa2fda73 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:29:01.740778 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-9e23d144-d14e-4166-ab5c-3706fa2fda73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:29:01.807906 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1127/2291] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:29:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:29:01.816943 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ae8b64-b1c9-45b7-a9b7-2c1a815e14be None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:29:01.817232 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ae8b64-b1c9-45b7-a9b7-2c1a815e14be None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:29:01.817507 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ae8b64-b1c9-45b7-a9b7-2c1a815e14be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:29:01.837195 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-35ae8b64-b1c9-45b7-a9b7-2c1a815e14be None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:29:01.838308 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-35ae8b64-b1c9-45b7-a9b7-2c1a815e14be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:29:01.846164 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1165/2292] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:29:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:29:01.850497 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e23d144-d14e-4166-ab5c-3706fa2fda73 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:29:01.860876 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e23d144-d14e-4166-ab5c-3706fa2fda73 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:29:01.865803 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6f7456-bcf2-4acc-89e8-ac7f19a180f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:29:01.866397 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6f7456-bcf2-4acc-89e8-ac7f19a180f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:29:01.866675 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6f7456-bcf2-4acc-89e8-ac7f19a180f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:29:01.866944 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6f7456-bcf2-4acc-89e8-ac7f19a180f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:29:01.867605 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6f7456-bcf2-4acc-89e8-ac7f19a180f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:29:01.867906 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6f7456-bcf2-4acc-89e8-ac7f19a180f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:29:01.870121 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6f7456-bcf2-4acc-89e8-ac7f19a180f9 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:29:01.882442 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1128/2293] 10.222.0.66 () {58 vars in 1153 bytes} [Mon Sep 19 10:29:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:29:01.886778 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ae8b64-b1c9-45b7-a9b7-2c1a815e14be None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:29:01.897950 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ae8b64-b1c9-45b7-a9b7-2c1a815e14be None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:29:01.902701 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d39eb3-1e13-44de-b763-2aabfe47d3bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:29:01.903303 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d39eb3-1e13-44de-b763-2aabfe47d3bc admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:29:01.903620 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d39eb3-1e13-44de-b763-2aabfe47d3bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:29:01.903891 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d39eb3-1e13-44de-b763-2aabfe47d3bc admin admin] PATH_INFO: `/v3/projects` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:29:01.904561 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d39eb3-1e13-44de-b763-2aabfe47d3bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:29:01.906464 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d39eb3-1e13-44de-b763-2aabfe47d3bc admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:29:01.935627 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1166/2294] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 19 10:29:01 2022] POST /identity/v3/projects => generated 371 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:29:01.939854 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6f7456-bcf2-4acc-89e8-ac7f19a180f9 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:29:01.949831 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6f7456-bcf2-4acc-89e8-ac7f19a180f9 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:29:02.006119 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d567fc11-465a-43f5-8ef3-1e59058e9466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:29:02.006734 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d567fc11-465a-43f5-8ef3-1e59058e9466 admin admin] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:29:02.007016 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d567fc11-465a-43f5-8ef3-1e59058e9466 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:29:02.007294 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d567fc11-465a-43f5-8ef3-1e59058e9466 admin admin] PATH_INFO: `/v3/users` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:29:02.007936 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d567fc11-465a-43f5-8ef3-1e59058e9466 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:29:02.009951 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d567fc11-465a-43f5-8ef3-1e59058e9466 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:29:02.033243 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1129/2295] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 19 10:29:01 2022] POST /identity/v3/users => generated 286 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:29:02.037416 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d39eb3-1e13-44de-b763-2aabfe47d3bc admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:29:02.049612 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d39eb3-1e13-44de-b763-2aabfe47d3bc admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:29:02.057672 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6051e9ce-69dc-4094-ae12-106fa18d953a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:29:02.058604 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6051e9ce-69dc-4094-ae12-106fa18d953a admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:29:02.058953 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6051e9ce-69dc-4094-ae12-106fa18d953a admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:29:02.059291 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6051e9ce-69dc-4094-ae12-106fa18d953a admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:29:02.060803 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6051e9ce-69dc-4094-ae12-106fa18d953a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:29:02.061794 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6051e9ce-69dc-4094-ae12-106fa18d953a admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:29:02.075938 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1167/2296] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:29:02 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 10:29:02.077277 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d567fc11-465a-43f5-8ef3-1e59058e9466 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:29:02.088466 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d567fc11-465a-43f5-8ef3-1e59058e9466 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:29:02.093783 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd3090f-cc23-49aa-a671-b55229fb5c5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:29:02.094421 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd3090f-cc23-49aa-a671-b55229fb5c5a admin admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:29:02.094702 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd3090f-cc23-49aa-a671-b55229fb5c5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:29:02.094974 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd3090f-cc23-49aa-a671-b55229fb5c5a admin admin] PATH_INFO: `/v3/roles` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:29:02.095617 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd3090f-cc23-49aa-a671-b55229fb5c5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:29:02.097270 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd3090f-cc23-49aa-a671-b55229fb5c5a admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:29:02.113080 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1130/2297] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:29:02 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 10:29:02.114599 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6051e9ce-69dc-4094-ae12-106fa18d953a admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:29:02.125410 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6051e9ce-69dc-4094-ae12-106fa18d953a admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:29:02.130272 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43743ec0-34a4-4b3f-8527-1baf1a7ee687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:29:02.130946 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43743ec0-34a4-4b3f-8527-1baf1a7ee687 admin admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:29:02.131229 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43743ec0-34a4-4b3f-8527-1baf1a7ee687 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:29:02.131507 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43743ec0-34a4-4b3f-8527-1baf1a7ee687 admin admin] PATH_INFO: `/v3/projects/0de551dd847b41b78c25932995311d82/users/12db3e996ca24a4e80138541d32031b6/roles/cd5b42ed3b754b58817a62bbe74651b4` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:29:02.156202 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43743ec0-34a4-4b3f-8527-1baf1a7ee687 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0de551dd847b41b78c25932995311d82, user_id=12db3e996ca24a4e80138541d32031b6, role_id=cd5b42ed3b754b58817a62bbe74651b4)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:29:02.159299 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43743ec0-34a4-4b3f-8527-1baf1a7ee687 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:29:02.177055 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1168/2298] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 19 10:29:02 2022] PUT /identity/v3/projects/0de551dd847b41b78c25932995311d82/users/12db3e996ca24a4e80138541d32031b6/roles/cd5b42ed3b754b58817a62bbe74651b4 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:29:02.187968 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2198a78b-6669-4346-bde5-f2857a0c5db3 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:29:02.188285 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2198a78b-6669-4346-bde5-f2857a0c5db3 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:29:02.188569 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2198a78b-6669-4346-bde5-f2857a0c5db3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:29:02.220329 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-2198a78b-6669-4346-bde5-f2857a0c5db3 None None] MFA Rules not processed for user `12db3e996ca24a4e80138541d32031b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:29:02.221690 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-2198a78b-6669-4346-bde5-f2857a0c5db3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:29:02.263180 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:29:02.303927 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1131/2299] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:29:02 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:29:02.318989 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43743ec0-34a4-4b3f-8527-1baf1a7ee687 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:29:02.318989 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-43743ec0-34a4-4b3f-8527-1baf1a7ee687 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:29:02.346043 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:DELETE=9,keystone:SELECT=88,keystone:INSERT=3 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:29:02.394063 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43743ec0-34a4-4b3f-8527-1baf1a7ee687 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:29:02.397827 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f035553-cabd-4780-b3a2-fb2d85b2ac49 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa4d004fd44482cae761c4b3bdfab31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:29:02.398462 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f035553-cabd-4780-b3a2-fb2d85b2ac49 service cinder] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:29:02.398747 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f035553-cabd-4780-b3a2-fb2d85b2ac49 service cinder] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:29:02.399022 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f035553-cabd-4780-b3a2-fb2d85b2ac49 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:29:02.408553 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f035553-cabd-4780-b3a2-fb2d85b2ac49 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:29:02.409984 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f035553-cabd-4780-b3a2-fb2d85b2ac49 service cinder] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:29:02.419475 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1169/2300] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:29:02 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:29:02.445351 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2198a78b-6669-4346-bde5-f2857a0c5db3 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:29:02.508591 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2198a78b-6669-4346-bde5-f2857a0c5db3 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:29:02.513881 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dde893a-e523-4ff5-a167-21394d98c0f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:29:02.515312 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dde893a-e523-4ff5-a167-21394d98c0f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:29:02.515312 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dde893a-e523-4ff5-a167-21394d98c0f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:29:02.515312 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dde893a-e523-4ff5-a167-21394d98c0f7 admin admin] PATH_INFO: `/v3/users/12db3e996ca24a4e80138541d32031b6` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:29:02.516356 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dde893a-e523-4ff5-a167-21394d98c0f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=12db3e996ca24a4e80138541d32031b6)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:29:02.518708 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dde893a-e523-4ff5-a167-21394d98c0f7 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:29:02.565867 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-2dde893a-e523-4ff5-a167-21394d98c0f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12db3e996ca24a4e80138541d32031b6'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:29:02.575161 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-2dde893a-e523-4ff5-a167-21394d98c0f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12db3e996ca24a4e80138541d32031b6'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:29:02.575750 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-2dde893a-e523-4ff5-a167-21394d98c0f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12db3e996ca24a4e80138541d32031b6'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:29:02.576543 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-2dde893a-e523-4ff5-a167-21394d98c0f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12db3e996ca24a4e80138541d32031b6'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:29:02.584060 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-2dde893a-e523-4ff5-a167-21394d98c0f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12db3e996ca24a4e80138541d32031b6'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:29:02.606172 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1132/2301] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 19 10:29:02 2022] DELETE /identity/v3/users/12db3e996ca24a4e80138541d32031b6 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:29:02.610571 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3e5dcd-5f54-41ee-aa48-63c9846c5fdc None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:29:02.610862 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3e5dcd-5f54-41ee-aa48-63c9846c5fdc None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:29:02.611140 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3e5dcd-5f54-41ee-aa48-63c9846c5fdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:29:02.629750 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-cf3e5dcd-5f54-41ee-aa48-63c9846c5fdc None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:29:02.630977 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-cf3e5dcd-5f54-41ee-aa48-63c9846c5fdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:29:02.691561 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1170/2302] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:29:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:29:02.701717 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dde893a-e523-4ff5-a167-21394d98c0f7 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:29:02.703131 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-2dde893a-e523-4ff5-a167-21394d98c0f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:29:02.762619 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dde893a-e523-4ff5-a167-21394d98c0f7 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:29:02.766526 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df444049-6ac2-49ce-8655-a5527657e307 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c1289b015854c6bb6aee8fed6b807db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:29:02.767134 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df444049-6ac2-49ce-8655-a5527657e307 service neutron] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:29:02.767415 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df444049-6ac2-49ce-8655-a5527657e307 service neutron] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:29:02.767690 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df444049-6ac2-49ce-8655-a5527657e307 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:29:02.777623 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df444049-6ac2-49ce-8655-a5527657e307 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:29:02.779059 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df444049-6ac2-49ce-8655-a5527657e307 service neutron] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:29:02.783606 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:29:02.790916 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1133/2303] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:29:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:29:03.068454 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3e5dcd-5f54-41ee-aa48-63c9846c5fdc None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:29:03.069949 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-cf3e5dcd-5f54-41ee-aa48-63c9846c5fdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:29:03.084201 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3e5dcd-5f54-41ee-aa48-63c9846c5fdc None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:29:03.089788 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8149118c-568b-4937-bcf9-132111b8b698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:29:03.090443 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8149118c-568b-4937-bcf9-132111b8b698 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:29:03.090721 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8149118c-568b-4937-bcf9-132111b8b698 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:29:03.090995 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8149118c-568b-4937-bcf9-132111b8b698 admin admin] PATH_INFO: `/v3/projects/0de551dd847b41b78c25932995311d82` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:29:03.092125 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8149118c-568b-4937-bcf9-132111b8b698 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0de551dd847b41b78c25932995311d82)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:29:03.094113 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8149118c-568b-4937-bcf9-132111b8b698 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:29:03.142258 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-8149118c-568b-4937-bcf9-132111b8b698 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0de551dd847b41b78c25932995311d82', 'request_id': 'req-8149118c-568b-4937-bcf9-132111b8b698'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:29:03.148471 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-8149118c-568b-4937-bcf9-132111b8b698 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0de551dd847b41b78c25932995311d82', 'request_id': 'req-8149118c-568b-4937-bcf9-132111b8b698'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:29:03.156202 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-8149118c-568b-4937-bcf9-132111b8b698 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0de551dd847b41b78c25932995311d82', 'request_id': 'req-8149118c-568b-4937-bcf9-132111b8b698'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:29:03.171333 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-8149118c-568b-4937-bcf9-132111b8b698 admin admin] The token cache is being invalidate because project 0de551dd847b41b78c25932995311d82 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 10:29:03.171618 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-8149118c-568b-4937-bcf9-132111b8b698 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:29:03.172333 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-8149118c-568b-4937-bcf9-132111b8b698 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:29:03.174232 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1171/2304] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 19 10:29:03 2022] DELETE /identity/v3/projects/0de551dd847b41b78c25932995311d82 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:29:07.200643 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df444049-6ac2-49ce-8655-a5527657e307 service neutron] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:29:07.202088 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-df444049-6ac2-49ce-8655-a5527657e307 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:29:07.215268 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df444049-6ac2-49ce-8655-a5527657e307 service neutron] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:29:07.271628 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e477d1-4686-4302-974c-1d583f36d660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:29:07.272055 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e477d1-4686-4302-974c-1d583f36d660 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:29:07.272368 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e477d1-4686-4302-974c-1d583f36d660 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:29:07.272644 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e477d1-4686-4302-974c-1d583f36d660 admin admin] PATH_INFO: `/v3/users/848901d5ce034dbf842894c0e7e9a593` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:29:07.273762 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e477d1-4686-4302-974c-1d583f36d660 admin admin] RBAC: Authorizing `identity:delete_user(user_id=848901d5ce034dbf842894c0e7e9a593)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:29:07.275713 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e477d1-4686-4302-974c-1d583f36d660 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:29:07.322199 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-f9e477d1-4686-4302-974c-1d583f36d660 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '848901d5ce034dbf842894c0e7e9a593'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:29:07.331031 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-f9e477d1-4686-4302-974c-1d583f36d660 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '848901d5ce034dbf842894c0e7e9a593'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:29:07.331819 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-f9e477d1-4686-4302-974c-1d583f36d660 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '848901d5ce034dbf842894c0e7e9a593'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:29:07.332479 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-f9e477d1-4686-4302-974c-1d583f36d660 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '848901d5ce034dbf842894c0e7e9a593'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:29:07.340443 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-f9e477d1-4686-4302-974c-1d583f36d660 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '848901d5ce034dbf842894c0e7e9a593'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:29:07.357632 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1134/2305] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 19 10:29:07 2022] DELETE /identity/v3/users/848901d5ce034dbf842894c0e7e9a593 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:29:07.362086 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48abf2f9-eba4-45ce-ba44-d3a1cfc5ba03 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:29:07.362560 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48abf2f9-eba4-45ce-ba44-d3a1cfc5ba03 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:29:07.362652 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48abf2f9-eba4-45ce-ba44-d3a1cfc5ba03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:29:07.382727 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-48abf2f9-eba4-45ce-ba44-d3a1cfc5ba03 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:29:07.383948 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-48abf2f9-eba4-45ce-ba44-d3a1cfc5ba03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:29:07.424310 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:29:07.454346 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1172/2306] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:29:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 10:29:07.468815 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e477d1-4686-4302-974c-1d583f36d660 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:29:07.468815 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-f9e477d1-4686-4302-974c-1d583f36d660 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:29:07.528359 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e477d1-4686-4302-974c-1d583f36d660 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:29:07.532011 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f279fa2-72fb-4809-88d7-5e74a4c846d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c1289b015854c6bb6aee8fed6b807db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:29:07.532651 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f279fa2-72fb-4809-88d7-5e74a4c846d5 service neutron] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:29:07.532934 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f279fa2-72fb-4809-88d7-5e74a4c846d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:29:07.533230 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f279fa2-72fb-4809-88d7-5e74a4c846d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:29:07.542380 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f279fa2-72fb-4809-88d7-5e74a4c846d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:29:07.543830 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f279fa2-72fb-4809-88d7-5e74a4c846d5 service neutron] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:29:07.553589 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1135/2307] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:29:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:29:07.926811 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48abf2f9-eba4-45ce-ba44-d3a1cfc5ba03 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:29:07.928319 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-48abf2f9-eba4-45ce-ba44-d3a1cfc5ba03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:29:07.947466 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48abf2f9-eba4-45ce-ba44-d3a1cfc5ba03 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:29:07.960861 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d85a647-d7bb-48c5-a3f4-5bdb1d382aba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:29:07.960861 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d85a647-d7bb-48c5-a3f4-5bdb1d382aba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:29:07.960861 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d85a647-d7bb-48c5-a3f4-5bdb1d382aba admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:29:07.960861 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d85a647-d7bb-48c5-a3f4-5bdb1d382aba admin admin] PATH_INFO: `/v3/projects/deea41c4dc2840038bcc07817baa8ad6` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:29:07.963137 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d85a647-d7bb-48c5-a3f4-5bdb1d382aba admin admin] RBAC: Authorizing `identity:delete_project(project_id=deea41c4dc2840038bcc07817baa8ad6)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:29:07.965387 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d85a647-d7bb-48c5-a3f4-5bdb1d382aba admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:29:08.019991 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-7d85a647-d7bb-48c5-a3f4-5bdb1d382aba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'deea41c4dc2840038bcc07817baa8ad6', 'request_id': 'req-7d85a647-d7bb-48c5-a3f4-5bdb1d382aba'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:29:08.027180 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-7d85a647-d7bb-48c5-a3f4-5bdb1d382aba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'deea41c4dc2840038bcc07817baa8ad6', 'request_id': 'req-7d85a647-d7bb-48c5-a3f4-5bdb1d382aba'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:29:08.035526 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-7d85a647-d7bb-48c5-a3f4-5bdb1d382aba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'deea41c4dc2840038bcc07817baa8ad6', 'request_id': 'req-7d85a647-d7bb-48c5-a3f4-5bdb1d382aba'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:29:08.056341 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-7d85a647-d7bb-48c5-a3f4-5bdb1d382aba admin admin] The token cache is being invalidate because project deea41c4dc2840038bcc07817baa8ad6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 10:29:08.056670 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-7d85a647-d7bb-48c5-a3f4-5bdb1d382aba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:29:08.057555 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-7d85a647-d7bb-48c5-a3f4-5bdb1d382aba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:29:08.059125 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1173/2308] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 19 10:29:07 2022] DELETE /identity/v3/projects/deea41c4dc2840038bcc07817baa8ad6 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:29:08.064829 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530d651f-2ffb-4b68-ad75-1162cfd22164 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:29:08.065247 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530d651f-2ffb-4b68-ad75-1162cfd22164 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:29:08.065600 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530d651f-2ffb-4b68-ad75-1162cfd22164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:29:08.086653 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-530d651f-2ffb-4b68-ad75-1162cfd22164 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:29:08.088494 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-530d651f-2ffb-4b68-ad75-1162cfd22164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:29:08.101620 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:29:08.157597 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1136/2309] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:29:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:29:08.165345 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e812e2-551a-4cee-9a9f-bc946ed4519e None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:29:08.165753 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e812e2-551a-4cee-9a9f-bc946ed4519e None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:29:08.166652 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e812e2-551a-4cee-9a9f-bc946ed4519e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:29:08.189350 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-e3e812e2-551a-4cee-9a9f-bc946ed4519e None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:29:08.190964 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-e3e812e2-551a-4cee-9a9f-bc946ed4519e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:29:08.201621 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1174/2310] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:29:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:29:08.206040 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530d651f-2ffb-4b68-ad75-1162cfd22164 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:29:08.219768 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530d651f-2ffb-4b68-ad75-1162cfd22164 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:29:08.224907 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e429f329-4b2c-4598-a70d-713a0ce78705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:29:08.225999 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e429f329-4b2c-4598-a70d-713a0ce78705 admin admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:29:08.226472 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e429f329-4b2c-4598-a70d-713a0ce78705 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:29:08.227424 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e429f329-4b2c-4598-a70d-713a0ce78705 admin admin] PATH_INFO: `/v3/domains` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:29:08.228090 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e429f329-4b2c-4598-a70d-713a0ce78705 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:29:08.228420 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e429f329-4b2c-4598-a70d-713a0ce78705 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:29:08.230673 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e429f329-4b2c-4598-a70d-713a0ce78705 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:29:08.246211 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1137/2311] 10.222.0.66 () {58 vars in 1153 bytes} [Mon Sep 19 10:29:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:29:08.250453 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e812e2-551a-4cee-9a9f-bc946ed4519e None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:29:08.260322 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e812e2-551a-4cee-9a9f-bc946ed4519e None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:29:08.265993 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e23bcf6-d4bc-4c68-aa89-0649ecf620cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:29:08.266781 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e23bcf6-d4bc-4c68-aa89-0649ecf620cc admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:29:08.267173 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e23bcf6-d4bc-4c68-aa89-0649ecf620cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:29:08.267553 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e23bcf6-d4bc-4c68-aa89-0649ecf620cc admin admin] PATH_INFO: `/v3/projects` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:29:08.268394 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e23bcf6-d4bc-4c68-aa89-0649ecf620cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:29:08.270509 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e23bcf6-d4bc-4c68-aa89-0649ecf620cc admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:29:08.304610 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1175/2312] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 19 10:29:08 2022] POST /identity/v3/projects => generated 385 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:29:08.308891 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e429f329-4b2c-4598-a70d-713a0ce78705 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:29:08.321453 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e429f329-4b2c-4598-a70d-713a0ce78705 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:29:08.394967 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013f8094-caff-4296-bf7b-beceb2c1713c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:29:08.395670 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013f8094-caff-4296-bf7b-beceb2c1713c admin admin] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:29:08.395982 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013f8094-caff-4296-bf7b-beceb2c1713c admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:29:08.396300 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013f8094-caff-4296-bf7b-beceb2c1713c admin admin] PATH_INFO: `/v3/users` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:29:08.396964 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013f8094-caff-4296-bf7b-beceb2c1713c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:29:08.399002 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013f8094-caff-4296-bf7b-beceb2c1713c admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:29:08.421548 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1138/2313] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 19 10:29:08 2022] POST /identity/v3/users => generated 293 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:29:08.425692 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e23bcf6-d4bc-4c68-aa89-0649ecf620cc admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:29:08.436795 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e23bcf6-d4bc-4c68-aa89-0649ecf620cc admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:29:08.441937 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd32979-bcdf-4400-846a-8dafe5c634bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:29:08.442663 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd32979-bcdf-4400-846a-8dafe5c634bb admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:29:08.443076 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd32979-bcdf-4400-846a-8dafe5c634bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:29:08.443386 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd32979-bcdf-4400-846a-8dafe5c634bb admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:29:08.444099 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd32979-bcdf-4400-846a-8dafe5c634bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:29:08.445771 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd32979-bcdf-4400-846a-8dafe5c634bb admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:29:08.466544 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1176/2314] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:29:08 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 10:29:08.467911 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013f8094-caff-4296-bf7b-beceb2c1713c admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:29:08.485227 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013f8094-caff-4296-bf7b-beceb2c1713c admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:29:08.491144 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b26b887-aabf-49c4-a381-1d6bb7ae3a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:29:08.491854 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b26b887-aabf-49c4-a381-1d6bb7ae3a1c admin admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:29:08.492139 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b26b887-aabf-49c4-a381-1d6bb7ae3a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:29:08.492455 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b26b887-aabf-49c4-a381-1d6bb7ae3a1c admin admin] PATH_INFO: `/v3/roles` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:29:08.493113 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b26b887-aabf-49c4-a381-1d6bb7ae3a1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:29:08.494877 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b26b887-aabf-49c4-a381-1d6bb7ae3a1c admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:29:08.508256 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1139/2315] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:29:08 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 10:29:08.511157 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd32979-bcdf-4400-846a-8dafe5c634bb admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:29:08.522775 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd32979-bcdf-4400-846a-8dafe5c634bb admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:29:08.528878 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8747fcab-3d75-42d2-8375-4dd9362fd736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:29:08.529274 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8747fcab-3d75-42d2-8375-4dd9362fd736 admin admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:29:08.529563 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8747fcab-3d75-42d2-8375-4dd9362fd736 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:29:08.529838 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8747fcab-3d75-42d2-8375-4dd9362fd736 admin admin] PATH_INFO: `/v3/projects/6e5e0fd0f63a42528df3cd11a255d682/users/3604da37946c48ea81e1cf567ee50b5c/roles/cd5b42ed3b754b58817a62bbe74651b4` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:29:08.546261 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8747fcab-3d75-42d2-8375-4dd9362fd736 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e5e0fd0f63a42528df3cd11a255d682, user_id=3604da37946c48ea81e1cf567ee50b5c, role_id=cd5b42ed3b754b58817a62bbe74651b4)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:29:08.549637 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8747fcab-3d75-42d2-8375-4dd9362fd736 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:29:08.568869 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1177/2316] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 19 10:29:08 2022] PUT /identity/v3/projects/6e5e0fd0f63a42528df3cd11a255d682/users/3604da37946c48ea81e1cf567ee50b5c/roles/cd5b42ed3b754b58817a62bbe74651b4 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:29:08.581440 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd975b0-22e1-4d7a-939b-7bd568fdaf81 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:29:08.581791 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd975b0-22e1-4d7a-939b-7bd568fdaf81 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:29:08.582007 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd975b0-22e1-4d7a-939b-7bd568fdaf81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:29:08.615843 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-5cd975b0-22e1-4d7a-939b-7bd568fdaf81 None None] MFA Rules not processed for user `3604da37946c48ea81e1cf567ee50b5c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:29:08.617090 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-5cd975b0-22e1-4d7a-939b-7bd568fdaf81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:29:08.693773 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1140/2317] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:29:08 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:29:08.704036 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8747fcab-3d75-42d2-8375-4dd9362fd736 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:29:08.706275 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-8747fcab-3d75-42d2-8375-4dd9362fd736 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:29:08.769210 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8747fcab-3d75-42d2-8375-4dd9362fd736 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:29:08.773633 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd975b0-22e1-4d7a-939b-7bd568fdaf81 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:29:08.774030 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75908768-b966-4385-b6bd-fb0fcca364a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa4d004fd44482cae761c4b3bdfab31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:29:08.774785 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75908768-b966-4385-b6bd-fb0fcca364a3 service cinder] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:29:08.775137 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75908768-b966-4385-b6bd-fb0fcca364a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:29:08.775299 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-5cd975b0-22e1-4d7a-939b-7bd568fdaf81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:29:08.775731 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75908768-b966-4385-b6bd-fb0fcca364a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:29:08.785073 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75908768-b966-4385-b6bd-fb0fcca364a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:29:08.786827 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75908768-b966-4385-b6bd-fb0fcca364a3 service cinder] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:29:08.795365 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:29:08.796692 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1178/2318] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:29:08 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:29:08.848956 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd975b0-22e1-4d7a-939b-7bd568fdaf81 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:29:08.854392 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872534e0-8ae4-4d18-9f19-dc3e9e3d2080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:29:08.855025 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872534e0-8ae4-4d18-9f19-dc3e9e3d2080 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:29:08.855299 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872534e0-8ae4-4d18-9f19-dc3e9e3d2080 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:29:08.855569 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872534e0-8ae4-4d18-9f19-dc3e9e3d2080 admin admin] PATH_INFO: `/v3/users/7b625fd0d9ec45898a962947bf4acb4b` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:29:08.856784 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872534e0-8ae4-4d18-9f19-dc3e9e3d2080 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b625fd0d9ec45898a962947bf4acb4b)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:29:08.858715 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872534e0-8ae4-4d18-9f19-dc3e9e3d2080 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:29:08.908816 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-872534e0-8ae4-4d18-9f19-dc3e9e3d2080 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b625fd0d9ec45898a962947bf4acb4b'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:29:08.916626 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-872534e0-8ae4-4d18-9f19-dc3e9e3d2080 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b625fd0d9ec45898a962947bf4acb4b'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:29:08.917240 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-872534e0-8ae4-4d18-9f19-dc3e9e3d2080 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b625fd0d9ec45898a962947bf4acb4b'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:29:08.917849 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-872534e0-8ae4-4d18-9f19-dc3e9e3d2080 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b625fd0d9ec45898a962947bf4acb4b'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:29:08.925918 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-872534e0-8ae4-4d18-9f19-dc3e9e3d2080 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b625fd0d9ec45898a962947bf4acb4b'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:29:08.946116 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1141/2319] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 19 10:29:08 2022] DELETE /identity/v3/users/7b625fd0d9ec45898a962947bf4acb4b => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 10:29:09.142636 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75908768-b966-4385-b6bd-fb0fcca364a3 service cinder] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:29:09.150148 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:29:09.154827 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75908768-b966-4385-b6bd-fb0fcca364a3 service cinder] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:29:09.218584 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb53723-b1fd-42b5-baee-155ac2c9b5aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:29:09.219217 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb53723-b1fd-42b5-baee-155ac2c9b5aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:29:09.219499 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb53723-b1fd-42b5-baee-155ac2c9b5aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:29:09.219777 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb53723-b1fd-42b5-baee-155ac2c9b5aa admin admin] PATH_INFO: `/v3/projects/051dda581f074f8598ca847a341827c2` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:29:09.220929 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb53723-b1fd-42b5-baee-155ac2c9b5aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=051dda581f074f8598ca847a341827c2)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:29:09.222864 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb53723-b1fd-42b5-baee-155ac2c9b5aa admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:29:09.269215 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-4fb53723-b1fd-42b5-baee-155ac2c9b5aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '051dda581f074f8598ca847a341827c2', 'request_id': 'req-4fb53723-b1fd-42b5-baee-155ac2c9b5aa'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:29:09.275536 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-4fb53723-b1fd-42b5-baee-155ac2c9b5aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '051dda581f074f8598ca847a341827c2', 'request_id': 'req-4fb53723-b1fd-42b5-baee-155ac2c9b5aa'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:29:09.283078 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-4fb53723-b1fd-42b5-baee-155ac2c9b5aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '051dda581f074f8598ca847a341827c2', 'request_id': 'req-4fb53723-b1fd-42b5-baee-155ac2c9b5aa'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:29:09.294157 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-4fb53723-b1fd-42b5-baee-155ac2c9b5aa admin admin] The token cache is being invalidate because project 051dda581f074f8598ca847a341827c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 10:29:09.294445 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-4fb53723-b1fd-42b5-baee-155ac2c9b5aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:29:09.295344 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-4fb53723-b1fd-42b5-baee-155ac2c9b5aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:29:09.296869 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1179/2320] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 19 10:29:09 2022] DELETE /identity/v3/projects/051dda581f074f8598ca847a341827c2 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:29:09.300946 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872534e0-8ae4-4d18-9f19-dc3e9e3d2080 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:29:09.302374 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-872534e0-8ae4-4d18-9f19-dc3e9e3d2080 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:29:09.317941 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872534e0-8ae4-4d18-9f19-dc3e9e3d2080 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:29:09.373816 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b266fb6-8782-4b8a-87a8-0a9affaa965b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:29:09.374359 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b266fb6-8782-4b8a-87a8-0a9affaa965b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:29:09.374788 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b266fb6-8782-4b8a-87a8-0a9affaa965b admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:29:09.374906 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b266fb6-8782-4b8a-87a8-0a9affaa965b admin admin] PATH_INFO: `/v3/users/88be76395a9d45e4ad7e926c4c28e592` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:29:09.376105 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b266fb6-8782-4b8a-87a8-0a9affaa965b admin admin] RBAC: Authorizing `identity:delete_user(user_id=88be76395a9d45e4ad7e926c4c28e592)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:29:09.378215 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b266fb6-8782-4b8a-87a8-0a9affaa965b admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:29:09.418660 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:29:09.428944 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-5b266fb6-8782-4b8a-87a8-0a9affaa965b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88be76395a9d45e4ad7e926c4c28e592'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:29:09.438209 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-5b266fb6-8782-4b8a-87a8-0a9affaa965b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88be76395a9d45e4ad7e926c4c28e592'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:29:09.438944 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-5b266fb6-8782-4b8a-87a8-0a9affaa965b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88be76395a9d45e4ad7e926c4c28e592'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:29:09.439600 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-5b266fb6-8782-4b8a-87a8-0a9affaa965b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88be76395a9d45e4ad7e926c4c28e592'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:29:09.446948 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-5b266fb6-8782-4b8a-87a8-0a9affaa965b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88be76395a9d45e4ad7e926c4c28e592'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:29:09.464841 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1142/2321] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 19 10:29:09 2022] DELETE /identity/v3/users/88be76395a9d45e4ad7e926c4c28e592 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:29:09.648813 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb53723-b1fd-42b5-baee-155ac2c9b5aa admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:29:09.650810 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-4fb53723-b1fd-42b5-baee-155ac2c9b5aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:29:09.665820 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb53723-b1fd-42b5-baee-155ac2c9b5aa admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:29:09.725879 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acde71da-eeda-4614-b252-68c8554e948e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:29:09.726575 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acde71da-eeda-4614-b252-68c8554e948e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:29:09.726872 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acde71da-eeda-4614-b252-68c8554e948e admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:29:09.727176 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acde71da-eeda-4614-b252-68c8554e948e admin admin] PATH_INFO: `/v3/projects/45584272919f451881cc199fdddc0f99` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:29:09.729093 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acde71da-eeda-4614-b252-68c8554e948e admin admin] RBAC: Authorizing `identity:delete_project(project_id=45584272919f451881cc199fdddc0f99)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:29:09.731156 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acde71da-eeda-4614-b252-68c8554e948e admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:29:09.768812 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:29:09.780283 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-acde71da-eeda-4614-b252-68c8554e948e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45584272919f451881cc199fdddc0f99', 'request_id': 'req-acde71da-eeda-4614-b252-68c8554e948e'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:29:09.786440 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-acde71da-eeda-4614-b252-68c8554e948e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45584272919f451881cc199fdddc0f99', 'request_id': 'req-acde71da-eeda-4614-b252-68c8554e948e'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:29:09.794327 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-acde71da-eeda-4614-b252-68c8554e948e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45584272919f451881cc199fdddc0f99', 'request_id': 'req-acde71da-eeda-4614-b252-68c8554e948e'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:29:09.805360 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-acde71da-eeda-4614-b252-68c8554e948e admin admin] The token cache is being invalidate because project 45584272919f451881cc199fdddc0f99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 10:29:09.805651 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-acde71da-eeda-4614-b252-68c8554e948e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:29:09.806310 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-acde71da-eeda-4614-b252-68c8554e948e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:29:09.808051 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1180/2322] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 19 10:29:09 2022] DELETE /identity/v3/projects/45584272919f451881cc199fdddc0f99 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:29:09.812927 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e60015-0bfa-43fb-be68-2aed2c0df831 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:29:09.813220 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e60015-0bfa-43fb-be68-2aed2c0df831 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:29:09.813534 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e60015-0bfa-43fb-be68-2aed2c0df831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:29:09.835258 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-c2e60015-0bfa-43fb-be68-2aed2c0df831 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:29:09.836709 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-c2e60015-0bfa-43fb-be68-2aed2c0df831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:29:09.903620 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1143/2323] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:29:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:29:09.911710 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca66f357-83f2-433f-a042-b1e26fbc7424 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:29:09.912091 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca66f357-83f2-433f-a042-b1e26fbc7424 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:29:09.912494 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca66f357-83f2-433f-a042-b1e26fbc7424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:29:09.934372 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-ca66f357-83f2-433f-a042-b1e26fbc7424 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:29:09.935624 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-ca66f357-83f2-433f-a042-b1e26fbc7424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:29:09.943755 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1181/2324] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:29:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 10:29:09.948706 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e60015-0bfa-43fb-be68-2aed2c0df831 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:29:09.958411 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e60015-0bfa-43fb-be68-2aed2c0df831 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:29:09.963678 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e76c33-5130-4c30-86bd-4251231679b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:29:09.964313 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e76c33-5130-4c30-86bd-4251231679b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:29:09.964616 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e76c33-5130-4c30-86bd-4251231679b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:29:09.964875 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e76c33-5130-4c30-86bd-4251231679b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:29:09.965519 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e76c33-5130-4c30-86bd-4251231679b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:29:09.965824 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e76c33-5130-4c30-86bd-4251231679b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:29:09.967451 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e76c33-5130-4c30-86bd-4251231679b7 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:29:09.978887 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1144/2325] 10.222.0.66 () {58 vars in 1153 bytes} [Mon Sep 19 10:29:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:29:09.983726 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca66f357-83f2-433f-a042-b1e26fbc7424 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:29:09.993368 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca66f357-83f2-433f-a042-b1e26fbc7424 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:29:09.998103 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27850f2-b345-44b7-b5c7-ec717d75c241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:29:09.998705 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27850f2-b345-44b7-b5c7-ec717d75c241 admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:29:09.998985 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27850f2-b345-44b7-b5c7-ec717d75c241 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:29:09.999259 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27850f2-b345-44b7-b5c7-ec717d75c241 admin admin] PATH_INFO: `/v3/projects` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:29:09.999880 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27850f2-b345-44b7-b5c7-ec717d75c241 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:29:10.002013 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27850f2-b345-44b7-b5c7-ec717d75c241 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:29:10.031804 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1182/2326] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 19 10:29:09 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:29:10.035993 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e76c33-5130-4c30-86bd-4251231679b7 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:29:10.046339 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e76c33-5130-4c30-86bd-4251231679b7 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:29:10.105143 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de6ee4f-ce2c-47b1-9726-7d354cfe6ebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:29:10.105764 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de6ee4f-ce2c-47b1-9726-7d354cfe6ebc admin admin] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:29:10.106048 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de6ee4f-ce2c-47b1-9726-7d354cfe6ebc admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:29:10.106322 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de6ee4f-ce2c-47b1-9726-7d354cfe6ebc admin admin] PATH_INFO: `/v3/users` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:29:10.106957 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de6ee4f-ce2c-47b1-9726-7d354cfe6ebc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:29:10.108935 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de6ee4f-ce2c-47b1-9726-7d354cfe6ebc admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:29:10.129496 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1145/2327] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 19 10:29:10 2022] POST /identity/v3/users => generated 293 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:29:10.133982 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27850f2-b345-44b7-b5c7-ec717d75c241 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:29:10.145586 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27850f2-b345-44b7-b5c7-ec717d75c241 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:29:10.151510 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c24a48d-42a3-41a6-80e9-a80cf92df40d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:29:10.152123 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c24a48d-42a3-41a6-80e9-a80cf92df40d admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:29:10.152430 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c24a48d-42a3-41a6-80e9-a80cf92df40d admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:29:10.152913 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c24a48d-42a3-41a6-80e9-a80cf92df40d admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:29:10.153333 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c24a48d-42a3-41a6-80e9-a80cf92df40d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:29:10.155392 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c24a48d-42a3-41a6-80e9-a80cf92df40d admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:29:10.171096 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1183/2328] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:29:10 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 10:29:10.177908 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de6ee4f-ce2c-47b1-9726-7d354cfe6ebc admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:29:10.188255 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de6ee4f-ce2c-47b1-9726-7d354cfe6ebc admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:29:10.193043 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba5490e-b8b5-4d1d-9d3e-1f2626f93c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:29:10.193657 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba5490e-b8b5-4d1d-9d3e-1f2626f93c4f admin admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:29:10.193937 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba5490e-b8b5-4d1d-9d3e-1f2626f93c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:29:10.194210 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba5490e-b8b5-4d1d-9d3e-1f2626f93c4f admin admin] PATH_INFO: `/v3/roles` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:29:10.194847 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba5490e-b8b5-4d1d-9d3e-1f2626f93c4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:29:10.196513 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba5490e-b8b5-4d1d-9d3e-1f2626f93c4f admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:29:10.217118 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1146/2329] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:29:10 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 10:29:10.222807 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c24a48d-42a3-41a6-80e9-a80cf92df40d admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:29:10.239855 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c24a48d-42a3-41a6-80e9-a80cf92df40d admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:29:10.246497 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c857aa02-bed1-4509-8fb9-f3de2d05b909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:29:10.247174 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c857aa02-bed1-4509-8fb9-f3de2d05b909 admin admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:29:10.247455 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c857aa02-bed1-4509-8fb9-f3de2d05b909 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:29:10.247731 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c857aa02-bed1-4509-8fb9-f3de2d05b909 admin admin] PATH_INFO: `/v3/projects/839a49f1ddf0406db6bee93fb4849846/users/931feacb79644f8da4161bea382a4b1b/roles/cd5b42ed3b754b58817a62bbe74651b4` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:29:10.266388 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c857aa02-bed1-4509-8fb9-f3de2d05b909 admin admin] RBAC: Authorizing `identity:create_grant(project_id=839a49f1ddf0406db6bee93fb4849846, user_id=931feacb79644f8da4161bea382a4b1b, role_id=cd5b42ed3b754b58817a62bbe74651b4)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:29:10.266388 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c857aa02-bed1-4509-8fb9-f3de2d05b909 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:29:10.279999 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1184/2330] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 19 10:29:10 2022] PUT /identity/v3/projects/839a49f1ddf0406db6bee93fb4849846/users/931feacb79644f8da4161bea382a4b1b/roles/cd5b42ed3b754b58817a62bbe74651b4 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:29:10.290438 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b846e4-7afc-439e-ad95-b8390cb7901d None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:29:10.290869 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b846e4-7afc-439e-ad95-b8390cb7901d None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:29:10.291156 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b846e4-7afc-439e-ad95-b8390cb7901d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:29:10.323669 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-77b846e4-7afc-439e-ad95-b8390cb7901d None None] MFA Rules not processed for user `931feacb79644f8da4161bea382a4b1b`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:29:10.325014 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-77b846e4-7afc-439e-ad95-b8390cb7901d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:29:10.333493 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:29:10.399428 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1147/2331] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:29:10 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:29:10.404100 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c857aa02-bed1-4509-8fb9-f3de2d05b909 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:29:10.467317 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c857aa02-bed1-4509-8fb9-f3de2d05b909 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:29:10.471913 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f7e0e7-8246-403b-92ad-d3d0621e6823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:29:10.472553 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f7e0e7-8246-403b-92ad-d3d0621e6823 admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:29:10.472839 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f7e0e7-8246-403b-92ad-d3d0621e6823 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:29:10.473118 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f7e0e7-8246-403b-92ad-d3d0621e6823 admin admin] PATH_INFO: `/v3/projects` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:29:10.473773 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f7e0e7-8246-403b-92ad-d3d0621e6823 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:29:10.477451 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f7e0e7-8246-403b-92ad-d3d0621e6823 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:29:10.506758 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1185/2332] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 19 10:29:10 2022] POST /identity/v3/projects => generated 385 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:29:10.511597 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b846e4-7afc-439e-ad95-b8390cb7901d None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:29:10.522278 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b846e4-7afc-439e-ad95-b8390cb7901d None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:29:10.578938 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab22fd2-29e7-4c15-b7b7-872310cde900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:29:10.579647 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab22fd2-29e7-4c15-b7b7-872310cde900 admin admin] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:29:10.579996 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab22fd2-29e7-4c15-b7b7-872310cde900 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:29:10.580862 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab22fd2-29e7-4c15-b7b7-872310cde900 admin admin] PATH_INFO: `/v3/users` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:29:10.581168 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab22fd2-29e7-4c15-b7b7-872310cde900 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:29:10.583095 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab22fd2-29e7-4c15-b7b7-872310cde900 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:29:10.608926 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1148/2333] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 19 10:29:10 2022] POST /identity/v3/users => generated 293 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:29:10.613674 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f7e0e7-8246-403b-92ad-d3d0621e6823 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:29:10.627997 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f7e0e7-8246-403b-92ad-d3d0621e6823 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:29:10.634139 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0773010e-97a6-4caa-bb62-2c5c71989281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:29:10.635392 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0773010e-97a6-4caa-bb62-2c5c71989281 admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:29:10.635739 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0773010e-97a6-4caa-bb62-2c5c71989281 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:29:10.636226 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0773010e-97a6-4caa-bb62-2c5c71989281 admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:29:10.637164 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0773010e-97a6-4caa-bb62-2c5c71989281 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:29:10.639064 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0773010e-97a6-4caa-bb62-2c5c71989281 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:29:10.653758 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1186/2334] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:29:10 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 10:29:10.657668 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab22fd2-29e7-4c15-b7b7-872310cde900 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:29:10.679571 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab22fd2-29e7-4c15-b7b7-872310cde900 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:29:10.685129 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2d2353-9b03-400e-af7e-030aa6e9aced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:29:10.685936 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2d2353-9b03-400e-af7e-030aa6e9aced admin admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:29:10.686308 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2d2353-9b03-400e-af7e-030aa6e9aced admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:29:10.687079 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2d2353-9b03-400e-af7e-030aa6e9aced admin admin] PATH_INFO: `/v3/roles` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:29:10.687880 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2d2353-9b03-400e-af7e-030aa6e9aced admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:29:10.689763 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2d2353-9b03-400e-af7e-030aa6e9aced admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:29:10.701677 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1149/2335] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:29:10 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 10:29:10.706093 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0773010e-97a6-4caa-bb62-2c5c71989281 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:29:10.716708 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0773010e-97a6-4caa-bb62-2c5c71989281 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:29:10.721366 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c975812-8f6f-40f6-a499-03efbe411a7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:29:10.721946 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c975812-8f6f-40f6-a499-03efbe411a7d admin admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:29:10.722224 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c975812-8f6f-40f6-a499-03efbe411a7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:29:10.722496 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c975812-8f6f-40f6-a499-03efbe411a7d admin admin] PATH_INFO: `/v3/projects/fd241b3c81b04f61adb9073e5b3d75f2/users/ff7994989cf741828fe737399784c778/roles/cd5b42ed3b754b58817a62bbe74651b4` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:29:10.737702 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c975812-8f6f-40f6-a499-03efbe411a7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd241b3c81b04f61adb9073e5b3d75f2, user_id=ff7994989cf741828fe737399784c778, role_id=cd5b42ed3b754b58817a62bbe74651b4)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:29:10.740475 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c975812-8f6f-40f6-a499-03efbe411a7d admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:29:10.768678 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1187/2336] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 19 10:29:10 2022] PUT /identity/v3/projects/fd241b3c81b04f61adb9073e5b3d75f2/users/ff7994989cf741828fe737399784c778/roles/cd5b42ed3b754b58817a62bbe74651b4 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:29:10.780116 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8336a64e-f391-4b49-8418-8f546a367df8 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:29:10.780440 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8336a64e-f391-4b49-8418-8f546a367df8 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:29:10.780719 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8336a64e-f391-4b49-8418-8f546a367df8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:29:10.811091 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-8336a64e-f391-4b49-8418-8f546a367df8 None None] MFA Rules not processed for user `ff7994989cf741828fe737399784c778`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:29:10.812332 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-8336a64e-f391-4b49-8418-8f546a367df8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:29:10.879220 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1150/2337] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:29:10 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:29:10.883801 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c975812-8f6f-40f6-a499-03efbe411a7d admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:29:10.896711 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:29:10.948502 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c975812-8f6f-40f6-a499-03efbe411a7d admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:29:10.956653 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5af1bb-70d5-486f-a852-59b09d05972d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:29:10.957262 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5af1bb-70d5-486f-a852-59b09d05972d admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:29:10.957538 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5af1bb-70d5-486f-a852-59b09d05972d admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:29:10.957811 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5af1bb-70d5-486f-a852-59b09d05972d admin admin] PATH_INFO: `/v3/projects` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:29:10.958432 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5af1bb-70d5-486f-a852-59b09d05972d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:29:10.960356 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5af1bb-70d5-486f-a852-59b09d05972d admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:29:10.986571 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1188/2338] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 19 10:29:10 2022] POST /identity/v3/projects => generated 385 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:29:10.990668 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8336a64e-f391-4b49-8418-8f546a367df8 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:29:11.002021 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8336a64e-f391-4b49-8418-8f546a367df8 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:29:11.014490 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:29:11.059685 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278bce29-33d6-496a-9930-581a982eec5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:29:11.060375 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278bce29-33d6-496a-9930-581a982eec5e admin admin] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:29:11.060660 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278bce29-33d6-496a-9930-581a982eec5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:29:11.060935 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278bce29-33d6-496a-9930-581a982eec5e admin admin] PATH_INFO: `/v3/users` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:29:11.061565 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278bce29-33d6-496a-9930-581a982eec5e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:29:11.063710 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278bce29-33d6-496a-9930-581a982eec5e admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:29:11.087537 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1151/2339] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 19 10:29:10 2022] POST /identity/v3/users => generated 299 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:29:11.092075 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5af1bb-70d5-486f-a852-59b09d05972d admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:29:11.102305 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5af1bb-70d5-486f-a852-59b09d05972d admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:29:11.107477 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be54bab5-1533-4790-bd30-5ac222f99d2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:29:11.108067 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be54bab5-1533-4790-bd30-5ac222f99d2a admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:29:11.108375 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be54bab5-1533-4790-bd30-5ac222f99d2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:29:11.108644 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be54bab5-1533-4790-bd30-5ac222f99d2a admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:29:11.109274 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be54bab5-1533-4790-bd30-5ac222f99d2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:29:11.110867 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be54bab5-1533-4790-bd30-5ac222f99d2a admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:29:11.122453 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1189/2340] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:29:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 10:29:11.126645 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278bce29-33d6-496a-9930-581a982eec5e admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:29:11.136678 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278bce29-33d6-496a-9930-581a982eec5e admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:29:11.141320 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6307c1-1be8-4958-8b94-8ea08f9e5e9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:29:11.141967 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6307c1-1be8-4958-8b94-8ea08f9e5e9f admin admin] REQUEST_METHOD: `PUT` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:29:11.142257 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6307c1-1be8-4958-8b94-8ea08f9e5e9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:29:11.142535 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6307c1-1be8-4958-8b94-8ea08f9e5e9f admin admin] PATH_INFO: `/v3/projects/633b4c52d4134b2383f4f009e56a98be/users/37a9ae05ec8a48d6bd7ea99d1d821854/roles/5c8b89fae4fa45bd944cbeaf442136e1` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:29:11.157711 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6307c1-1be8-4958-8b94-8ea08f9e5e9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=633b4c52d4134b2383f4f009e56a98be, user_id=37a9ae05ec8a48d6bd7ea99d1d821854, role_id=5c8b89fae4fa45bd944cbeaf442136e1)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:29:11.160402 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6307c1-1be8-4958-8b94-8ea08f9e5e9f admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:29:11.177036 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1152/2341] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 19 10:29:11 2022] PUT /identity/v3/projects/633b4c52d4134b2383f4f009e56a98be/users/37a9ae05ec8a48d6bd7ea99d1d821854/roles/5c8b89fae4fa45bd944cbeaf442136e1 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:29:11.181468 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be54bab5-1533-4790-bd30-5ac222f99d2a admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:29:11.191531 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be54bab5-1533-4790-bd30-5ac222f99d2a admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:29:11.246185 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c64635-f834-4dcb-8457-82302ab707c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:29:11.246697 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c64635-f834-4dcb-8457-82302ab707c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:29:11.247002 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c64635-f834-4dcb-8457-82302ab707c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:29:11.247273 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c64635-f834-4dcb-8457-82302ab707c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:29:11.247896 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c64635-f834-4dcb-8457-82302ab707c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:29:11.249519 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c64635-f834-4dcb-8457-82302ab707c0 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:29:11.259057 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1190/2342] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:29:11 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 10:29:11.263585 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6307c1-1be8-4958-8b94-8ea08f9e5e9f admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:29:11.276189 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6307c1-1be8-4958-8b94-8ea08f9e5e9f admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:29:11.281137 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59087a83-5fb7-4c4b-9ac2-ea04fd718995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:29:11.281909 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59087a83-5fb7-4c4b-9ac2-ea04fd718995 admin admin] REQUEST_METHOD: `PUT` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:29:11.282221 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59087a83-5fb7-4c4b-9ac2-ea04fd718995 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:29:11.282497 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59087a83-5fb7-4c4b-9ac2-ea04fd718995 admin admin] PATH_INFO: `/v3/projects/633b4c52d4134b2383f4f009e56a98be/users/37a9ae05ec8a48d6bd7ea99d1d821854/roles/5c8b89fae4fa45bd944cbeaf442136e1` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:29:11.284491 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59087a83-5fb7-4c4b-9ac2-ea04fd718995 admin admin] RBAC: Authorizing `identity:create_grant(project_id=633b4c52d4134b2383f4f009e56a98be, user_id=37a9ae05ec8a48d6bd7ea99d1d821854, role_id=5c8b89fae4fa45bd944cbeaf442136e1)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:29:11.287250 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59087a83-5fb7-4c4b-9ac2-ea04fd718995 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:29:11.298968 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1153/2343] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 19 10:29:11 2022] PUT /identity/v3/projects/633b4c52d4134b2383f4f009e56a98be/users/37a9ae05ec8a48d6bd7ea99d1d821854/roles/5c8b89fae4fa45bd944cbeaf442136e1 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:29:11.309625 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b519776-bd37-4b77-a72f-134afeb94665 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:29:11.309909 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b519776-bd37-4b77-a72f-134afeb94665 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:29:11.310182 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b519776-bd37-4b77-a72f-134afeb94665 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:29:11.337284 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-5b519776-bd37-4b77-a72f-134afeb94665 None None] MFA Rules not processed for user `37a9ae05ec8a48d6bd7ea99d1d821854`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:29:11.339063 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-5b519776-bd37-4b77-a72f-134afeb94665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:29:11.403097 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59087a83-5fb7-4c4b-9ac2-ea04fd718995 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:29:11.405086 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-59087a83-5fb7-4c4b-9ac2-ea04fd718995 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:29:11.412457 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1191/2344] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:29:11 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:29:11.423979 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b519776-bd37-4b77-a72f-134afeb94665 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:29:11.425760 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-5b519776-bd37-4b77-a72f-134afeb94665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:29:11.435455 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:29:11.474122 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59087a83-5fb7-4c4b-9ac2-ea04fd718995 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:29:11.478788 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15057b3-4d60-42f7-bb9b-e89e1b457484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:29:11.479420 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15057b3-4d60-42f7-bb9b-e89e1b457484 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:29:11.479695 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15057b3-4d60-42f7-bb9b-e89e1b457484 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:29:11.479965 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15057b3-4d60-42f7-bb9b-e89e1b457484 admin admin] PATH_INFO: `/v3/users/3604da37946c48ea81e1cf567ee50b5c` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:29:11.481115 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15057b3-4d60-42f7-bb9b-e89e1b457484 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3604da37946c48ea81e1cf567ee50b5c)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:29:11.483076 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15057b3-4d60-42f7-bb9b-e89e1b457484 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:29:11.484267 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b519776-bd37-4b77-a72f-134afeb94665 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:29:11.487924 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fd1c8d-bb1f-49c7-99c2-ae41460334bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa4d004fd44482cae761c4b3bdfab31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:29:11.488592 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fd1c8d-bb1f-49c7-99c2-ae41460334bc service cinder] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:29:11.488874 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fd1c8d-bb1f-49c7-99c2-ae41460334bc service cinder] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:29:11.489147 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fd1c8d-bb1f-49c7-99c2-ae41460334bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:29:11.532337 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-c15057b3-4d60-42f7-bb9b-e89e1b457484 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3604da37946c48ea81e1cf567ee50b5c'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:29:11.540546 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-c15057b3-4d60-42f7-bb9b-e89e1b457484 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3604da37946c48ea81e1cf567ee50b5c'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:29:11.541334 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-c15057b3-4d60-42f7-bb9b-e89e1b457484 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3604da37946c48ea81e1cf567ee50b5c'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:29:11.542001 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-c15057b3-4d60-42f7-bb9b-e89e1b457484 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3604da37946c48ea81e1cf567ee50b5c'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:29:11.547856 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fd1c8d-bb1f-49c7-99c2-ae41460334bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:29:11.549413 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-c15057b3-4d60-42f7-bb9b-e89e1b457484 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3604da37946c48ea81e1cf567ee50b5c'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:29:11.549564 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fd1c8d-bb1f-49c7-99c2-ae41460334bc service cinder] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:29:11.559255 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1192/2345] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:29:11 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 10:29:11.559866 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=85,keystone:INSERT=6,keystone:DELETE=9 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:29:11.573850 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1154/2346] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 19 10:29:11 2022] DELETE /identity/v3/users/3604da37946c48ea81e1cf567ee50b5c => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:29:11.578684 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e4ff01-e879-4d44-bcd4-f125da7579dd None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:29:11.578976 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e4ff01-e879-4d44-bcd4-f125da7579dd None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:29:11.579267 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e4ff01-e879-4d44-bcd4-f125da7579dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:29:11.599079 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-a2e4ff01-e879-4d44-bcd4-f125da7579dd None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:29:11.600326 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-a2e4ff01-e879-4d44-bcd4-f125da7579dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:29:11.664244 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1193/2347] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:29:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:29:11.675436 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15057b3-4d60-42f7-bb9b-e89e1b457484 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:29:11.680136 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-c15057b3-4d60-42f7-bb9b-e89e1b457484 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:29:11.752280 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15057b3-4d60-42f7-bb9b-e89e1b457484 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:29:11.756307 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f9396e-9e0a-4519-9eb0-8559cfa0f817 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c1289b015854c6bb6aee8fed6b807db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:29:11.756911 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f9396e-9e0a-4519-9eb0-8559cfa0f817 service neutron] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:29:11.757189 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f9396e-9e0a-4519-9eb0-8559cfa0f817 service neutron] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:29:11.757464 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f9396e-9e0a-4519-9eb0-8559cfa0f817 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:29:11.767927 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f9396e-9e0a-4519-9eb0-8559cfa0f817 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:29:11.769557 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f9396e-9e0a-4519-9eb0-8559cfa0f817 service neutron] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:29:11.779959 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1155/2348] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:29:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:29:12.116979 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e4ff01-e879-4d44-bcd4-f125da7579dd None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:29:12.118408 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-a2e4ff01-e879-4d44-bcd4-f125da7579dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:29:12.131451 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e4ff01-e879-4d44-bcd4-f125da7579dd None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:29:12.137307 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f1ace0-d32f-4510-979b-1556fb9e3562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:29:12.138034 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f1ace0-d32f-4510-979b-1556fb9e3562 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:29:12.138246 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f1ace0-d32f-4510-979b-1556fb9e3562 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:29:12.138523 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f1ace0-d32f-4510-979b-1556fb9e3562 admin admin] PATH_INFO: `/v3/projects/6e5e0fd0f63a42528df3cd11a255d682` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:29:12.139988 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f1ace0-d32f-4510-979b-1556fb9e3562 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e5e0fd0f63a42528df3cd11a255d682)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:29:12.141980 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f1ace0-d32f-4510-979b-1556fb9e3562 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:29:12.194041 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-73f1ace0-d32f-4510-979b-1556fb9e3562 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e5e0fd0f63a42528df3cd11a255d682', 'request_id': 'req-73f1ace0-d32f-4510-979b-1556fb9e3562'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:29:12.200290 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-73f1ace0-d32f-4510-979b-1556fb9e3562 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e5e0fd0f63a42528df3cd11a255d682', 'request_id': 'req-73f1ace0-d32f-4510-979b-1556fb9e3562'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:29:12.202828 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:29:12.208746 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-73f1ace0-d32f-4510-979b-1556fb9e3562 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e5e0fd0f63a42528df3cd11a255d682', 'request_id': 'req-73f1ace0-d32f-4510-979b-1556fb9e3562'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:29:12.219843 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-73f1ace0-d32f-4510-979b-1556fb9e3562 admin admin] The token cache is being invalidate because project 6e5e0fd0f63a42528df3cd11a255d682 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 10:29:12.220133 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-73f1ace0-d32f-4510-979b-1556fb9e3562 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:29:12.220786 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-73f1ace0-d32f-4510-979b-1556fb9e3562 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:29:12.222266 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1194/2349] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 19 10:29:12 2022] DELETE /identity/v3/projects/6e5e0fd0f63a42528df3cd11a255d682 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:29:13.189552 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f9396e-9e0a-4519-9eb0-8559cfa0f817 service neutron] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:29:13.190984 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-a4f9396e-9e0a-4519-9eb0-8559cfa0f817 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:29:13.251008 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f9396e-9e0a-4519-9eb0-8559cfa0f817 service neutron] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:29:13.300641 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de17672a-00d0-46e3-b60c-94bb294cda85 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa4d004fd44482cae761c4b3bdfab31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:29:13.301246 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de17672a-00d0-46e3-b60c-94bb294cda85 service cinder] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:29:13.301531 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de17672a-00d0-46e3-b60c-94bb294cda85 service cinder] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:29:13.301804 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de17672a-00d0-46e3-b60c-94bb294cda85 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:29:13.303568 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-de17672a-00d0-46e3-b60c-94bb294cda85 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:29:13.359845 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de17672a-00d0-46e3-b60c-94bb294cda85 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:29:13.361316 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de17672a-00d0-46e3-b60c-94bb294cda85 service cinder] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:29:13.373359 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1156/2350] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:29:13 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:29:13.961167 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f1ace0-d32f-4510-979b-1556fb9e3562 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:29:13.962772 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-73f1ace0-d32f-4510-979b-1556fb9e3562 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:29:13.975254 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f1ace0-d32f-4510-979b-1556fb9e3562 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:29:13.979325 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b96340c-6d2f-48f7-9bcc-5ecc6b5b514d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa4d004fd44482cae761c4b3bdfab31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:29:13.979936 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b96340c-6d2f-48f7-9bcc-5ecc6b5b514d service cinder] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:29:13.980248 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b96340c-6d2f-48f7-9bcc-5ecc6b5b514d service cinder] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:29:13.980525 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b96340c-6d2f-48f7-9bcc-5ecc6b5b514d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:29:13.982280 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-8b96340c-6d2f-48f7-9bcc-5ecc6b5b514d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:29:14.047436 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b96340c-6d2f-48f7-9bcc-5ecc6b5b514d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:29:14.048904 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b96340c-6d2f-48f7-9bcc-5ecc6b5b514d service cinder] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:29:14.058607 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1195/2351] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:29:13 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:29:17.970546 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de17672a-00d0-46e3-b60c-94bb294cda85 service cinder] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:29:17.972086 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-de17672a-00d0-46e3-b60c-94bb294cda85 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:29:17.977675 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:29:18.042279 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de17672a-00d0-46e3-b60c-94bb294cda85 service cinder] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:29:18.047144 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429ceb60-705d-4306-b439-4ccfb8bcf321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:29:18.047771 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429ceb60-705d-4306-b439-4ccfb8bcf321 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:29:18.048052 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429ceb60-705d-4306-b439-4ccfb8bcf321 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:29:18.048353 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429ceb60-705d-4306-b439-4ccfb8bcf321 admin admin] PATH_INFO: `/v3/users/931feacb79644f8da4161bea382a4b1b` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:29:18.049485 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429ceb60-705d-4306-b439-4ccfb8bcf321 admin admin] RBAC: Authorizing `identity:delete_user(user_id=931feacb79644f8da4161bea382a4b1b)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:29:18.051459 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429ceb60-705d-4306-b439-4ccfb8bcf321 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:29:18.099216 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-429ceb60-705d-4306-b439-4ccfb8bcf321 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '931feacb79644f8da4161bea382a4b1b'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:29:18.105938 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-429ceb60-705d-4306-b439-4ccfb8bcf321 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '931feacb79644f8da4161bea382a4b1b'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:29:18.106673 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-429ceb60-705d-4306-b439-4ccfb8bcf321 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '931feacb79644f8da4161bea382a4b1b'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:29:18.107383 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-429ceb60-705d-4306-b439-4ccfb8bcf321 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '931feacb79644f8da4161bea382a4b1b'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:29:18.114310 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-429ceb60-705d-4306-b439-4ccfb8bcf321 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '931feacb79644f8da4161bea382a4b1b'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:29:18.131666 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1157/2352] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 19 10:29:17 2022] DELETE /identity/v3/users/931feacb79644f8da4161bea382a4b1b => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 10:29:18.136826 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cb79ea-63cc-4c0d-85c9-a0531e7060c0 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:29:18.137305 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cb79ea-63cc-4c0d-85c9-a0531e7060c0 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:29:18.137407 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cb79ea-63cc-4c0d-85c9-a0531e7060c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:29:18.156074 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-01cb79ea-63cc-4c0d-85c9-a0531e7060c0 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:29:18.157497 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-01cb79ea-63cc-4c0d-85c9-a0531e7060c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:29:18.219123 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1196/2353] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:29:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:29:18.229295 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429ceb60-705d-4306-b439-4ccfb8bcf321 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:29:18.230689 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-429ceb60-705d-4306-b439-4ccfb8bcf321 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:29:18.289689 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429ceb60-705d-4306-b439-4ccfb8bcf321 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:29:18.294041 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ed224d-b932-4b5b-9a2a-7cabe7da8436 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c1289b015854c6bb6aee8fed6b807db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:29:18.294656 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ed224d-b932-4b5b-9a2a-7cabe7da8436 service neutron] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:29:18.295188 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ed224d-b932-4b5b-9a2a-7cabe7da8436 service neutron] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:29:18.295463 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ed224d-b932-4b5b-9a2a-7cabe7da8436 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:29:18.304823 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ed224d-b932-4b5b-9a2a-7cabe7da8436 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:29:18.306873 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ed224d-b932-4b5b-9a2a-7cabe7da8436 service neutron] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:29:18.317557 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1158/2354] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:29:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:29:18.650788 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cb79ea-63cc-4c0d-85c9-a0531e7060c0 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:29:18.652754 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-01cb79ea-63cc-4c0d-85c9-a0531e7060c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:29:18.678474 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cb79ea-63cc-4c0d-85c9-a0531e7060c0 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:29:18.707097 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02d310e-02f1-4fc8-b1b9-7a50c8161ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:29:18.707776 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02d310e-02f1-4fc8-b1b9-7a50c8161ae2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:29:18.708058 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02d310e-02f1-4fc8-b1b9-7a50c8161ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:29:18.708364 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02d310e-02f1-4fc8-b1b9-7a50c8161ae2 admin admin] PATH_INFO: `/v3/projects/839a49f1ddf0406db6bee93fb4849846` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:29:18.709656 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02d310e-02f1-4fc8-b1b9-7a50c8161ae2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=839a49f1ddf0406db6bee93fb4849846)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:29:18.711762 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02d310e-02f1-4fc8-b1b9-7a50c8161ae2 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:29:18.768112 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-d02d310e-02f1-4fc8-b1b9-7a50c8161ae2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '839a49f1ddf0406db6bee93fb4849846', 'request_id': 'req-d02d310e-02f1-4fc8-b1b9-7a50c8161ae2'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:29:18.774825 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-d02d310e-02f1-4fc8-b1b9-7a50c8161ae2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '839a49f1ddf0406db6bee93fb4849846', 'request_id': 'req-d02d310e-02f1-4fc8-b1b9-7a50c8161ae2'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:29:18.782983 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-d02d310e-02f1-4fc8-b1b9-7a50c8161ae2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '839a49f1ddf0406db6bee93fb4849846', 'request_id': 'req-d02d310e-02f1-4fc8-b1b9-7a50c8161ae2'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:29:18.796921 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-d02d310e-02f1-4fc8-b1b9-7a50c8161ae2 admin admin] The token cache is being invalidate because project 839a49f1ddf0406db6bee93fb4849846 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 10:29:18.797970 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-d02d310e-02f1-4fc8-b1b9-7a50c8161ae2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:29:18.798644 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-d02d310e-02f1-4fc8-b1b9-7a50c8161ae2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:29:18.803079 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1197/2355] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 19 10:29:18 2022] DELETE /identity/v3/projects/839a49f1ddf0406db6bee93fb4849846 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:29:18.804348 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ed224d-b932-4b5b-9a2a-7cabe7da8436 service neutron] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:29:18.813973 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ed224d-b932-4b5b-9a2a-7cabe7da8436 service neutron] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:29:18.835275 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:29:18.875994 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b105b2db-8140-4db1-92ad-7c6c943eb4bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:29:18.876681 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b105b2db-8140-4db1-92ad-7c6c943eb4bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:29:18.876964 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b105b2db-8140-4db1-92ad-7c6c943eb4bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:29:18.877248 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b105b2db-8140-4db1-92ad-7c6c943eb4bb admin admin] PATH_INFO: `/v3/users/ff7994989cf741828fe737399784c778` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:29:18.878376 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b105b2db-8140-4db1-92ad-7c6c943eb4bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff7994989cf741828fe737399784c778)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:29:18.880474 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b105b2db-8140-4db1-92ad-7c6c943eb4bb admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:29:18.933616 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-b105b2db-8140-4db1-92ad-7c6c943eb4bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff7994989cf741828fe737399784c778'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:29:18.940973 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-b105b2db-8140-4db1-92ad-7c6c943eb4bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff7994989cf741828fe737399784c778'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:29:18.941591 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-b105b2db-8140-4db1-92ad-7c6c943eb4bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff7994989cf741828fe737399784c778'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:29:18.942212 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-b105b2db-8140-4db1-92ad-7c6c943eb4bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff7994989cf741828fe737399784c778'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:29:18.950003 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-b105b2db-8140-4db1-92ad-7c6c943eb4bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff7994989cf741828fe737399784c778'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:29:18.969262 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1159/2356] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 19 10:29:18 2022] DELETE /identity/v3/users/ff7994989cf741828fe737399784c778 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 10:29:19.273489 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02d310e-02f1-4fc8-b1b9-7a50c8161ae2 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:29:19.275118 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-d02d310e-02f1-4fc8-b1b9-7a50c8161ae2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:29:19.284650 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:29:19.293359 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02d310e-02f1-4fc8-b1b9-7a50c8161ae2 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:29:19.354536 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afc3976-0114-4adc-8777-57415c3e665c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:29:19.355174 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afc3976-0114-4adc-8777-57415c3e665c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:29:19.355453 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afc3976-0114-4adc-8777-57415c3e665c admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:29:19.355729 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afc3976-0114-4adc-8777-57415c3e665c admin admin] PATH_INFO: `/v3/projects/fd241b3c81b04f61adb9073e5b3d75f2` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:29:19.362016 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afc3976-0114-4adc-8777-57415c3e665c admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd241b3c81b04f61adb9073e5b3d75f2)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:29:19.364222 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afc3976-0114-4adc-8777-57415c3e665c admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:29:19.420488 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-7afc3976-0114-4adc-8777-57415c3e665c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd241b3c81b04f61adb9073e5b3d75f2', 'request_id': 'req-7afc3976-0114-4adc-8777-57415c3e665c'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:29:19.427786 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-7afc3976-0114-4adc-8777-57415c3e665c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd241b3c81b04f61adb9073e5b3d75f2', 'request_id': 'req-7afc3976-0114-4adc-8777-57415c3e665c'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:29:19.436578 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-7afc3976-0114-4adc-8777-57415c3e665c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd241b3c81b04f61adb9073e5b3d75f2', 'request_id': 'req-7afc3976-0114-4adc-8777-57415c3e665c'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:29:19.447920 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-7afc3976-0114-4adc-8777-57415c3e665c admin admin] The token cache is being invalidate because project fd241b3c81b04f61adb9073e5b3d75f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 10:29:19.448230 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-7afc3976-0114-4adc-8777-57415c3e665c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:29:19.448857 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-7afc3976-0114-4adc-8777-57415c3e665c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:29:19.450324 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1198/2357] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 19 10:29:19 2022] DELETE /identity/v3/projects/fd241b3c81b04f61adb9073e5b3d75f2 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:29:19.454310 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b105b2db-8140-4db1-92ad-7c6c943eb4bb admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:29:19.455745 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-b105b2db-8140-4db1-92ad-7c6c943eb4bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:29:19.468382 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b105b2db-8140-4db1-92ad-7c6c943eb4bb admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:29:19.524527 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af112a72-eb9b-4d89-9de6-ebfe37b15cc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:29:19.525094 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af112a72-eb9b-4d89-9de6-ebfe37b15cc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:29:19.525373 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af112a72-eb9b-4d89-9de6-ebfe37b15cc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:29:19.525646 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af112a72-eb9b-4d89-9de6-ebfe37b15cc0 admin admin] PATH_INFO: `/v3/users/37a9ae05ec8a48d6bd7ea99d1d821854` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:29:19.526749 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af112a72-eb9b-4d89-9de6-ebfe37b15cc0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=37a9ae05ec8a48d6bd7ea99d1d821854)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:29:19.528716 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af112a72-eb9b-4d89-9de6-ebfe37b15cc0 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:29:19.572552 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:29:19.574291 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-af112a72-eb9b-4d89-9de6-ebfe37b15cc0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37a9ae05ec8a48d6bd7ea99d1d821854'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:29:19.581988 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-af112a72-eb9b-4d89-9de6-ebfe37b15cc0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37a9ae05ec8a48d6bd7ea99d1d821854'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:29:19.582890 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-af112a72-eb9b-4d89-9de6-ebfe37b15cc0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37a9ae05ec8a48d6bd7ea99d1d821854'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:29:19.583750 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-af112a72-eb9b-4d89-9de6-ebfe37b15cc0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37a9ae05ec8a48d6bd7ea99d1d821854'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:29:19.591338 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-af112a72-eb9b-4d89-9de6-ebfe37b15cc0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37a9ae05ec8a48d6bd7ea99d1d821854'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:29:19.610794 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1160/2358] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 19 10:29:19 2022] DELETE /identity/v3/users/37a9ae05ec8a48d6bd7ea99d1d821854 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:29:19.904748 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afc3976-0114-4adc-8777-57415c3e665c admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:29:19.906883 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-7afc3976-0114-4adc-8777-57415c3e665c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:29:19.934824 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afc3976-0114-4adc-8777-57415c3e665c admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:29:19.995513 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bd1357-d78d-43ca-b3eb-24422dd5da17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:29:19.996188 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bd1357-d78d-43ca-b3eb-24422dd5da17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:29:19.996475 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bd1357-d78d-43ca-b3eb-24422dd5da17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:29:19.996756 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bd1357-d78d-43ca-b3eb-24422dd5da17 admin admin] PATH_INFO: `/v3/projects/633b4c52d4134b2383f4f009e56a98be` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:29:19.997893 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bd1357-d78d-43ca-b3eb-24422dd5da17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=633b4c52d4134b2383f4f009e56a98be)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:29:19.999817 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bd1357-d78d-43ca-b3eb-24422dd5da17 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:29:20.036118 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:29:20.048511 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-e9bd1357-d78d-43ca-b3eb-24422dd5da17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '633b4c52d4134b2383f4f009e56a98be', 'request_id': 'req-e9bd1357-d78d-43ca-b3eb-24422dd5da17'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:29:20.054767 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-e9bd1357-d78d-43ca-b3eb-24422dd5da17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '633b4c52d4134b2383f4f009e56a98be', 'request_id': 'req-e9bd1357-d78d-43ca-b3eb-24422dd5da17'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:29:20.062570 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-e9bd1357-d78d-43ca-b3eb-24422dd5da17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '633b4c52d4134b2383f4f009e56a98be', 'request_id': 'req-e9bd1357-d78d-43ca-b3eb-24422dd5da17'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:29:20.073034 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-e9bd1357-d78d-43ca-b3eb-24422dd5da17 admin admin] The token cache is being invalidate because project 633b4c52d4134b2383f4f009e56a98be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 10:29:20.073320 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-e9bd1357-d78d-43ca-b3eb-24422dd5da17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:29:20.073961 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-e9bd1357-d78d-43ca-b3eb-24422dd5da17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:29:20.075430 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1199/2359] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 19 10:29:19 2022] DELETE /identity/v3/projects/633b4c52d4134b2383f4f009e56a98be => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:29:20.080406 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4407e0-6563-48cb-bb7b-0c88299283ac None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:29:20.080764 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4407e0-6563-48cb-bb7b-0c88299283ac None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:29:20.081106 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4407e0-6563-48cb-bb7b-0c88299283ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:29:20.102675 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-2a4407e0-6563-48cb-bb7b-0c88299283ac None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:29:20.104642 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-2a4407e0-6563-48cb-bb7b-0c88299283ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:29:20.166781 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1161/2360] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:29:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:29:20.175849 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f90733-b584-4fde-a97b-84bb322e67d2 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:29:20.176134 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f90733-b584-4fde-a97b-84bb322e67d2 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:29:20.176440 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f90733-b584-4fde-a97b-84bb322e67d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:29:20.196774 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-18f90733-b584-4fde-a97b-84bb322e67d2 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:29:20.197986 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-18f90733-b584-4fde-a97b-84bb322e67d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:29:20.206307 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1200/2361] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:29:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:29:20.210463 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4407e0-6563-48cb-bb7b-0c88299283ac None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:29:20.221247 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4407e0-6563-48cb-bb7b-0c88299283ac None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:29:20.225962 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0816a57-1186-435b-8181-8c379aac447d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:29:20.226752 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0816a57-1186-435b-8181-8c379aac447d admin admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:29:20.226888 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0816a57-1186-435b-8181-8c379aac447d admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:29:20.227134 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0816a57-1186-435b-8181-8c379aac447d admin admin] PATH_INFO: `/v3/domains` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:29:20.227795 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0816a57-1186-435b-8181-8c379aac447d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:29:20.228847 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0816a57-1186-435b-8181-8c379aac447d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:29:20.230431 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0816a57-1186-435b-8181-8c379aac447d admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:29:20.243517 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1162/2362] 10.222.0.66 () {58 vars in 1153 bytes} [Mon Sep 19 10:29:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 10:29:20.248014 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f90733-b584-4fde-a97b-84bb322e67d2 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:29:20.257449 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f90733-b584-4fde-a97b-84bb322e67d2 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:29:20.262320 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e72226a-66d9-4b54-8f6f-37b5eb6d0783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:29:20.262952 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e72226a-66d9-4b54-8f6f-37b5eb6d0783 admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:29:20.263233 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e72226a-66d9-4b54-8f6f-37b5eb6d0783 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:29:20.263510 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e72226a-66d9-4b54-8f6f-37b5eb6d0783 admin admin] PATH_INFO: `/v3/projects` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:29:20.264188 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e72226a-66d9-4b54-8f6f-37b5eb6d0783 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:29:20.266156 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e72226a-66d9-4b54-8f6f-37b5eb6d0783 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:29:20.294672 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1201/2363] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 19 10:29:20 2022] POST /identity/v3/projects => generated 371 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:29:20.299026 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0816a57-1186-435b-8181-8c379aac447d admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:29:20.309105 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0816a57-1186-435b-8181-8c379aac447d admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:29:20.366857 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e30d88-4fba-4125-9f5b-4568ec83522d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:29:20.367458 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e30d88-4fba-4125-9f5b-4568ec83522d admin admin] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:29:20.367737 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e30d88-4fba-4125-9f5b-4568ec83522d admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:29:20.368010 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e30d88-4fba-4125-9f5b-4568ec83522d admin admin] PATH_INFO: `/v3/users` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:29:20.368679 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e30d88-4fba-4125-9f5b-4568ec83522d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:29:20.370598 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e30d88-4fba-4125-9f5b-4568ec83522d admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:29:20.392870 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1163/2364] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 19 10:29:20 2022] POST /identity/v3/users => generated 286 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:29:20.397101 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e72226a-66d9-4b54-8f6f-37b5eb6d0783 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:29:20.407873 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e72226a-66d9-4b54-8f6f-37b5eb6d0783 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:29:20.412427 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fab1f04-f639-4d9a-a443-a951471b4a3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:29:20.413014 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fab1f04-f639-4d9a-a443-a951471b4a3b admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:29:20.413292 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fab1f04-f639-4d9a-a443-a951471b4a3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:29:20.413559 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fab1f04-f639-4d9a-a443-a951471b4a3b admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:29:20.414187 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fab1f04-f639-4d9a-a443-a951471b4a3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:29:20.415761 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fab1f04-f639-4d9a-a443-a951471b4a3b admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:29:20.425724 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1202/2365] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:29:20 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 10:29:20.431444 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e30d88-4fba-4125-9f5b-4568ec83522d admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:29:20.442313 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e30d88-4fba-4125-9f5b-4568ec83522d admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:29:20.447572 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e134145-1be0-4901-a92f-35369566e343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:29:20.448188 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e134145-1be0-4901-a92f-35369566e343 admin admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:29:20.448487 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e134145-1be0-4901-a92f-35369566e343 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:29:20.448754 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e134145-1be0-4901-a92f-35369566e343 admin admin] PATH_INFO: `/v3/roles` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:29:20.449416 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e134145-1be0-4901-a92f-35369566e343 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:29:20.451019 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e134145-1be0-4901-a92f-35369566e343 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:29:20.461999 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1164/2366] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:29:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 10:29:20.466741 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fab1f04-f639-4d9a-a443-a951471b4a3b admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:29:20.476720 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fab1f04-f639-4d9a-a443-a951471b4a3b admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:29:20.481314 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42cf000-e415-4e70-8de5-7447acce0527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:29:20.481964 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42cf000-e415-4e70-8de5-7447acce0527 admin admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:29:20.482243 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42cf000-e415-4e70-8de5-7447acce0527 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:29:20.482521 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42cf000-e415-4e70-8de5-7447acce0527 admin admin] PATH_INFO: `/v3/projects/4ad2ab63f1034b56a3e4eb59883fdec3/users/0ba6eafda2eb432aa3c7e031743ed2c8/roles/cd5b42ed3b754b58817a62bbe74651b4` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:29:20.496916 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42cf000-e415-4e70-8de5-7447acce0527 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ad2ab63f1034b56a3e4eb59883fdec3, user_id=0ba6eafda2eb432aa3c7e031743ed2c8, role_id=cd5b42ed3b754b58817a62bbe74651b4)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:29:20.499549 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42cf000-e415-4e70-8de5-7447acce0527 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:29:20.513742 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1203/2367] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 19 10:29:20 2022] PUT /identity/v3/projects/4ad2ab63f1034b56a3e4eb59883fdec3/users/0ba6eafda2eb432aa3c7e031743ed2c8/roles/cd5b42ed3b754b58817a62bbe74651b4 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:29:20.518841 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c16a3f-10f4-4c76-be28-1a87b19f1681 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:29:20.519127 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c16a3f-10f4-4c76-be28-1a87b19f1681 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:29:20.519401 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c16a3f-10f4-4c76-be28-1a87b19f1681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:29:20.538424 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-c2c16a3f-10f4-4c76-be28-1a87b19f1681 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:29:20.539611 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-c2c16a3f-10f4-4c76-be28-1a87b19f1681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:29:20.563431 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:29:20.602169 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1165/2368] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:29:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 10:29:20.612012 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42cf000-e415-4e70-8de5-7447acce0527 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:29:20.613804 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-c42cf000-e415-4e70-8de5-7447acce0527 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:29:20.675882 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42cf000-e415-4e70-8de5-7447acce0527 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:29:20.679746 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275b74b4-4f01-4f57-b75f-f1895ea4dfde service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c1289b015854c6bb6aee8fed6b807db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:29:20.680391 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275b74b4-4f01-4f57-b75f-f1895ea4dfde service neutron] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:29:20.680676 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275b74b4-4f01-4f57-b75f-f1895ea4dfde service neutron] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:29:20.680953 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275b74b4-4f01-4f57-b75f-f1895ea4dfde service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:29:20.690486 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275b74b4-4f01-4f57-b75f-f1895ea4dfde service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:29:20.691927 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275b74b4-4f01-4f57-b75f-f1895ea4dfde service neutron] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:29:20.702127 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1204/2369] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:29:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:29:21.370125 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40f9779-d88a-4d94-a28b-6ff955da9ee0 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:29:21.370531 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40f9779-d88a-4d94-a28b-6ff955da9ee0 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:29:21.370965 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40f9779-d88a-4d94-a28b-6ff955da9ee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:29:21.403960 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-d40f9779-d88a-4d94-a28b-6ff955da9ee0 None None] MFA Rules not processed for user `0ba6eafda2eb432aa3c7e031743ed2c8`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:29:21.405220 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-d40f9779-d88a-4d94-a28b-6ff955da9ee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:29:21.475944 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1166/2370] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:29:21 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:29:21.487043 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275b74b4-4f01-4f57-b75f-f1895ea4dfde service neutron] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:29:21.488589 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-275b74b4-4f01-4f57-b75f-f1895ea4dfde service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:29:21.551431 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275b74b4-4f01-4f57-b75f-f1895ea4dfde service neutron] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:29:21.555099 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688bda54-1979-4b6a-ab65-7699672fd9f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa4d004fd44482cae761c4b3bdfab31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:29:21.555712 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688bda54-1979-4b6a-ab65-7699672fd9f8 service cinder] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:29:21.556005 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688bda54-1979-4b6a-ab65-7699672fd9f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:29:21.556339 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688bda54-1979-4b6a-ab65-7699672fd9f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:29:21.565009 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688bda54-1979-4b6a-ab65-7699672fd9f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:29:21.566442 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688bda54-1979-4b6a-ab65-7699672fd9f8 service cinder] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:29:21.575246 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1205/2371] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:29:21 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:29:22.938593 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c86456-19c5-436e-beb9-23fae1a4bde8 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:29:22.939502 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c86456-19c5-436e-beb9-23fae1a4bde8 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:29:22.939502 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c86456-19c5-436e-beb9-23fae1a4bde8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:29:22.958219 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-95c86456-19c5-436e-beb9-23fae1a4bde8 None None] MFA Rules not processed for user `0ba6eafda2eb432aa3c7e031743ed2c8`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:29:22.959350 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-95c86456-19c5-436e-beb9-23fae1a4bde8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:29:22.967745 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1167/2372] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:29:22 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:29:31.571360 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:DELETE=5,keystone:SELECT=90,keystone:INSERT=3 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:29:32.953151 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=49 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:29:33.646792 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688bda54-1979-4b6a-ab65-7699672fd9f8 service cinder] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:29:33.648381 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-688bda54-1979-4b6a-ab65-7699672fd9f8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:29:33.662496 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688bda54-1979-4b6a-ab65-7699672fd9f8 service cinder] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:29:33.667318 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b574ba-e33f-4b6c-b2d4-b5057d094397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:29:33.667956 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b574ba-e33f-4b6c-b2d4-b5057d094397 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:29:33.668287 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b574ba-e33f-4b6c-b2d4-b5057d094397 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:29:33.668640 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b574ba-e33f-4b6c-b2d4-b5057d094397 admin admin] PATH_INFO: `/v3/users/de5bebe61f9b4e0aa23c07e2fdf3cc3d` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:29:33.669707 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b574ba-e33f-4b6c-b2d4-b5057d094397 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de5bebe61f9b4e0aa23c07e2fdf3cc3d)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:29:33.671905 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b574ba-e33f-4b6c-b2d4-b5057d094397 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:29:33.724765 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-f9b574ba-e33f-4b6c-b2d4-b5057d094397 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de5bebe61f9b4e0aa23c07e2fdf3cc3d'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:29:33.732020 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-f9b574ba-e33f-4b6c-b2d4-b5057d094397 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de5bebe61f9b4e0aa23c07e2fdf3cc3d'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:29:33.732754 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-f9b574ba-e33f-4b6c-b2d4-b5057d094397 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de5bebe61f9b4e0aa23c07e2fdf3cc3d'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:29:33.733349 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-f9b574ba-e33f-4b6c-b2d4-b5057d094397 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de5bebe61f9b4e0aa23c07e2fdf3cc3d'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:29:33.740304 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-f9b574ba-e33f-4b6c-b2d4-b5057d094397 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de5bebe61f9b4e0aa23c07e2fdf3cc3d'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:29:33.757650 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1206/2373] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 19 10:29:33 2022] DELETE /identity/v3/users/de5bebe61f9b4e0aa23c07e2fdf3cc3d => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:29:33.763113 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10286751-8e27-4f98-8c4b-090fe4c8f55e None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:29:33.763397 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10286751-8e27-4f98-8c4b-090fe4c8f55e None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:29:33.763671 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10286751-8e27-4f98-8c4b-090fe4c8f55e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:29:33.785902 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-10286751-8e27-4f98-8c4b-090fe4c8f55e None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:29:33.787102 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-10286751-8e27-4f98-8c4b-090fe4c8f55e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:29:33.845795 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1168/2374] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:29:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:29:33.856111 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b574ba-e33f-4b6c-b2d4-b5057d094397 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:29:33.857613 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-f9b574ba-e33f-4b6c-b2d4-b5057d094397 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:29:33.919338 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b574ba-e33f-4b6c-b2d4-b5057d094397 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:29:33.923177 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f30187d-0700-4af7-8125-ad3a0ad2e5e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c1289b015854c6bb6aee8fed6b807db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:29:33.923782 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f30187d-0700-4af7-8125-ad3a0ad2e5e4 service neutron] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:29:33.924063 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f30187d-0700-4af7-8125-ad3a0ad2e5e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:29:33.924366 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f30187d-0700-4af7-8125-ad3a0ad2e5e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:29:33.934802 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f30187d-0700-4af7-8125-ad3a0ad2e5e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:29:33.936438 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f30187d-0700-4af7-8125-ad3a0ad2e5e4 service neutron] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:29:33.946664 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1207/2375] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:29:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:29:34.368207 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10286751-8e27-4f98-8c4b-090fe4c8f55e None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:29:34.369731 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-10286751-8e27-4f98-8c4b-090fe4c8f55e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:29:34.385757 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10286751-8e27-4f98-8c4b-090fe4c8f55e None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:29:34.392684 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9141c429-3785-4284-bbe8-5791084b8783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:29:34.393947 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9141c429-3785-4284-bbe8-5791084b8783 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:29:34.394898 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9141c429-3785-4284-bbe8-5791084b8783 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:29:34.397853 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9141c429-3785-4284-bbe8-5791084b8783 admin admin] PATH_INFO: `/v3/projects/017b64a98d8d4481ab52471ed4ad953d` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:29:34.399350 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9141c429-3785-4284-bbe8-5791084b8783 admin admin] RBAC: Authorizing `identity:delete_project(project_id=017b64a98d8d4481ab52471ed4ad953d)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:29:34.404103 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9141c429-3785-4284-bbe8-5791084b8783 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:29:34.466744 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-9141c429-3785-4284-bbe8-5791084b8783 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '017b64a98d8d4481ab52471ed4ad953d', 'request_id': 'req-9141c429-3785-4284-bbe8-5791084b8783'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:29:34.473992 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-9141c429-3785-4284-bbe8-5791084b8783 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '017b64a98d8d4481ab52471ed4ad953d', 'request_id': 'req-9141c429-3785-4284-bbe8-5791084b8783'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:29:34.481682 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-9141c429-3785-4284-bbe8-5791084b8783 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '017b64a98d8d4481ab52471ed4ad953d', 'request_id': 'req-9141c429-3785-4284-bbe8-5791084b8783'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:29:34.492455 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-9141c429-3785-4284-bbe8-5791084b8783 admin admin] The token cache is being invalidate because project 017b64a98d8d4481ab52471ed4ad953d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 10:29:34.492773 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-9141c429-3785-4284-bbe8-5791084b8783 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:29:34.493518 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-9141c429-3785-4284-bbe8-5791084b8783 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:29:34.495123 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1169/2376] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 19 10:29:34 2022] DELETE /identity/v3/projects/017b64a98d8d4481ab52471ed4ad953d => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 10:29:34.500405 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a05ef6-027d-45fa-865e-5c4dea43fc19 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:29:34.500696 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a05ef6-027d-45fa-865e-5c4dea43fc19 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:29:34.501000 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a05ef6-027d-45fa-865e-5c4dea43fc19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:29:34.523545 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-67a05ef6-027d-45fa-865e-5c4dea43fc19 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:29:34.526695 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-67a05ef6-027d-45fa-865e-5c4dea43fc19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:29:34.590662 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1208/2377] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:29:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:29:34.598447 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686db152-50e9-4d83-a2a3-14f6ca872c19 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:29:34.598734 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686db152-50e9-4d83-a2a3-14f6ca872c19 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:29:34.599010 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686db152-50e9-4d83-a2a3-14f6ca872c19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:29:34.619762 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-686db152-50e9-4d83-a2a3-14f6ca872c19 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:29:34.620992 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-686db152-50e9-4d83-a2a3-14f6ca872c19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:29:34.628888 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1170/2378] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:29:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:29:34.633425 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a05ef6-027d-45fa-865e-5c4dea43fc19 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:29:34.644899 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a05ef6-027d-45fa-865e-5c4dea43fc19 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:29:34.650122 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4387a8ba-fd99-47f4-a8ef-f40b1ad6e264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:29:34.650738 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4387a8ba-fd99-47f4-a8ef-f40b1ad6e264 admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:29:34.651026 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4387a8ba-fd99-47f4-a8ef-f40b1ad6e264 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:29:34.651299 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4387a8ba-fd99-47f4-a8ef-f40b1ad6e264 admin admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:29:34.651942 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4387a8ba-fd99-47f4-a8ef-f40b1ad6e264 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:29:34.652277 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4387a8ba-fd99-47f4-a8ef-f40b1ad6e264 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:29:34.653877 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4387a8ba-fd99-47f4-a8ef-f40b1ad6e264 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:29:34.665816 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1209/2379] 10.222.0.66 () {58 vars in 1153 bytes} [Mon Sep 19 10:29:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:29:34.670369 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686db152-50e9-4d83-a2a3-14f6ca872c19 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:29:34.679858 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686db152-50e9-4d83-a2a3-14f6ca872c19 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:29:34.685753 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4b15e8-2e18-4295-923f-2f80928cad8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:29:34.686368 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4b15e8-2e18-4295-923f-2f80928cad8e admin admin] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:29:34.686650 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4b15e8-2e18-4295-923f-2f80928cad8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:29:34.686925 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4b15e8-2e18-4295-923f-2f80928cad8e admin admin] PATH_INFO: `/v3/projects` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:29:34.687570 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4b15e8-2e18-4295-923f-2f80928cad8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:29:34.689728 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4b15e8-2e18-4295-923f-2f80928cad8e admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:29:34.720105 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1171/2380] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 19 10:29:34 2022] POST /identity/v3/projects => generated 371 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:29:34.724333 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4387a8ba-fd99-47f4-a8ef-f40b1ad6e264 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:29:34.729634 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:29:34.736020 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4387a8ba-fd99-47f4-a8ef-f40b1ad6e264 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:29:34.798164 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce37306-846f-49b7-89d9-759ab7894a0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:29:34.798782 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce37306-846f-49b7-89d9-759ab7894a0e admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:29:34.799099 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce37306-846f-49b7-89d9-759ab7894a0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:29:34.799344 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce37306-846f-49b7-89d9-759ab7894a0e admin admin] PATH_INFO: `/v3/users` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:29:34.799978 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce37306-846f-49b7-89d9-759ab7894a0e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:29:34.801964 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce37306-846f-49b7-89d9-759ab7894a0e admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:29:34.824446 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1210/2381] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 19 10:29:34 2022] POST /identity/v3/users => generated 286 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:29:34.828515 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4b15e8-2e18-4295-923f-2f80928cad8e admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:29:34.839513 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4b15e8-2e18-4295-923f-2f80928cad8e admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:29:34.844129 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77e7864-e426-4960-a576-cf55efe3bdaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:29:34.844760 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77e7864-e426-4960-a576-cf55efe3bdaa admin admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:29:34.845041 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77e7864-e426-4960-a576-cf55efe3bdaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:29:34.845311 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77e7864-e426-4960-a576-cf55efe3bdaa admin admin] PATH_INFO: `/v3/roles` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:29:34.845945 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77e7864-e426-4960-a576-cf55efe3bdaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:29:34.847541 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77e7864-e426-4960-a576-cf55efe3bdaa admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:29:34.857779 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1172/2382] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:29:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 10:29:34.862446 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce37306-846f-49b7-89d9-759ab7894a0e admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:29:34.872403 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce37306-846f-49b7-89d9-759ab7894a0e admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:29:34.876995 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7e176a-baaa-4ba3-9a33-638118f8df65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:29:34.877581 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7e176a-baaa-4ba3-9a33-638118f8df65 admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:29:34.877859 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7e176a-baaa-4ba3-9a33-638118f8df65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:29:34.878130 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7e176a-baaa-4ba3-9a33-638118f8df65 admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:29:34.878755 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7e176a-baaa-4ba3-9a33-638118f8df65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:29:34.880370 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7e176a-baaa-4ba3-9a33-638118f8df65 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:29:34.893932 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1211/2383] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:29:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 10:29:34.898071 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77e7864-e426-4960-a576-cf55efe3bdaa admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:29:34.908797 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77e7864-e426-4960-a576-cf55efe3bdaa admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:29:34.913974 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b26187-38e0-49dd-a21e-081ab6756935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:29:34.914627 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b26187-38e0-49dd-a21e-081ab6756935 admin admin] REQUEST_METHOD: `PUT` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:29:34.914910 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b26187-38e0-49dd-a21e-081ab6756935 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:29:34.915217 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b26187-38e0-49dd-a21e-081ab6756935 admin admin] PATH_INFO: `/v3/projects/ae0b96965a0b4564a4cc19028bf55123/users/699aa0a0199f4e908d90a4e1ef5efc15/roles/cd5b42ed3b754b58817a62bbe74651b4` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:29:34.930853 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b26187-38e0-49dd-a21e-081ab6756935 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae0b96965a0b4564a4cc19028bf55123, user_id=699aa0a0199f4e908d90a4e1ef5efc15, role_id=cd5b42ed3b754b58817a62bbe74651b4)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:29:34.933557 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b26187-38e0-49dd-a21e-081ab6756935 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:29:34.947917 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1173/2384] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 19 10:29:34 2022] PUT /identity/v3/projects/ae0b96965a0b4564a4cc19028bf55123/users/699aa0a0199f4e908d90a4e1ef5efc15/roles/cd5b42ed3b754b58817a62bbe74651b4 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:29:34.952991 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1b56a4-8a15-4d4a-ac67-bbcde0aec3be None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:29:34.953284 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1b56a4-8a15-4d4a-ac67-bbcde0aec3be None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:29:34.953566 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1b56a4-8a15-4d4a-ac67-bbcde0aec3be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:29:34.974040 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-be1b56a4-8a15-4d4a-ac67-bbcde0aec3be None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:29:34.975273 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-be1b56a4-8a15-4d4a-ac67-bbcde0aec3be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:29:35.039574 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1212/2385] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:29:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:29:35.049497 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b26187-38e0-49dd-a21e-081ab6756935 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:29:35.051383 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-f7b26187-38e0-49dd-a21e-081ab6756935 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:29:35.076019 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:29:35.235462 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b26187-38e0-49dd-a21e-081ab6756935 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:29:35.239807 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9152a7-6eba-49b5-a3b0-947a75515dba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c1289b015854c6bb6aee8fed6b807db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:29:35.240458 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9152a7-6eba-49b5-a3b0-947a75515dba service neutron] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:29:35.240741 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9152a7-6eba-49b5-a3b0-947a75515dba service neutron] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:29:35.241017 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9152a7-6eba-49b5-a3b0-947a75515dba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:29:35.250953 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9152a7-6eba-49b5-a3b0-947a75515dba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:29:35.252421 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9152a7-6eba-49b5-a3b0-947a75515dba service neutron] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:29:35.262571 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1174/2386] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:29:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:29:40.086464 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ca2e5b-5bd2-4fda-ac4c-9a70aa545521 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:29:40.087616 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ca2e5b-5bd2-4fda-ac4c-9a70aa545521 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:29:40.087616 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ca2e5b-5bd2-4fda-ac4c-9a70aa545521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:29:40.118272 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-a7ca2e5b-5bd2-4fda-ac4c-9a70aa545521 None None] MFA Rules not processed for user `699aa0a0199f4e908d90a4e1ef5efc15`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:29:40.119613 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-a7ca2e5b-5bd2-4fda-ac4c-9a70aa545521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:29:40.189887 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1213/2387] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:29:40 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:29:40.194412 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9152a7-6eba-49b5-a3b0-947a75515dba service neutron] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:29:40.205702 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9152a7-6eba-49b5-a3b0-947a75515dba service neutron] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:29:40.210509 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b79d9a-bedd-4f3a-a610-bf94c4b0b599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:29:40.211197 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b79d9a-bedd-4f3a-a610-bf94c4b0b599 admin admin] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:29:40.211562 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b79d9a-bedd-4f3a-a610-bf94c4b0b599 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:29:40.212533 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b79d9a-bedd-4f3a-a610-bf94c4b0b599 admin admin] PATH_INFO: `/v3/projects` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:29:40.213270 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b79d9a-bedd-4f3a-a610-bf94c4b0b599 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:29:40.215327 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b79d9a-bedd-4f3a-a610-bf94c4b0b599 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:29:40.244961 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1175/2388] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 19 10:29:40 2022] POST /identity/v3/projects => generated 373 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:29:40.254459 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ca2e5b-5bd2-4fda-ac4c-9a70aa545521 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:29:40.266898 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ca2e5b-5bd2-4fda-ac4c-9a70aa545521 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:29:40.275538 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:29:40.344949 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7835a51d-b6a0-4d29-ac1a-9049db71987c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:29:40.345609 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7835a51d-b6a0-4d29-ac1a-9049db71987c admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:29:40.345946 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7835a51d-b6a0-4d29-ac1a-9049db71987c admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:29:40.347448 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7835a51d-b6a0-4d29-ac1a-9049db71987c admin admin] PATH_INFO: `/v3/users` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:29:40.348116 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7835a51d-b6a0-4d29-ac1a-9049db71987c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:29:40.350099 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7835a51d-b6a0-4d29-ac1a-9049db71987c admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:29:40.373942 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1214/2389] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 19 10:29:40 2022] POST /identity/v3/users => generated 293 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:29:40.377985 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b79d9a-bedd-4f3a-a610-bf94c4b0b599 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:29:40.389689 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b79d9a-bedd-4f3a-a610-bf94c4b0b599 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:29:40.394807 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d762d44c-db7f-4c87-ba2d-6ccb7bb1ee00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:29:40.395493 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d762d44c-db7f-4c87-ba2d-6ccb7bb1ee00 admin admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:29:40.395840 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d762d44c-db7f-4c87-ba2d-6ccb7bb1ee00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:29:40.396194 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d762d44c-db7f-4c87-ba2d-6ccb7bb1ee00 admin admin] PATH_INFO: `/v3/roles` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:29:40.396927 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d762d44c-db7f-4c87-ba2d-6ccb7bb1ee00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:29:40.398603 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d762d44c-db7f-4c87-ba2d-6ccb7bb1ee00 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:29:40.409501 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1176/2390] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:29:40 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 10:29:40.413785 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7835a51d-b6a0-4d29-ac1a-9049db71987c admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:29:40.427249 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7835a51d-b6a0-4d29-ac1a-9049db71987c admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:29:40.433271 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7727fe3-959a-4a62-a8c0-153ce26111fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:29:40.433948 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7727fe3-959a-4a62-a8c0-153ce26111fa admin admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:29:40.434227 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7727fe3-959a-4a62-a8c0-153ce26111fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:29:40.434498 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7727fe3-959a-4a62-a8c0-153ce26111fa admin admin] PATH_INFO: `/v3/projects/49d4a70e46734aea96f73796d7d4c5e9/users/ab574e9d27254a81a9e8eb09a6c263e1/roles/5c8b89fae4fa45bd944cbeaf442136e1` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:29:40.452870 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7727fe3-959a-4a62-a8c0-153ce26111fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=49d4a70e46734aea96f73796d7d4c5e9, user_id=ab574e9d27254a81a9e8eb09a6c263e1, role_id=5c8b89fae4fa45bd944cbeaf442136e1)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:29:40.456009 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7727fe3-959a-4a62-a8c0-153ce26111fa admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:29:40.471132 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1215/2391] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 19 10:29:40 2022] PUT /identity/v3/projects/49d4a70e46734aea96f73796d7d4c5e9/users/ab574e9d27254a81a9e8eb09a6c263e1/roles/5c8b89fae4fa45bd944cbeaf442136e1 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:29:40.475238 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d762d44c-db7f-4c87-ba2d-6ccb7bb1ee00 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:29:40.486101 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d762d44c-db7f-4c87-ba2d-6ccb7bb1ee00 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:29:40.546688 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c27234-431d-4129-886d-d47bd174ee7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:29:40.547326 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c27234-431d-4129-886d-d47bd174ee7d admin admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:29:40.547612 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c27234-431d-4129-886d-d47bd174ee7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:29:40.547883 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c27234-431d-4129-886d-d47bd174ee7d admin admin] PATH_INFO: `/v3/roles` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:29:40.548560 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c27234-431d-4129-886d-d47bd174ee7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:29:40.550187 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c27234-431d-4129-886d-d47bd174ee7d admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:29:40.561237 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1177/2392] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:29:40 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 10:29:40.565873 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7727fe3-959a-4a62-a8c0-153ce26111fa admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:29:40.577944 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7727fe3-959a-4a62-a8c0-153ce26111fa admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:29:40.584492 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b0f90f-bd84-472c-a7cc-377f67fb409d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:29:40.585286 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b0f90f-bd84-472c-a7cc-377f67fb409d admin admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:29:40.585639 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b0f90f-bd84-472c-a7cc-377f67fb409d admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:29:40.585991 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b0f90f-bd84-472c-a7cc-377f67fb409d admin admin] PATH_INFO: `/v3/projects/49d4a70e46734aea96f73796d7d4c5e9/users/ab574e9d27254a81a9e8eb09a6c263e1/roles/5c8b89fae4fa45bd944cbeaf442136e1` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:29:40.588346 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b0f90f-bd84-472c-a7cc-377f67fb409d admin admin] RBAC: Authorizing `identity:create_grant(project_id=49d4a70e46734aea96f73796d7d4c5e9, user_id=ab574e9d27254a81a9e8eb09a6c263e1, role_id=5c8b89fae4fa45bd944cbeaf442136e1)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:29:40.591075 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b0f90f-bd84-472c-a7cc-377f67fb409d admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:29:40.607369 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1216/2393] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 19 10:29:40 2022] PUT /identity/v3/projects/49d4a70e46734aea96f73796d7d4c5e9/users/ab574e9d27254a81a9e8eb09a6c263e1/roles/5c8b89fae4fa45bd944cbeaf442136e1 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:29:44.788657 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c9fb1d-97ca-45f1-bd63-4f84c94f1fb7 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:29:44.789570 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c9fb1d-97ca-45f1-bd63-4f84c94f1fb7 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:29:44.790344 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c9fb1d-97ca-45f1-bd63-4f84c94f1fb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:29:44.828866 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-c1c9fb1d-97ca-45f1-bd63-4f84c94f1fb7 None None] MFA Rules not processed for user `0ba6eafda2eb432aa3c7e031743ed2c8`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:29:44.830802 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-c1c9fb1d-97ca-45f1-bd63-4f84c94f1fb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:29:44.934900 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1178/2394] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:29:44 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:29:46.231020 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a22ed7-9326-4062-86c1-8849851eebb5 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:29:46.232001 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a22ed7-9326-4062-86c1-8849851eebb5 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:29:46.232339 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a22ed7-9326-4062-86c1-8849851eebb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:29:46.275693 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-07a22ed7-9326-4062-86c1-8849851eebb5 None None] MFA Rules not processed for user `f66555915f3b46f0a687df2a69fc7eee`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:29:46.277305 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-07a22ed7-9326-4062-86c1-8849851eebb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:29:46.378589 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1217/2395] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:29:46 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:29:48.163702 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7656350b-24a0-492c-9a94-06a410481faf None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:29:48.164311 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7656350b-24a0-492c-9a94-06a410481faf None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:29:48.164422 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7656350b-24a0-492c-9a94-06a410481faf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:29:48.193800 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-7656350b-24a0-492c-9a94-06a410481faf None None] MFA Rules not processed for user `ab574e9d27254a81a9e8eb09a6c263e1`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:29:48.194823 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-7656350b-24a0-492c-9a94-06a410481faf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:29:48.223615 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:29:48.304333 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1179/2396] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:29:48 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:29:48.327161 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a22ed7-9326-4062-86c1-8849851eebb5 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:29:48.329561 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-07a22ed7-9326-4062-86c1-8849851eebb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:29:48.493923 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a22ed7-9326-4062-86c1-8849851eebb5 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:29:48.507303 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c028434f-96b9-443e-b3f4-bcf1896ef3dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15c70bfb085a44e9b84942b480ff22f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:29:48.508020 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c028434f-96b9-443e-b3f4-bcf1896ef3dd service nova] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:29:48.508973 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c028434f-96b9-443e-b3f4-bcf1896ef3dd service nova] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:29:48.509364 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c028434f-96b9-443e-b3f4-bcf1896ef3dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:29:48.534017 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:29:48.599646 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c028434f-96b9-443e-b3f4-bcf1896ef3dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:29:48.601480 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c028434f-96b9-443e-b3f4-bcf1896ef3dd service nova] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:29:48.612232 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1218/2397] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:29:48 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:29:49.934631 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5771051f-6d54-4d4e-9c1d-34271b1935fa None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:29:49.935163 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5771051f-6d54-4d4e-9c1d-34271b1935fa None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:29:49.935163 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5771051f-6d54-4d4e-9c1d-34271b1935fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:29:49.954317 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-5771051f-6d54-4d4e-9c1d-34271b1935fa None None] MFA Rules not processed for user `699aa0a0199f4e908d90a4e1ef5efc15`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:29:49.955516 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-5771051f-6d54-4d4e-9c1d-34271b1935fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:29:49.962873 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1180/2398] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:29:49 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:29:58.607431 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=25 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:29:59.949324 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=23 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:30:02.495874 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de28984a-9d67-4e6d-8e19-47cb0e189404 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:30:02.496422 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de28984a-9d67-4e6d-8e19-47cb0e189404 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:30:02.496555 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de28984a-9d67-4e6d-8e19-47cb0e189404 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:30:02.516147 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-de28984a-9d67-4e6d-8e19-47cb0e189404 None None] MFA Rules not processed for user `e62a6e400ad7425f9217164bc9190a21`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:30:02.517418 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-de28984a-9d67-4e6d-8e19-47cb0e189404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:30:02.575618 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1219/2399] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:30:02 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:30:10.468562 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5771051f-6d54-4d4e-9c1d-34271b1935fa None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:30:10.470162 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-5771051f-6d54-4d4e-9c1d-34271b1935fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:30:10.541336 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5771051f-6d54-4d4e-9c1d-34271b1935fa None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:30:10.546537 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551143f6-74df-4512-9b81-d80357dba8be service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46b78120cac64f09bd0f4cdc42424163', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:30:10.547153 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551143f6-74df-4512-9b81-d80357dba8be service placement] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:30:10.547433 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551143f6-74df-4512-9b81-d80357dba8be service placement] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:30:10.547710 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551143f6-74df-4512-9b81-d80357dba8be service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:30:10.549491 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-551143f6-74df-4512-9b81-d80357dba8be service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:30:10.562133 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551143f6-74df-4512-9b81-d80357dba8be service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:30:10.563733 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551143f6-74df-4512-9b81-d80357dba8be service placement] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:30:10.574748 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1181/2400] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:30:10 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:30:12.568024 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=25 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:30:20.570141 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=32 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:30:22.050188 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7033789-ccb7-4b16-8971-1242e45dc1d4 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:30:22.050704 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7033789-ccb7-4b16-8971-1242e45dc1d4 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:30:22.050808 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7033789-ccb7-4b16-8971-1242e45dc1d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:30:22.072278 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-b7033789-ccb7-4b16-8971-1242e45dc1d4 None None] MFA Rules not processed for user `e4d1160b71a84e2fa44a8ca6edf1846e`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:30:22.073595 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-b7033789-ccb7-4b16-8971-1242e45dc1d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:30:22.170629 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1220/2401] 10.222.0.66 () {58 vars in 1009 bytes} [Mon Sep 19 10:30:22 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:30:22.224920 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551143f6-74df-4512-9b81-d80357dba8be service placement] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:30:22.227503 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-551143f6-74df-4512-9b81-d80357dba8be service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:30:22.328805 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551143f6-74df-4512-9b81-d80357dba8be service placement] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:30:22.333906 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07173436-18c7-4a01-8eef-0a0163b085d3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6677354e36614c9fb3d03413749be5ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:30:22.334818 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07173436-18c7-4a01-8eef-0a0163b085d3 service swift] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:30:22.335714 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07173436-18c7-4a01-8eef-0a0163b085d3 service swift] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:30:22.336078 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07173436-18c7-4a01-8eef-0a0163b085d3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:30:22.349720 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07173436-18c7-4a01-8eef-0a0163b085d3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:30:22.351536 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07173436-18c7-4a01-8eef-0a0163b085d3 service swift] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:30:22.360556 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1182/2402] 10.222.0.66 () {60 vars in 1384 bytes} [Mon Sep 19 10:30:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 19 10:30:32.162018 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=25 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:30:32.356934 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=32 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:30:33.693290 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7033789-ccb7-4b16-8971-1242e45dc1d4 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:30:33.695294 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-b7033789-ccb7-4b16-8971-1242e45dc1d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:30:33.780475 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7033789-ccb7-4b16-8971-1242e45dc1d4 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:30:33.784359 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc5e46c-5350-4393-b71e-b195276a5edd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c1289b015854c6bb6aee8fed6b807db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:30:33.784981 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc5e46c-5350-4393-b71e-b195276a5edd service neutron] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:30:33.785257 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc5e46c-5350-4393-b71e-b195276a5edd service neutron] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:30:33.785577 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc5e46c-5350-4393-b71e-b195276a5edd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:30:33.796249 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc5e46c-5350-4393-b71e-b195276a5edd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:30:33.797716 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc5e46c-5350-4393-b71e-b195276a5edd service neutron] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:30:33.810364 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1221/2403] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:30:33 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:30:43.352408 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8eacd1-8a8a-4117-b331-63d13470cd4e None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:30:43.352937 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8eacd1-8a8a-4117-b331-63d13470cd4e None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:30:43.352937 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8eacd1-8a8a-4117-b331-63d13470cd4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:30:43.373743 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-de8eacd1-8a8a-4117-b331-63d13470cd4e None None] MFA Rules not processed for user `e4d1160b71a84e2fa44a8ca6edf1846e`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:30:43.375172 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-de8eacd1-8a8a-4117-b331-63d13470cd4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:30:43.383971 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1183/2404] 10.222.0.66 () {58 vars in 967 bytes} [Mon Sep 19 10:30:43 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:30:43.399788 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc5e46c-5350-4393-b71e-b195276a5edd service neutron] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:30:43.413402 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc5e46c-5350-4393-b71e-b195276a5edd service neutron] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:30:43.419338 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fe62f0-9380-4d1a-973e-1bf4b539e607 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6677354e36614c9fb3d03413749be5ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:30:43.420334 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fe62f0-9380-4d1a-973e-1bf4b539e607 service swift] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:30:43.420683 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fe62f0-9380-4d1a-973e-1bf4b539e607 service swift] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:30:43.421021 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fe62f0-9380-4d1a-973e-1bf4b539e607 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:30:43.430608 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fe62f0-9380-4d1a-973e-1bf4b539e607 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:30:43.433001 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fe62f0-9380-4d1a-973e-1bf4b539e607 service swift] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:30:43.441174 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1222/2405] 10.222.0.66 () {60 vars in 1384 bytes} [Mon Sep 19 10:30:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 19 10:30:45.435586 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8eacd1-8a8a-4117-b331-63d13470cd4e None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:30:45.437232 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-de8eacd1-8a8a-4117-b331-63d13470cd4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:30:45.520319 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8eacd1-8a8a-4117-b331-63d13470cd4e None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:30:45.525478 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ed158f-9f8f-4911-87d2-24396381f16f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:30:45.526145 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ed158f-9f8f-4911-87d2-24396381f16f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:30:45.526420 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ed158f-9f8f-4911-87d2-24396381f16f admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:30:45.526699 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ed158f-9f8f-4911-87d2-24396381f16f admin admin] PATH_INFO: `/v3/users/0ba6eafda2eb432aa3c7e031743ed2c8` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:30:45.527826 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ed158f-9f8f-4911-87d2-24396381f16f admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ba6eafda2eb432aa3c7e031743ed2c8)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:30:45.529799 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ed158f-9f8f-4911-87d2-24396381f16f admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:30:45.581367 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-74ed158f-9f8f-4911-87d2-24396381f16f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ba6eafda2eb432aa3c7e031743ed2c8'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:30:45.590222 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-74ed158f-9f8f-4911-87d2-24396381f16f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ba6eafda2eb432aa3c7e031743ed2c8'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:30:45.590860 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-74ed158f-9f8f-4911-87d2-24396381f16f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ba6eafda2eb432aa3c7e031743ed2c8'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:30:45.591487 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-74ed158f-9f8f-4911-87d2-24396381f16f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ba6eafda2eb432aa3c7e031743ed2c8'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:30:45.599306 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-74ed158f-9f8f-4911-87d2-24396381f16f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ba6eafda2eb432aa3c7e031743ed2c8'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:30:45.618170 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1184/2406] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 19 10:30:45 2022] DELETE /identity/v3/users/0ba6eafda2eb432aa3c7e031743ed2c8 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:30:45.802752 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fe62f0-9380-4d1a-973e-1bf4b539e607 service swift] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:30:45.813214 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fe62f0-9380-4d1a-973e-1bf4b539e607 service swift] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:30:45.879905 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb011d3-64d1-4b64-8796-3cc4d53f4c94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:30:45.880571 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb011d3-64d1-4b64-8796-3cc4d53f4c94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:30:45.880853 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb011d3-64d1-4b64-8796-3cc4d53f4c94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:30:45.881660 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb011d3-64d1-4b64-8796-3cc4d53f4c94 admin admin] PATH_INFO: `/v3/projects/4ad2ab63f1034b56a3e4eb59883fdec3` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:30:45.883083 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb011d3-64d1-4b64-8796-3cc4d53f4c94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ad2ab63f1034b56a3e4eb59883fdec3)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:30:45.884730 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb011d3-64d1-4b64-8796-3cc4d53f4c94 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:30:45.932940 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-0fb011d3-64d1-4b64-8796-3cc4d53f4c94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ad2ab63f1034b56a3e4eb59883fdec3', 'request_id': 'req-0fb011d3-64d1-4b64-8796-3cc4d53f4c94'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:30:45.939083 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-0fb011d3-64d1-4b64-8796-3cc4d53f4c94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ad2ab63f1034b56a3e4eb59883fdec3', 'request_id': 'req-0fb011d3-64d1-4b64-8796-3cc4d53f4c94'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:30:45.946847 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-0fb011d3-64d1-4b64-8796-3cc4d53f4c94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ad2ab63f1034b56a3e4eb59883fdec3', 'request_id': 'req-0fb011d3-64d1-4b64-8796-3cc4d53f4c94'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:30:45.957324 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-0fb011d3-64d1-4b64-8796-3cc4d53f4c94 admin admin] The token cache is being invalidate because project 4ad2ab63f1034b56a3e4eb59883fdec3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 10:30:45.957610 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-0fb011d3-64d1-4b64-8796-3cc4d53f4c94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:30:45.958238 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-0fb011d3-64d1-4b64-8796-3cc4d53f4c94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:30:45.960485 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1223/2407] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 19 10:30:45 2022] DELETE /identity/v3/projects/4ad2ab63f1034b56a3e4eb59883fdec3 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:30:45.965524 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3f0ff3-5b6d-45cd-82a2-ad42fb7b9c80 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:30:45.965891 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3f0ff3-5b6d-45cd-82a2-ad42fb7b9c80 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:30:45.966195 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3f0ff3-5b6d-45cd-82a2-ad42fb7b9c80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:30:45.985272 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-ef3f0ff3-5b6d-45cd-82a2-ad42fb7b9c80 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:30:45.986464 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-ef3f0ff3-5b6d-45cd-82a2-ad42fb7b9c80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:30:46.043916 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1185/2408] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:30:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:30:46.052015 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec436710-5034-4849-bded-6e04278a5832 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:30:46.052322 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec436710-5034-4849-bded-6e04278a5832 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:30:46.052598 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec436710-5034-4849-bded-6e04278a5832 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:30:46.073229 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-ec436710-5034-4849-bded-6e04278a5832 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:30:46.074429 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-ec436710-5034-4849-bded-6e04278a5832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:30:46.082361 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1224/2409] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:30:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:30:46.087241 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3f0ff3-5b6d-45cd-82a2-ad42fb7b9c80 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:30:46.097039 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3f0ff3-5b6d-45cd-82a2-ad42fb7b9c80 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:30:46.101883 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6219498a-bc8f-4810-8b10-358c797627f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:30:46.102484 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6219498a-bc8f-4810-8b10-358c797627f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:30:46.102766 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6219498a-bc8f-4810-8b10-358c797627f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:30:46.103040 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6219498a-bc8f-4810-8b10-358c797627f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:30:46.103910 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6219498a-bc8f-4810-8b10-358c797627f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:30:46.104329 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6219498a-bc8f-4810-8b10-358c797627f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:30:46.106199 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6219498a-bc8f-4810-8b10-358c797627f9 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:30:46.115087 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:30:46.118909 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1186/2410] 10.222.0.66 () {58 vars in 1153 bytes} [Mon Sep 19 10:30:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:30:46.123304 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec436710-5034-4849-bded-6e04278a5832 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:30:46.133186 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec436710-5034-4849-bded-6e04278a5832 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:30:46.137864 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae9fe24-dcbf-489a-abd5-96f41f79ec86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:30:46.138461 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae9fe24-dcbf-489a-abd5-96f41f79ec86 admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:30:46.138743 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae9fe24-dcbf-489a-abd5-96f41f79ec86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:30:46.139019 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae9fe24-dcbf-489a-abd5-96f41f79ec86 admin admin] PATH_INFO: `/v3/projects` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:30:46.139656 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae9fe24-dcbf-489a-abd5-96f41f79ec86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:30:46.141598 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae9fe24-dcbf-489a-abd5-96f41f79ec86 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:30:46.153431 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:30:46.170670 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1225/2411] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 19 10:30:46 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:30:46.174779 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6219498a-bc8f-4810-8b10-358c797627f9 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:30:46.184866 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6219498a-bc8f-4810-8b10-358c797627f9 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:30:46.239927 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70a89d3-dcf8-4249-87d0-08a54cf14ea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:30:46.241258 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70a89d3-dcf8-4249-87d0-08a54cf14ea1 admin admin] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:30:46.241546 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70a89d3-dcf8-4249-87d0-08a54cf14ea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:30:46.241849 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70a89d3-dcf8-4249-87d0-08a54cf14ea1 admin admin] PATH_INFO: `/v3/users` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:30:46.242455 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70a89d3-dcf8-4249-87d0-08a54cf14ea1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:30:46.244494 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70a89d3-dcf8-4249-87d0-08a54cf14ea1 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:30:46.265706 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1187/2412] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 19 10:30:46 2022] POST /identity/v3/users => generated 287 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:30:46.271006 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae9fe24-dcbf-489a-abd5-96f41f79ec86 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:30:46.281616 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae9fe24-dcbf-489a-abd5-96f41f79ec86 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:30:46.286259 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a8fe44-e274-4bdb-996e-94f6abb46db5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:30:46.286859 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a8fe44-e274-4bdb-996e-94f6abb46db5 admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:30:46.287285 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a8fe44-e274-4bdb-996e-94f6abb46db5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:30:46.287469 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a8fe44-e274-4bdb-996e-94f6abb46db5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:30:46.288101 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a8fe44-e274-4bdb-996e-94f6abb46db5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:30:46.289728 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a8fe44-e274-4bdb-996e-94f6abb46db5 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:30:46.299777 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1226/2413] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:30:46 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 10:30:46.304313 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70a89d3-dcf8-4249-87d0-08a54cf14ea1 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:30:46.314132 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70a89d3-dcf8-4249-87d0-08a54cf14ea1 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:30:46.319944 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c26da3-3ca9-4d37-b71f-b8c365f51c0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:30:46.320554 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c26da3-3ca9-4d37-b71f-b8c365f51c0c admin admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:30:46.320838 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c26da3-3ca9-4d37-b71f-b8c365f51c0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:30:46.321116 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c26da3-3ca9-4d37-b71f-b8c365f51c0c admin admin] PATH_INFO: `/v3/roles` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:30:46.321751 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c26da3-3ca9-4d37-b71f-b8c365f51c0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:30:46.323362 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c26da3-3ca9-4d37-b71f-b8c365f51c0c admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:30:46.333970 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1188/2414] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:30:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 10:30:46.338148 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a8fe44-e274-4bdb-996e-94f6abb46db5 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:30:46.348155 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a8fe44-e274-4bdb-996e-94f6abb46db5 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:30:46.352840 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c023ce-49d5-485b-a1cd-7ac4e2c40ab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:30:46.353487 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c023ce-49d5-485b-a1cd-7ac4e2c40ab9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:30:46.353772 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c023ce-49d5-485b-a1cd-7ac4e2c40ab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:30:46.354050 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c023ce-49d5-485b-a1cd-7ac4e2c40ab9 admin admin] PATH_INFO: `/v3/projects/4e4655e2696d4c5f802844a308e1b417/users/553c61b85a4648808122c7ad497a15cd/roles/cd5b42ed3b754b58817a62bbe74651b4` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:30:46.369243 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c023ce-49d5-485b-a1cd-7ac4e2c40ab9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e4655e2696d4c5f802844a308e1b417, user_id=553c61b85a4648808122c7ad497a15cd, role_id=cd5b42ed3b754b58817a62bbe74651b4)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:30:46.371978 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c023ce-49d5-485b-a1cd-7ac4e2c40ab9 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:30:46.385829 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1227/2415] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 19 10:30:46 2022] PUT /identity/v3/projects/4e4655e2696d4c5f802844a308e1b417/users/553c61b85a4648808122c7ad497a15cd/roles/cd5b42ed3b754b58817a62bbe74651b4 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:30:46.396444 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da2ab07-0de2-4be7-8622-bf6190fbdec8 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:30:46.396754 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da2ab07-0de2-4be7-8622-bf6190fbdec8 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:30:46.397033 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da2ab07-0de2-4be7-8622-bf6190fbdec8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:30:46.424283 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-6da2ab07-0de2-4be7-8622-bf6190fbdec8 None None] MFA Rules not processed for user `553c61b85a4648808122c7ad497a15cd`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:30:46.425506 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-6da2ab07-0de2-4be7-8622-bf6190fbdec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:30:46.488774 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1189/2416] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:30:46 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:30:46.499940 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c023ce-49d5-485b-a1cd-7ac4e2c40ab9 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:30:46.501744 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-04c023ce-49d5-485b-a1cd-7ac4e2c40ab9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:30:46.559635 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c023ce-49d5-485b-a1cd-7ac4e2c40ab9 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:30:46.563247 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f44ac4-4994-49f0-afa3-8d2ffdd55df2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa4d004fd44482cae761c4b3bdfab31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:30:46.563938 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f44ac4-4994-49f0-afa3-8d2ffdd55df2 service cinder] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:30:46.564262 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f44ac4-4994-49f0-afa3-8d2ffdd55df2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:30:46.564538 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f44ac4-4994-49f0-afa3-8d2ffdd55df2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:30:46.573366 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f44ac4-4994-49f0-afa3-8d2ffdd55df2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:30:46.574780 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f44ac4-4994-49f0-afa3-8d2ffdd55df2 service cinder] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:30:46.583482 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1228/2417] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:30:46 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:30:56.485955 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=66,keystone:INSERT=3 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:30:56.579548 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=44,keystone:INSERT=2 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:30:56.783161 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da2ab07-0de2-4be7-8622-bf6190fbdec8 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:30:56.844428 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da2ab07-0de2-4be7-8622-bf6190fbdec8 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:30:56.848968 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555c936e-7507-49a1-92d6-c389a6f8fac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:30:56.849597 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555c936e-7507-49a1-92d6-c389a6f8fac1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:30:56.849888 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555c936e-7507-49a1-92d6-c389a6f8fac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:30:56.850167 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555c936e-7507-49a1-92d6-c389a6f8fac1 admin admin] PATH_INFO: `/v3/users/553c61b85a4648808122c7ad497a15cd` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:30:56.851305 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555c936e-7507-49a1-92d6-c389a6f8fac1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=553c61b85a4648808122c7ad497a15cd)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:30:56.853266 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555c936e-7507-49a1-92d6-c389a6f8fac1 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:30:56.900778 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-555c936e-7507-49a1-92d6-c389a6f8fac1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '553c61b85a4648808122c7ad497a15cd'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:30:56.908449 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-555c936e-7507-49a1-92d6-c389a6f8fac1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '553c61b85a4648808122c7ad497a15cd'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:30:56.909111 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-555c936e-7507-49a1-92d6-c389a6f8fac1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '553c61b85a4648808122c7ad497a15cd'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:30:56.909863 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-555c936e-7507-49a1-92d6-c389a6f8fac1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '553c61b85a4648808122c7ad497a15cd'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:30:56.916978 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-555c936e-7507-49a1-92d6-c389a6f8fac1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '553c61b85a4648808122c7ad497a15cd'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:30:56.934500 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1190/2418] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 19 10:30:56 2022] DELETE /identity/v3/users/553c61b85a4648808122c7ad497a15cd => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:30:56.939167 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3702bc9-0d0b-441e-8e91-554012f63590 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:30:56.939462 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3702bc9-0d0b-441e-8e91-554012f63590 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:30:56.939734 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3702bc9-0d0b-441e-8e91-554012f63590 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:30:56.959108 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-d3702bc9-0d0b-441e-8e91-554012f63590 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:30:56.960520 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-d3702bc9-0d0b-441e-8e91-554012f63590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:30:57.018428 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1229/2419] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:30:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:30:57.028052 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555c936e-7507-49a1-92d6-c389a6f8fac1 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:30:57.029490 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-555c936e-7507-49a1-92d6-c389a6f8fac1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:30:57.086724 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555c936e-7507-49a1-92d6-c389a6f8fac1 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:30:57.090422 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2c9f97-3084-4b8f-b83b-ff7862a5810f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c1289b015854c6bb6aee8fed6b807db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:30:57.091022 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2c9f97-3084-4b8f-b83b-ff7862a5810f service neutron] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:30:57.091302 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2c9f97-3084-4b8f-b83b-ff7862a5810f service neutron] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:30:57.091576 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2c9f97-3084-4b8f-b83b-ff7862a5810f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:30:57.101725 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2c9f97-3084-4b8f-b83b-ff7862a5810f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:30:57.103187 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2c9f97-3084-4b8f-b83b-ff7862a5810f service neutron] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:30:57.113149 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1191/2420] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:30:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:30:57.379630 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3702bc9-0d0b-441e-8e91-554012f63590 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:30:57.381075 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-d3702bc9-0d0b-441e-8e91-554012f63590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:30:57.402571 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3702bc9-0d0b-441e-8e91-554012f63590 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:30:57.407371 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608bfc0d-ebc0-4788-87bc-d60df7c06f01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:30:57.407903 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608bfc0d-ebc0-4788-87bc-d60df7c06f01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:30:57.408252 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608bfc0d-ebc0-4788-87bc-d60df7c06f01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:30:57.408561 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608bfc0d-ebc0-4788-87bc-d60df7c06f01 admin admin] PATH_INFO: `/v3/projects/4e4655e2696d4c5f802844a308e1b417` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:30:57.409611 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608bfc0d-ebc0-4788-87bc-d60df7c06f01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e4655e2696d4c5f802844a308e1b417)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:30:57.411495 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608bfc0d-ebc0-4788-87bc-d60df7c06f01 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:30:57.461311 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-608bfc0d-ebc0-4788-87bc-d60df7c06f01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e4655e2696d4c5f802844a308e1b417', 'request_id': 'req-608bfc0d-ebc0-4788-87bc-d60df7c06f01'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:30:57.470090 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-608bfc0d-ebc0-4788-87bc-d60df7c06f01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e4655e2696d4c5f802844a308e1b417', 'request_id': 'req-608bfc0d-ebc0-4788-87bc-d60df7c06f01'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:30:57.479665 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-608bfc0d-ebc0-4788-87bc-d60df7c06f01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e4655e2696d4c5f802844a308e1b417', 'request_id': 'req-608bfc0d-ebc0-4788-87bc-d60df7c06f01'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:30:57.490674 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-608bfc0d-ebc0-4788-87bc-d60df7c06f01 admin admin] The token cache is being invalidate because project 4e4655e2696d4c5f802844a308e1b417 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 10:30:57.490960 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-608bfc0d-ebc0-4788-87bc-d60df7c06f01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:30:57.491590 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-608bfc0d-ebc0-4788-87bc-d60df7c06f01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:30:57.493112 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1230/2421] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 19 10:30:57 2022] DELETE /identity/v3/projects/4e4655e2696d4c5f802844a308e1b417 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:30:57.498284 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121c3bdc-0c9e-4006-b803-b940d4863c8f None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:30:57.498824 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121c3bdc-0c9e-4006-b803-b940d4863c8f None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:30:57.498824 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121c3bdc-0c9e-4006-b803-b940d4863c8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:30:57.518000 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-121c3bdc-0c9e-4006-b803-b940d4863c8f None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:30:57.519250 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-121c3bdc-0c9e-4006-b803-b940d4863c8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:30:57.536189 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:30:57.581866 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1192/2422] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:30:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:30:57.590244 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a1e40a-ec15-449a-8b39-0c055ef55464 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:30:57.590707 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a1e40a-ec15-449a-8b39-0c055ef55464 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:30:57.590801 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a1e40a-ec15-449a-8b39-0c055ef55464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:30:57.610948 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-05a1e40a-ec15-449a-8b39-0c055ef55464 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:30:57.612176 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-05a1e40a-ec15-449a-8b39-0c055ef55464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:30:57.620083 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1231/2423] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:30:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:30:57.624315 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121c3bdc-0c9e-4006-b803-b940d4863c8f None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:30:57.633913 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121c3bdc-0c9e-4006-b803-b940d4863c8f None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:30:57.638421 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307675af-cb77-4528-a073-8bf833489754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:30:57.639013 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307675af-cb77-4528-a073-8bf833489754 admin admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:30:57.639288 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307675af-cb77-4528-a073-8bf833489754 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:30:57.639563 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307675af-cb77-4528-a073-8bf833489754 admin admin] PATH_INFO: `/v3/domains` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:30:57.640211 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307675af-cb77-4528-a073-8bf833489754 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:30:57.640514 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307675af-cb77-4528-a073-8bf833489754 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:30:57.642104 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307675af-cb77-4528-a073-8bf833489754 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:30:57.654747 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1193/2424] 10.222.0.66 () {58 vars in 1153 bytes} [Mon Sep 19 10:30:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:30:57.659065 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a1e40a-ec15-449a-8b39-0c055ef55464 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:30:57.669147 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a1e40a-ec15-449a-8b39-0c055ef55464 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:30:57.674180 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad9828e-bc2b-4e20-991b-dcabdbdc8b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:30:57.674795 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad9828e-bc2b-4e20-991b-dcabdbdc8b4c admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:30:57.675077 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad9828e-bc2b-4e20-991b-dcabdbdc8b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:30:57.675355 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad9828e-bc2b-4e20-991b-dcabdbdc8b4c admin admin] PATH_INFO: `/v3/projects` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:30:57.676033 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad9828e-bc2b-4e20-991b-dcabdbdc8b4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:30:57.677981 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad9828e-bc2b-4e20-991b-dcabdbdc8b4c admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:30:57.705402 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1232/2425] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 19 10:30:57 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:30:57.710221 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307675af-cb77-4528-a073-8bf833489754 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:30:57.719964 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307675af-cb77-4528-a073-8bf833489754 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:30:57.776024 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba48bf95-08d1-4030-b713-0376616d8718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:30:57.776580 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba48bf95-08d1-4030-b713-0376616d8718 admin admin] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:30:57.776862 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba48bf95-08d1-4030-b713-0376616d8718 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:30:57.777136 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba48bf95-08d1-4030-b713-0376616d8718 admin admin] PATH_INFO: `/v3/users` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:30:57.777760 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba48bf95-08d1-4030-b713-0376616d8718 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:30:57.779678 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba48bf95-08d1-4030-b713-0376616d8718 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:30:57.802004 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1194/2426] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 19 10:30:57 2022] POST /identity/v3/users => generated 293 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:30:57.806195 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad9828e-bc2b-4e20-991b-dcabdbdc8b4c admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:30:57.817289 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad9828e-bc2b-4e20-991b-dcabdbdc8b4c admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:30:57.822081 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4d0165-c0bd-40e3-9ef0-b345687c748e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:30:57.822737 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4d0165-c0bd-40e3-9ef0-b345687c748e admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:30:57.823020 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4d0165-c0bd-40e3-9ef0-b345687c748e admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:30:57.823299 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4d0165-c0bd-40e3-9ef0-b345687c748e admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:30:57.823967 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4d0165-c0bd-40e3-9ef0-b345687c748e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:30:57.825640 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4d0165-c0bd-40e3-9ef0-b345687c748e admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:30:57.836060 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1233/2427] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:30:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 10:30:57.840928 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba48bf95-08d1-4030-b713-0376616d8718 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:30:57.851749 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba48bf95-08d1-4030-b713-0376616d8718 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:30:57.856432 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c489be76-57f2-4d35-9deb-f603e4ffd99e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:30:57.857023 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c489be76-57f2-4d35-9deb-f603e4ffd99e admin admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:30:57.857307 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c489be76-57f2-4d35-9deb-f603e4ffd99e admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:30:57.857596 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c489be76-57f2-4d35-9deb-f603e4ffd99e admin admin] PATH_INFO: `/v3/roles` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:30:57.858218 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c489be76-57f2-4d35-9deb-f603e4ffd99e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:30:57.859817 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c489be76-57f2-4d35-9deb-f603e4ffd99e admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:30:57.870323 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1195/2428] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:30:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 10:30:57.874569 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4d0165-c0bd-40e3-9ef0-b345687c748e admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:30:57.885870 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4d0165-c0bd-40e3-9ef0-b345687c748e admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:30:57.892700 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342c5573-eabc-4102-a455-a6e80baca35f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:30:57.893662 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342c5573-eabc-4102-a455-a6e80baca35f admin admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:30:57.893996 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342c5573-eabc-4102-a455-a6e80baca35f admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:30:57.894319 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342c5573-eabc-4102-a455-a6e80baca35f admin admin] PATH_INFO: `/v3/projects/eebabf8ce54d44cc99526d8396f92ba5/users/de544cb21c79468eabf416c122ef7b0c/roles/cd5b42ed3b754b58817a62bbe74651b4` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:30:57.909922 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342c5573-eabc-4102-a455-a6e80baca35f admin admin] RBAC: Authorizing `identity:create_grant(project_id=eebabf8ce54d44cc99526d8396f92ba5, user_id=de544cb21c79468eabf416c122ef7b0c, role_id=cd5b42ed3b754b58817a62bbe74651b4)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:30:57.912666 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342c5573-eabc-4102-a455-a6e80baca35f admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:30:57.927660 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1234/2429] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 19 10:30:57 2022] PUT /identity/v3/projects/eebabf8ce54d44cc99526d8396f92ba5/users/de544cb21c79468eabf416c122ef7b0c/roles/cd5b42ed3b754b58817a62bbe74651b4 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:30:57.932784 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632983ac-3648-474f-9422-cd056f12d404 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:30:57.933067 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632983ac-3648-474f-9422-cd056f12d404 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:30:57.933341 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632983ac-3648-474f-9422-cd056f12d404 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:30:57.957813 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-632983ac-3648-474f-9422-cd056f12d404 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:30:57.959626 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-632983ac-3648-474f-9422-cd056f12d404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:30:58.017409 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1196/2430] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:30:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 10:30:58.027724 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342c5573-eabc-4102-a455-a6e80baca35f admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:30:58.029403 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-342c5573-eabc-4102-a455-a6e80baca35f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:30:58.051064 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:30:58.088003 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342c5573-eabc-4102-a455-a6e80baca35f admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:30:58.091874 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d7e8af-aa71-4b07-a47d-9f71fc1b25bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c1289b015854c6bb6aee8fed6b807db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:30:58.092520 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d7e8af-aa71-4b07-a47d-9f71fc1b25bf service neutron] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:30:58.092832 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d7e8af-aa71-4b07-a47d-9f71fc1b25bf service neutron] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:30:58.093111 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d7e8af-aa71-4b07-a47d-9f71fc1b25bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:30:58.102159 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d7e8af-aa71-4b07-a47d-9f71fc1b25bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:30:58.103581 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d7e8af-aa71-4b07-a47d-9f71fc1b25bf service neutron] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:30:58.112931 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1235/2431] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:30:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:31:02.018991 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966a9957-6727-49b3-9676-ff81134327b6 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:31:02.019507 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966a9957-6727-49b3-9676-ff81134327b6 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:31:02.019604 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966a9957-6727-49b3-9676-ff81134327b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:31:02.049176 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-966a9957-6727-49b3-9676-ff81134327b6 None None] MFA Rules not processed for user `de544cb21c79468eabf416c122ef7b0c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:31:02.050436 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-966a9957-6727-49b3-9676-ff81134327b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:31:02.070436 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:31:02.120389 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1197/2432] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:31:02 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:31:02.124990 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d7e8af-aa71-4b07-a47d-9f71fc1b25bf service neutron] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:31:02.135137 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d7e8af-aa71-4b07-a47d-9f71fc1b25bf service neutron] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:31:02.142735 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbaef9c-2b17-4bbe-a8f4-6f5ee7851a9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:31:02.143684 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbaef9c-2b17-4bbe-a8f4-6f5ee7851a9b admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:31:02.148258 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbaef9c-2b17-4bbe-a8f4-6f5ee7851a9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:31:02.149024 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbaef9c-2b17-4bbe-a8f4-6f5ee7851a9b admin admin] PATH_INFO: `/v3/projects` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:31:02.150128 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbaef9c-2b17-4bbe-a8f4-6f5ee7851a9b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:31:02.152152 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbaef9c-2b17-4bbe-a8f4-6f5ee7851a9b admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:31:02.182140 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1236/2433] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 19 10:31:02 2022] POST /identity/v3/projects => generated 385 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:31:02.186375 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966a9957-6727-49b3-9676-ff81134327b6 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:31:02.202383 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966a9957-6727-49b3-9676-ff81134327b6 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:31:02.265712 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3781694b-888f-425d-85ef-85efd39b6204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:31:02.266236 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3781694b-888f-425d-85ef-85efd39b6204 admin admin] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:31:02.266520 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3781694b-888f-425d-85ef-85efd39b6204 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:31:02.266797 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3781694b-888f-425d-85ef-85efd39b6204 admin admin] PATH_INFO: `/v3/users` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:31:02.267432 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3781694b-888f-425d-85ef-85efd39b6204 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:31:02.269503 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3781694b-888f-425d-85ef-85efd39b6204 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:31:02.293636 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1198/2434] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 19 10:31:02 2022] POST /identity/v3/users => generated 299 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:31:02.298171 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbaef9c-2b17-4bbe-a8f4-6f5ee7851a9b admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:31:02.309786 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbaef9c-2b17-4bbe-a8f4-6f5ee7851a9b admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:31:02.314487 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b35c3ea-0a86-4837-8626-ffccb90cadec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:31:02.315093 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b35c3ea-0a86-4837-8626-ffccb90cadec admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:31:02.315372 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b35c3ea-0a86-4837-8626-ffccb90cadec admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:31:02.315651 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b35c3ea-0a86-4837-8626-ffccb90cadec admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:31:02.316324 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b35c3ea-0a86-4837-8626-ffccb90cadec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:31:02.317978 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b35c3ea-0a86-4837-8626-ffccb90cadec admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:31:02.329336 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1237/2435] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:31:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 10:31:02.333906 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3781694b-888f-425d-85ef-85efd39b6204 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:31:02.349631 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3781694b-888f-425d-85ef-85efd39b6204 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:31:02.355964 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0804475-b992-46ce-8965-bb6d3dd40356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:31:02.355964 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0804475-b992-46ce-8965-bb6d3dd40356 admin admin] REQUEST_METHOD: `PUT` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:31:02.356350 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0804475-b992-46ce-8965-bb6d3dd40356 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:31:02.357597 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0804475-b992-46ce-8965-bb6d3dd40356 admin admin] PATH_INFO: `/v3/projects/dab09be80f904f888bcf7deb0acb971f/users/8b6a4194b3e34809bcea8a2eac7ac1ed/roles/5c8b89fae4fa45bd944cbeaf442136e1` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:31:02.385995 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0804475-b992-46ce-8965-bb6d3dd40356 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dab09be80f904f888bcf7deb0acb971f, user_id=8b6a4194b3e34809bcea8a2eac7ac1ed, role_id=5c8b89fae4fa45bd944cbeaf442136e1)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:31:02.388704 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0804475-b992-46ce-8965-bb6d3dd40356 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:31:02.409141 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1199/2436] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 19 10:31:02 2022] PUT /identity/v3/projects/dab09be80f904f888bcf7deb0acb971f/users/8b6a4194b3e34809bcea8a2eac7ac1ed/roles/5c8b89fae4fa45bd944cbeaf442136e1 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:31:02.413168 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b35c3ea-0a86-4837-8626-ffccb90cadec admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:31:02.423977 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b35c3ea-0a86-4837-8626-ffccb90cadec admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:31:02.488729 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19633655-1bdf-4937-8533-b18620cee544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:31:02.489356 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19633655-1bdf-4937-8533-b18620cee544 admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:31:02.489657 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19633655-1bdf-4937-8533-b18620cee544 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:31:02.489954 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19633655-1bdf-4937-8533-b18620cee544 admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:31:02.490610 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19633655-1bdf-4937-8533-b18620cee544 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:31:02.492299 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19633655-1bdf-4937-8533-b18620cee544 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:31:02.502871 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1238/2437] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:31:02 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 10:31:02.507515 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0804475-b992-46ce-8965-bb6d3dd40356 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:31:02.518508 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0804475-b992-46ce-8965-bb6d3dd40356 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:31:02.524012 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a815b947-ba0b-4987-a811-11604b891de4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:31:02.524763 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a815b947-ba0b-4987-a811-11604b891de4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:31:02.525046 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a815b947-ba0b-4987-a811-11604b891de4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:31:02.525324 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a815b947-ba0b-4987-a811-11604b891de4 admin admin] PATH_INFO: `/v3/projects/dab09be80f904f888bcf7deb0acb971f/users/8b6a4194b3e34809bcea8a2eac7ac1ed/roles/5c8b89fae4fa45bd944cbeaf442136e1` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:31:02.527302 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a815b947-ba0b-4987-a811-11604b891de4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dab09be80f904f888bcf7deb0acb971f, user_id=8b6a4194b3e34809bcea8a2eac7ac1ed, role_id=5c8b89fae4fa45bd944cbeaf442136e1)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:31:02.529999 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a815b947-ba0b-4987-a811-11604b891de4 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:31:02.541746 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1200/2438] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 19 10:31:02 2022] PUT /identity/v3/projects/dab09be80f904f888bcf7deb0acb971f/users/8b6a4194b3e34809bcea8a2eac7ac1ed/roles/5c8b89fae4fa45bd944cbeaf442136e1 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:31:06.985181 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3092a5b-a18e-45e6-8fa9-0551b455a972 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:31:06.985652 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3092a5b-a18e-45e6-8fa9-0551b455a972 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:31:06.985783 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3092a5b-a18e-45e6-8fa9-0551b455a972 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:31:07.014872 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-a3092a5b-a18e-45e6-8fa9-0551b455a972 None None] MFA Rules not processed for user `8b6a4194b3e34809bcea8a2eac7ac1ed`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:31:07.016288 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-a3092a5b-a18e-45e6-8fa9-0551b455a972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:31:07.090180 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1239/2439] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:31:06 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:31:07.108075 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a815b947-ba0b-4987-a811-11604b891de4 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:31:07.109844 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-a815b947-ba0b-4987-a811-11604b891de4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:31:07.204547 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a815b947-ba0b-4987-a811-11604b891de4 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:31:07.208857 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ed91fd-2897-4968-9e9f-c2f7abeb83aa service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f95c0d9f2414f3ca2fa2d1546d47f1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:31:07.209513 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ed91fd-2897-4968-9e9f-c2f7abeb83aa service glance] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:31:07.209793 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ed91fd-2897-4968-9e9f-c2f7abeb83aa service glance] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:31:07.210065 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ed91fd-2897-4968-9e9f-c2f7abeb83aa service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:31:07.240956 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:31:07.303317 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ed91fd-2897-4968-9e9f-c2f7abeb83aa service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:31:07.304863 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ed91fd-2897-4968-9e9f-c2f7abeb83aa service glance] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:31:07.315384 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1201/2440] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:31:07 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:31:07.506290 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d9f5fd-7812-476b-9589-7df353367ccf None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:31:07.506475 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d9f5fd-7812-476b-9589-7df353367ccf None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:31:07.506787 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d9f5fd-7812-476b-9589-7df353367ccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:31:07.535274 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-d6d9f5fd-7812-476b-9589-7df353367ccf None None] MFA Rules not processed for user `e4d1160b71a84e2fa44a8ca6edf1846e`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:31:07.538246 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-d6d9f5fd-7812-476b-9589-7df353367ccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:31:07.553482 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:31:07.623443 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1240/2441] 10.222.0.66 () {58 vars in 1009 bytes} [Mon Sep 19 10:31:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:31:07.638341 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ed91fd-2897-4968-9e9f-c2f7abeb83aa service glance] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:31:07.639920 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-66ed91fd-2897-4968-9e9f-c2f7abeb83aa service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:31:07.730956 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ed91fd-2897-4968-9e9f-c2f7abeb83aa service glance] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:31:07.740427 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbd4224-c802-4567-ada2-444fe5f16987 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6677354e36614c9fb3d03413749be5ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:31:07.741066 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbd4224-c802-4567-ada2-444fe5f16987 service swift] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:31:07.741364 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbd4224-c802-4567-ada2-444fe5f16987 service swift] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:31:07.741629 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbd4224-c802-4567-ada2-444fe5f16987 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:31:07.750915 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbd4224-c802-4567-ada2-444fe5f16987 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:31:07.752768 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbd4224-c802-4567-ada2-444fe5f16987 service swift] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:31:07.762669 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1202/2442] 10.222.0.66 () {60 vars in 1384 bytes} [Mon Sep 19 10:31:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 19 10:31:16.607247 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08515e3-9074-4652-9e6f-c9d8e8a32fe2 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:31:16.607782 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08515e3-9074-4652-9e6f-c9d8e8a32fe2 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:31:16.607958 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08515e3-9074-4652-9e6f-c9d8e8a32fe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:31:16.629181 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-b08515e3-9074-4652-9e6f-c9d8e8a32fe2 None None] MFA Rules not processed for user `de544cb21c79468eabf416c122ef7b0c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:31:16.630489 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-b08515e3-9074-4652-9e6f-c9d8e8a32fe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:31:16.640199 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1241/2443] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:31:16 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:31:17.758687 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=48 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:31:20.509394 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe740b1a-8d9f-4666-8c8e-703e39008378 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:31:20.509972 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe740b1a-8d9f-4666-8c8e-703e39008378 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:31:20.509972 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe740b1a-8d9f-4666-8c8e-703e39008378 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:31:20.540835 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-fe740b1a-8d9f-4666-8c8e-703e39008378 None None] MFA Rules not processed for user `e4d1160b71a84e2fa44a8ca6edf1846e`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:31:20.542180 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-fe740b1a-8d9f-4666-8c8e-703e39008378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:31:20.550292 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1203/2444] 10.222.0.66 () {58 vars in 1009 bytes} [Mon Sep 19 10:31:20 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:31:20.562319 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08515e3-9074-4652-9e6f-c9d8e8a32fe2 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:31:20.574826 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08515e3-9074-4652-9e6f-c9d8e8a32fe2 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:31:20.580084 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5348e150-35b7-4c66-8d50-58675e4c8bb8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6677354e36614c9fb3d03413749be5ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:31:20.580729 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5348e150-35b7-4c66-8d50-58675e4c8bb8 service swift] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:31:20.581005 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5348e150-35b7-4c66-8d50-58675e4c8bb8 service swift] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:31:20.581289 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5348e150-35b7-4c66-8d50-58675e4c8bb8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:31:20.590183 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5348e150-35b7-4c66-8d50-58675e4c8bb8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:31:20.591734 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5348e150-35b7-4c66-8d50-58675e4c8bb8 service swift] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:31:20.600077 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1242/2445] 10.222.0.66 () {60 vars in 1384 bytes} [Mon Sep 19 10:31:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 19 10:31:30.526783 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=3 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:31:30.596579 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=29 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:31:53.058394 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15979e9-e027-4ef2-a8a3-2974e58349d0 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:31:53.059224 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15979e9-e027-4ef2-a8a3-2974e58349d0 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:31:53.059501 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15979e9-e027-4ef2-a8a3-2974e58349d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:31:53.079561 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-a15979e9-e027-4ef2-a8a3-2974e58349d0 None None] MFA Rules not processed for user `f66555915f3b46f0a687df2a69fc7eee`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:31:53.080805 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-a15979e9-e027-4ef2-a8a3-2974e58349d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:31:53.137954 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1204/2446] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:31:53 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:31:54.516086 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5348e150-35b7-4c66-8d50-58675e4c8bb8 service swift] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:31:54.517611 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-5348e150-35b7-4c66-8d50-58675e4c8bb8 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:31:54.578419 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5348e150-35b7-4c66-8d50-58675e4c8bb8 service swift] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:31:54.582348 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7646efdf-38ee-4396-9dd4-84d4c5e5dfc1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c1289b015854c6bb6aee8fed6b807db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:31:54.582970 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7646efdf-38ee-4396-9dd4-84d4c5e5dfc1 service neutron] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:31:54.583254 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7646efdf-38ee-4396-9dd4-84d4c5e5dfc1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:31:54.583529 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7646efdf-38ee-4396-9dd4-84d4c5e5dfc1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:31:54.593350 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7646efdf-38ee-4396-9dd4-84d4c5e5dfc1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:31:54.594916 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7646efdf-38ee-4396-9dd4-84d4c5e5dfc1 service neutron] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:31:54.605582 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1243/2447] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:31:54 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:32:03.130512 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=25 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:32:04.600582 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=26 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:32:09.007681 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15979e9-e027-4ef2-a8a3-2974e58349d0 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:32:09.017684 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15979e9-e027-4ef2-a8a3-2974e58349d0 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:32:09.021228 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203561de-fd6d-4bd1-a414-04f729d51d8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c1289b015854c6bb6aee8fed6b807db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:32:09.021837 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203561de-fd6d-4bd1-a414-04f729d51d8e service neutron] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:32:09.022666 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203561de-fd6d-4bd1-a414-04f729d51d8e service neutron] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:32:09.022940 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203561de-fd6d-4bd1-a414-04f729d51d8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:32:09.024753 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-203561de-fd6d-4bd1-a414-04f729d51d8e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:32:09.100310 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203561de-fd6d-4bd1-a414-04f729d51d8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:32:09.101748 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203561de-fd6d-4bd1-a414-04f729d51d8e service neutron] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:32:09.112853 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1205/2448] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:32:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:32:10.241869 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7646efdf-38ee-4396-9dd4-84d4c5e5dfc1 service neutron] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:32:10.250593 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7646efdf-38ee-4396-9dd4-84d4c5e5dfc1 service neutron] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:32:10.254240 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4d44f1-5d5c-4b7b-91cd-da1a1c418531 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c1289b015854c6bb6aee8fed6b807db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:32:10.254933 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4d44f1-5d5c-4b7b-91cd-da1a1c418531 service neutron] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:32:10.255249 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4d44f1-5d5c-4b7b-91cd-da1a1c418531 service neutron] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:32:10.255486 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4d44f1-5d5c-4b7b-91cd-da1a1c418531 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:32:10.257554 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-1e4d44f1-5d5c-4b7b-91cd-da1a1c418531 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:32:10.270899 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4d44f1-5d5c-4b7b-91cd-da1a1c418531 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:32:10.272862 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4d44f1-5d5c-4b7b-91cd-da1a1c418531 service neutron] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:32:10.283515 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1244/2449] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:32:10 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:32:16.304322 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6338ae30-88b0-43ba-a511-d6b0d753e50e None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:32:16.304864 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6338ae30-88b0-43ba-a511-d6b0d753e50e None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:32:16.304978 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6338ae30-88b0-43ba-a511-d6b0d753e50e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:32:16.323572 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-6338ae30-88b0-43ba-a511-d6b0d753e50e None None] MFA Rules not processed for user `e62a6e400ad7425f9217164bc9190a21`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:32:16.324793 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-6338ae30-88b0-43ba-a511-d6b0d753e50e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:32:16.378955 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1206/2450] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:32:16 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:32:20.278726 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=6 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:32:26.372395 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=59 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:32:51.218940 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4d44f1-5d5c-4b7b-91cd-da1a1c418531 service neutron] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:32:51.227992 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4d44f1-5d5c-4b7b-91cd-da1a1c418531 service neutron] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:32:51.231392 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4785b5fe-bf02-4c34-9fb0-08dd9b20d469 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c1289b015854c6bb6aee8fed6b807db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:32:51.231996 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4785b5fe-bf02-4c34-9fb0-08dd9b20d469 service neutron] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:32:51.232313 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4785b5fe-bf02-4c34-9fb0-08dd9b20d469 service neutron] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:32:51.232592 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4785b5fe-bf02-4c34-9fb0-08dd9b20d469 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:32:51.234295 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-4785b5fe-bf02-4c34-9fb0-08dd9b20d469 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:32:51.243949 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4785b5fe-bf02-4c34-9fb0-08dd9b20d469 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:32:51.245421 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4785b5fe-bf02-4c34-9fb0-08dd9b20d469 service neutron] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:32:51.253285 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1245/2451] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:32:51 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:32:57.810846 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6338ae30-88b0-43ba-a511-d6b0d753e50e None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:32:57.812303 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-6338ae30-88b0-43ba-a511-d6b0d753e50e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:32:57.868555 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6338ae30-88b0-43ba-a511-d6b0d753e50e None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:32:57.872108 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc9b391-2fdb-4766-a342-2018dd5a64e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa4d004fd44482cae761c4b3bdfab31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:32:57.872740 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc9b391-2fdb-4766-a342-2018dd5a64e5 service cinder] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:32:57.873024 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc9b391-2fdb-4766-a342-2018dd5a64e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:32:57.873302 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc9b391-2fdb-4766-a342-2018dd5a64e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:32:57.875023 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-1bc9b391-2fdb-4766-a342-2018dd5a64e5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:32:57.936579 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc9b391-2fdb-4766-a342-2018dd5a64e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:32:57.938028 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc9b391-2fdb-4766-a342-2018dd5a64e5 service cinder] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:32:57.946923 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1207/2452] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:32:57 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:33:01.249727 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=6 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:33:03.238396 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4785b5fe-bf02-4c34-9fb0-08dd9b20d469 service neutron] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:33:03.239761 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-4785b5fe-bf02-4c34-9fb0-08dd9b20d469 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:33:03.259852 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4785b5fe-bf02-4c34-9fb0-08dd9b20d469 service neutron] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:33:03.266027 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e9bd59-3b33-4c66-b81c-3b3644607cf2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15c70bfb085a44e9b84942b480ff22f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:33:03.266666 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e9bd59-3b33-4c66-b81c-3b3644607cf2 service nova] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:33:03.266952 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e9bd59-3b33-4c66-b81c-3b3644607cf2 service nova] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:33:03.267252 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e9bd59-3b33-4c66-b81c-3b3644607cf2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:33:03.274685 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-b3e9bd59-3b33-4c66-b81c-3b3644607cf2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:33:03.290990 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e9bd59-3b33-4c66-b81c-3b3644607cf2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:33:03.292830 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e9bd59-3b33-4c66-b81c-3b3644607cf2 service nova] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:33:03.316394 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1246/2453] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:33:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:33:06.097470 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc9b391-2fdb-4766-a342-2018dd5a64e5 service cinder] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:33:06.099459 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-1bc9b391-2fdb-4766-a342-2018dd5a64e5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:33:06.116994 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc9b391-2fdb-4766-a342-2018dd5a64e5 service cinder] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:33:06.122653 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faedc6ac-c668-416d-8a89-3a55cb3c3b0c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15c70bfb085a44e9b84942b480ff22f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:33:06.123269 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faedc6ac-c668-416d-8a89-3a55cb3c3b0c service nova] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:33:06.123557 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faedc6ac-c668-416d-8a89-3a55cb3c3b0c service nova] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:33:06.123902 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faedc6ac-c668-416d-8a89-3a55cb3c3b0c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:33:06.125596 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-faedc6ac-c668-416d-8a89-3a55cb3c3b0c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:33:06.137049 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faedc6ac-c668-416d-8a89-3a55cb3c3b0c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:33:06.138648 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faedc6ac-c668-416d-8a89-3a55cb3c3b0c service nova] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:33:06.148753 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1208/2454] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:33:06 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:33:07.066883 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d37920-bad9-4af6-bd2f-1c0fda3c2c3d None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:33:07.067429 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d37920-bad9-4af6-bd2f-1c0fda3c2c3d None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:33:07.067429 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d37920-bad9-4af6-bd2f-1c0fda3c2c3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:33:07.087444 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-95d37920-bad9-4af6-bd2f-1c0fda3c2c3d None None] MFA Rules not processed for user `d37107a7553248409c6cd63406c3ddef`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:33:07.088597 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-95d37920-bad9-4af6-bd2f-1c0fda3c2c3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:33:07.095428 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1247/2455] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:33:07 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:33:07.400666 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faedc6ac-c668-416d-8a89-3a55cb3c3b0c service nova] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:33:07.410891 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faedc6ac-c668-416d-8a89-3a55cb3c3b0c service nova] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:33:07.415038 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa5714f-ff54-48cd-b3cd-d1e20d335a0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c1289b015854c6bb6aee8fed6b807db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:33:07.415635 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa5714f-ff54-48cd-b3cd-d1e20d335a0d service neutron] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:33:07.415917 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa5714f-ff54-48cd-b3cd-d1e20d335a0d service neutron] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:33:07.416223 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa5714f-ff54-48cd-b3cd-d1e20d335a0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:33:07.417942 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-2fa5714f-ff54-48cd-b3cd-d1e20d335a0d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:33:07.427655 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa5714f-ff54-48cd-b3cd-d1e20d335a0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:33:07.429219 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa5714f-ff54-48cd-b3cd-d1e20d335a0d service neutron] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:33:07.437013 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1209/2456] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:33:07 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:33:07.763339 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d37920-bad9-4af6-bd2f-1c0fda3c2c3d None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:33:07.764922 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-95d37920-bad9-4af6-bd2f-1c0fda3c2c3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:33:07.854555 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d37920-bad9-4af6-bd2f-1c0fda3c2c3d None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:33:07.861515 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a758943-687e-42db-8828-0ca86c7f9548 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46b78120cac64f09bd0f4cdc42424163', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:33:07.862233 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a758943-687e-42db-8828-0ca86c7f9548 service placement] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:33:07.862587 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a758943-687e-42db-8828-0ca86c7f9548 service placement] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:33:07.862931 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a758943-687e-42db-8828-0ca86c7f9548 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:33:07.865193 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-7a758943-687e-42db-8828-0ca86c7f9548 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:33:07.880534 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a758943-687e-42db-8828-0ca86c7f9548 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:33:07.883030 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a758943-687e-42db-8828-0ca86c7f9548 service placement] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:33:07.895450 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1248/2457] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:33:07 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:33:12.213989 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa5714f-ff54-48cd-b3cd-d1e20d335a0d service neutron] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:33:12.216009 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-2fa5714f-ff54-48cd-b3cd-d1e20d335a0d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:33:12.229684 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa5714f-ff54-48cd-b3cd-d1e20d335a0d service neutron] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:33:12.233049 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f1b795-a030-4638-939d-47e0cd2eb789 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa4d004fd44482cae761c4b3bdfab31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:33:12.233820 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f1b795-a030-4638-939d-47e0cd2eb789 service cinder] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:33:12.234202 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f1b795-a030-4638-939d-47e0cd2eb789 service cinder] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:33:12.234570 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f1b795-a030-4638-939d-47e0cd2eb789 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:33:12.236563 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-90f1b795-a030-4638-939d-47e0cd2eb789 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:33:12.259063 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f1b795-a030-4638-939d-47e0cd2eb789 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:33:12.260582 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f1b795-a030-4638-939d-47e0cd2eb789 service cinder] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:33:12.270221 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1210/2458] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:33:12 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:33:17.890154 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=41 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:33:22.265638 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=66 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:33:28.449635 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a758943-687e-42db-8828-0ca86c7f9548 service placement] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:33:28.464817 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a758943-687e-42db-8828-0ca86c7f9548 service placement] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:33:28.472420 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736416de-80fd-4ed0-84a7-29af7c06f86b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15c70bfb085a44e9b84942b480ff22f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:33:28.473301 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736416de-80fd-4ed0-84a7-29af7c06f86b service nova] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:33:28.474371 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736416de-80fd-4ed0-84a7-29af7c06f86b service nova] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:33:28.474839 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736416de-80fd-4ed0-84a7-29af7c06f86b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:33:28.476873 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-736416de-80fd-4ed0-84a7-29af7c06f86b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:33:28.492820 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736416de-80fd-4ed0-84a7-29af7c06f86b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:33:28.495074 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736416de-80fd-4ed0-84a7-29af7c06f86b service nova] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:33:28.513078 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1249/2459] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:33:28 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:33:29.321936 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db63f277-7645-47a1-96e1-3f498011d961 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:33:29.322399 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db63f277-7645-47a1-96e1-3f498011d961 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:33:29.322494 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db63f277-7645-47a1-96e1-3f498011d961 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:33:29.343262 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-db63f277-7645-47a1-96e1-3f498011d961 None None] MFA Rules not processed for user `f66555915f3b46f0a687df2a69fc7eee`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:33:29.344782 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-db63f277-7645-47a1-96e1-3f498011d961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:33:29.351446 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1211/2460] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:33:29 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:33:33.871666 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736416de-80fd-4ed0-84a7-29af7c06f86b service nova] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:33:33.886704 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736416de-80fd-4ed0-84a7-29af7c06f86b service nova] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:33:33.893449 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb07e53-cb79-446a-b369-3547f404508b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15c70bfb085a44e9b84942b480ff22f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:33:33.894063 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb07e53-cb79-446a-b369-3547f404508b service nova] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:33:33.894502 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb07e53-cb79-446a-b369-3547f404508b service nova] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:33:33.894781 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb07e53-cb79-446a-b369-3547f404508b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:33:33.897442 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-4eb07e53-cb79-446a-b369-3547f404508b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:33:33.912295 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb07e53-cb79-446a-b369-3547f404508b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:33:33.916522 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb07e53-cb79-446a-b369-3547f404508b service nova] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:33:33.928953 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1250/2461] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:33:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:33:36.686377 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db63f277-7645-47a1-96e1-3f498011d961 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:33:36.699658 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db63f277-7645-47a1-96e1-3f498011d961 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:33:36.704109 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b00c218-cbe9-4781-a790-859faaa577ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c1289b015854c6bb6aee8fed6b807db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:33:36.704730 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b00c218-cbe9-4781-a790-859faaa577ec service neutron] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:33:36.705072 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b00c218-cbe9-4781-a790-859faaa577ec service neutron] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:33:36.705351 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b00c218-cbe9-4781-a790-859faaa577ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:33:36.707706 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-2b00c218-cbe9-4781-a790-859faaa577ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:33:36.718366 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b00c218-cbe9-4781-a790-859faaa577ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:33:36.719956 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b00c218-cbe9-4781-a790-859faaa577ec service neutron] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:33:36.732473 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1212/2462] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:33:36 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:33:37.904936 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53105e0-48cc-4194-95aa-ed95ce4621b9 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:33:37.905518 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53105e0-48cc-4194-95aa-ed95ce4621b9 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:33:37.905826 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53105e0-48cc-4194-95aa-ed95ce4621b9 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:33:37.907357 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1251/2463] 10.222.0.66 () {54 vars in 921 bytes} [Mon Sep 19 10:33:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:33:37.913469 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21df5ea0-4772-40d2-a1a9-a8fe44056bc4 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:33:37.913983 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21df5ea0-4772-40d2-a1a9-a8fe44056bc4 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:33:37.914102 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21df5ea0-4772-40d2-a1a9-a8fe44056bc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:33:37.937395 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-21df5ea0-4772-40d2-a1a9-a8fe44056bc4 None None] MFA Rules not processed for user `0c1289b015854c6bb6aee8fed6b807db`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:33:37.938736 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-21df5ea0-4772-40d2-a1a9-a8fe44056bc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:33:37.945883 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1213/2464] 10.222.0.66 () {58 vars in 1018 bytes} [Mon Sep 19 10:33:37 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:33:37.959056 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53105e0-48cc-4194-95aa-ed95ce4621b9 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:33:37.971149 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53105e0-48cc-4194-95aa-ed95ce4621b9 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:33:37.975724 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78541e21-01c2-4612-a7d1-47daca03a800 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c1289b015854c6bb6aee8fed6b807db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:33:37.976508 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78541e21-01c2-4612-a7d1-47daca03a800 service neutron] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:33:37.976929 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78541e21-01c2-4612-a7d1-47daca03a800 service neutron] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:33:37.977303 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78541e21-01c2-4612-a7d1-47daca03a800 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:33:37.985888 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78541e21-01c2-4612-a7d1-47daca03a800 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:33:37.992495 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78541e21-01c2-4612-a7d1-47daca03a800 service neutron] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:33:38.006141 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1252/2465] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:33:37 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 10:33:38.119659 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e18991-fa0c-4c25-8801-593039e6dd3c None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:33:38.120249 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e18991-fa0c-4c25-8801-593039e6dd3c None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:33:38.120624 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e18991-fa0c-4c25-8801-593039e6dd3c None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:33:38.122374 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1214/2466] 10.222.0.66 () {54 vars in 921 bytes} [Mon Sep 19 10:33:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:33:38.131370 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bea797f-3434-4227-a13a-b8b0c2c35815 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:33:38.131753 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bea797f-3434-4227-a13a-b8b0c2c35815 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:33:38.132127 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bea797f-3434-4227-a13a-b8b0c2c35815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:33:38.168578 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-9bea797f-3434-4227-a13a-b8b0c2c35815 None None] MFA Rules not processed for user `15c70bfb085a44e9b84942b480ff22f1`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:33:38.171076 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-9bea797f-3434-4227-a13a-b8b0c2c35815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:33:38.183032 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1253/2467] 10.222.0.66 () {58 vars in 1018 bytes} [Mon Sep 19 10:33:38 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:33:38.194959 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e18991-fa0c-4c25-8801-593039e6dd3c None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:33:38.206503 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e18991-fa0c-4c25-8801-593039e6dd3c None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:33:38.210676 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e980480a-1069-40c0-bb6e-00a98933362a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c1289b015854c6bb6aee8fed6b807db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:33:38.211577 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e980480a-1069-40c0-bb6e-00a98933362a service neutron] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:33:38.212071 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e980480a-1069-40c0-bb6e-00a98933362a service neutron] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:33:38.212610 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e980480a-1069-40c0-bb6e-00a98933362a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:33:38.223977 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e980480a-1069-40c0-bb6e-00a98933362a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:33:38.225577 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e980480a-1069-40c0-bb6e-00a98933362a service neutron] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:33:38.237322 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1215/2468] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:33:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:33:47.753556 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bea797f-3434-4227-a13a-b8b0c2c35815 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:33:47.766316 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bea797f-3434-4227-a13a-b8b0c2c35815 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:33:47.770999 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9da4e6-6622-4947-be4f-5ee08f3ca088 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c1289b015854c6bb6aee8fed6b807db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:33:47.771730 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9da4e6-6622-4947-be4f-5ee08f3ca088 service neutron] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:33:47.772116 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9da4e6-6622-4947-be4f-5ee08f3ca088 service neutron] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:33:47.772527 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9da4e6-6622-4947-be4f-5ee08f3ca088 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:33:47.775065 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-fe9da4e6-6622-4947-be4f-5ee08f3ca088 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:33:47.842699 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9da4e6-6622-4947-be4f-5ee08f3ca088 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:33:47.844251 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9da4e6-6622-4947-be4f-5ee08f3ca088 service neutron] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:33:47.855024 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1254/2469] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:33:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:33:48.232271 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=18 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:33:51.181033 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e980480a-1069-40c0-bb6e-00a98933362a service neutron] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:33:51.182490 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-e980480a-1069-40c0-bb6e-00a98933362a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:33:51.202229 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e980480a-1069-40c0-bb6e-00a98933362a service neutron] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:33:51.232060 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4224f1b-c844-428b-80b9-d9d69cf7313d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46b78120cac64f09bd0f4cdc42424163', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:33:51.239719 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4224f1b-c844-428b-80b9-d9d69cf7313d service placement] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:33:51.240006 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4224f1b-c844-428b-80b9-d9d69cf7313d service placement] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:33:51.240358 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4224f1b-c844-428b-80b9-d9d69cf7313d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:33:51.245291 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-c4224f1b-c844-428b-80b9-d9d69cf7313d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:33:51.268463 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4224f1b-c844-428b-80b9-d9d69cf7313d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:33:51.272743 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4224f1b-c844-428b-80b9-d9d69cf7313d service placement] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:33:51.287505 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1216/2470] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:33:51 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:33:51.294900 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9da4e6-6622-4947-be4f-5ee08f3ca088 service neutron] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:33:51.298424 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-fe9da4e6-6622-4947-be4f-5ee08f3ca088 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:33:51.310702 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9da4e6-6622-4947-be4f-5ee08f3ca088 service neutron] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:33:51.315962 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e53512-edd4-4930-bc72-5e0c23a6b985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:33:51.317296 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e53512-edd4-4930-bc72-5e0c23a6b985 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:33:51.317729 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e53512-edd4-4930-bc72-5e0c23a6b985 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:33:51.318087 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e53512-edd4-4930-bc72-5e0c23a6b985 admin admin] PATH_INFO: `/v3/users/e62a6e400ad7425f9217164bc9190a21` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:33:51.319482 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e53512-edd4-4930-bc72-5e0c23a6b985 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e62a6e400ad7425f9217164bc9190a21)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:33:51.326391 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e53512-edd4-4930-bc72-5e0c23a6b985 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:33:51.386528 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-16e53512-edd4-4930-bc72-5e0c23a6b985 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e62a6e400ad7425f9217164bc9190a21'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:33:51.397763 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-16e53512-edd4-4930-bc72-5e0c23a6b985 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e62a6e400ad7425f9217164bc9190a21'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:33:51.399105 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-16e53512-edd4-4930-bc72-5e0c23a6b985 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e62a6e400ad7425f9217164bc9190a21'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:33:51.400454 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-16e53512-edd4-4930-bc72-5e0c23a6b985 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e62a6e400ad7425f9217164bc9190a21'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:33:51.409188 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-16e53512-edd4-4930-bc72-5e0c23a6b985 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e62a6e400ad7425f9217164bc9190a21'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:33:51.437386 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1255/2471] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 19 10:33:51 2022] DELETE /identity/v3/users/e62a6e400ad7425f9217164bc9190a21 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:33:51.635835 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4224f1b-c844-428b-80b9-d9d69cf7313d service placement] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:33:51.647694 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4224f1b-c844-428b-80b9-d9d69cf7313d service placement] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:33:51.704618 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679d43cc-01c2-4721-8091-e7b5d50bf233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:33:51.705251 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679d43cc-01c2-4721-8091-e7b5d50bf233 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:33:51.705532 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679d43cc-01c2-4721-8091-e7b5d50bf233 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:33:51.705803 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679d43cc-01c2-4721-8091-e7b5d50bf233 admin admin] PATH_INFO: `/v3/projects/2e33eb747357460eb0ad450ad46ca7bb` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:33:51.706903 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679d43cc-01c2-4721-8091-e7b5d50bf233 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e33eb747357460eb0ad450ad46ca7bb)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:33:51.709355 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679d43cc-01c2-4721-8091-e7b5d50bf233 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:33:51.756417 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-679d43cc-01c2-4721-8091-e7b5d50bf233 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e33eb747357460eb0ad450ad46ca7bb', 'request_id': 'req-679d43cc-01c2-4721-8091-e7b5d50bf233'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:33:51.762591 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-679d43cc-01c2-4721-8091-e7b5d50bf233 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e33eb747357460eb0ad450ad46ca7bb', 'request_id': 'req-679d43cc-01c2-4721-8091-e7b5d50bf233'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:33:51.770856 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-679d43cc-01c2-4721-8091-e7b5d50bf233 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e33eb747357460eb0ad450ad46ca7bb', 'request_id': 'req-679d43cc-01c2-4721-8091-e7b5d50bf233'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:33:51.781116 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-679d43cc-01c2-4721-8091-e7b5d50bf233 admin admin] The token cache is being invalidate because project 2e33eb747357460eb0ad450ad46ca7bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 10:33:51.781401 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-679d43cc-01c2-4721-8091-e7b5d50bf233 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:33:51.782027 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-679d43cc-01c2-4721-8091-e7b5d50bf233 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:33:51.783492 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1217/2472] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 19 10:33:51 2022] DELETE /identity/v3/projects/2e33eb747357460eb0ad450ad46ca7bb => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:33:51.788521 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66adbb3e-209d-4b95-baff-988cde58bc6c None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:33:51.788811 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66adbb3e-209d-4b95-baff-988cde58bc6c None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:33:51.789105 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66adbb3e-209d-4b95-baff-988cde58bc6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:33:51.809120 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-66adbb3e-209d-4b95-baff-988cde58bc6c None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:33:51.810373 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-66adbb3e-209d-4b95-baff-988cde58bc6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:33:51.823616 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:33:51.870719 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1256/2473] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:33:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:33:51.878684 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83b56fd-7376-404c-b0af-19c665dca485 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:33:51.878980 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83b56fd-7376-404c-b0af-19c665dca485 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:33:51.879744 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83b56fd-7376-404c-b0af-19c665dca485 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:33:51.902596 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-a83b56fd-7376-404c-b0af-19c665dca485 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:33:51.903703 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-a83b56fd-7376-404c-b0af-19c665dca485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:33:51.911501 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1218/2474] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:33:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:33:51.915858 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66adbb3e-209d-4b95-baff-988cde58bc6c None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:33:51.925802 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66adbb3e-209d-4b95-baff-988cde58bc6c None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:33:51.930514 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37618cd3-523c-499f-83c2-e819c71ce4b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:33:51.931113 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37618cd3-523c-499f-83c2-e819c71ce4b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:33:51.931401 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37618cd3-523c-499f-83c2-e819c71ce4b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:33:51.931674 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37618cd3-523c-499f-83c2-e819c71ce4b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:33:51.932354 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37618cd3-523c-499f-83c2-e819c71ce4b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:33:51.932652 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37618cd3-523c-499f-83c2-e819c71ce4b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:33:51.934240 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37618cd3-523c-499f-83c2-e819c71ce4b0 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:33:51.946563 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1257/2475] 10.222.0.66 () {58 vars in 1153 bytes} [Mon Sep 19 10:33:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:33:51.950977 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83b56fd-7376-404c-b0af-19c665dca485 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:33:51.960664 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83b56fd-7376-404c-b0af-19c665dca485 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:33:51.965222 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e216cd0f-ac58-4044-acf7-eb5ed94c6237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:33:51.965807 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e216cd0f-ac58-4044-acf7-eb5ed94c6237 admin admin] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:33:51.966083 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e216cd0f-ac58-4044-acf7-eb5ed94c6237 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:33:51.966349 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e216cd0f-ac58-4044-acf7-eb5ed94c6237 admin admin] PATH_INFO: `/v3/projects` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:33:51.966973 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e216cd0f-ac58-4044-acf7-eb5ed94c6237 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:33:51.968914 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e216cd0f-ac58-4044-acf7-eb5ed94c6237 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:33:51.996411 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1219/2476] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 19 10:33:51 2022] POST /identity/v3/projects => generated 387 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 10:33:52.000827 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37618cd3-523c-499f-83c2-e819c71ce4b0 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:33:52.011201 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37618cd3-523c-499f-83c2-e819c71ce4b0 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:33:52.067696 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42aac82-f1d0-4e6a-86b9-726ec2697524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:33:52.068337 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42aac82-f1d0-4e6a-86b9-726ec2697524 admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:33:52.068620 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42aac82-f1d0-4e6a-86b9-726ec2697524 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:33:52.068896 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42aac82-f1d0-4e6a-86b9-726ec2697524 admin admin] PATH_INFO: `/v3/users` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:33:52.069534 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42aac82-f1d0-4e6a-86b9-726ec2697524 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:33:52.071500 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42aac82-f1d0-4e6a-86b9-726ec2697524 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:33:52.093146 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1258/2477] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 19 10:33:51 2022] POST /identity/v3/users => generated 294 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:33:52.097307 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e216cd0f-ac58-4044-acf7-eb5ed94c6237 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:33:52.107631 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e216cd0f-ac58-4044-acf7-eb5ed94c6237 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:33:52.112356 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d600e86-fbb5-43f0-8400-7845ddc0d860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:33:52.112958 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d600e86-fbb5-43f0-8400-7845ddc0d860 admin admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:33:52.113235 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d600e86-fbb5-43f0-8400-7845ddc0d860 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:33:52.114008 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d600e86-fbb5-43f0-8400-7845ddc0d860 admin admin] PATH_INFO: `/v3/roles` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:33:52.114667 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d600e86-fbb5-43f0-8400-7845ddc0d860 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:33:52.116330 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d600e86-fbb5-43f0-8400-7845ddc0d860 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:33:52.126426 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1220/2478] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:33:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 10:33:52.131443 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42aac82-f1d0-4e6a-86b9-726ec2697524 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:33:52.141669 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42aac82-f1d0-4e6a-86b9-726ec2697524 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:33:52.146366 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685fc378-49a9-47e2-8442-617d7a3a14ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:33:52.146990 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685fc378-49a9-47e2-8442-617d7a3a14ea admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:33:52.147262 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685fc378-49a9-47e2-8442-617d7a3a14ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:33:52.147531 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685fc378-49a9-47e2-8442-617d7a3a14ea admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:33:52.148347 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685fc378-49a9-47e2-8442-617d7a3a14ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:33:52.149965 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685fc378-49a9-47e2-8442-617d7a3a14ea admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:33:52.161660 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1259/2479] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:33:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 10:33:52.165999 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d600e86-fbb5-43f0-8400-7845ddc0d860 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:33:52.178245 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d600e86-fbb5-43f0-8400-7845ddc0d860 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:33:52.184690 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1903424-e190-449e-b5d4-c13cb4ebc8d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:33:52.185436 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1903424-e190-449e-b5d4-c13cb4ebc8d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:33:52.185715 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1903424-e190-449e-b5d4-c13cb4ebc8d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:33:52.186009 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1903424-e190-449e-b5d4-c13cb4ebc8d8 admin admin] PATH_INFO: `/v3/projects/9fd979da6f7749779f7f0d029da53e5a/users/32c1b3f5141e43a3ae0af5ca2317ad3f/roles/cd5b42ed3b754b58817a62bbe74651b4` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:33:52.201880 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1903424-e190-449e-b5d4-c13cb4ebc8d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9fd979da6f7749779f7f0d029da53e5a, user_id=32c1b3f5141e43a3ae0af5ca2317ad3f, role_id=cd5b42ed3b754b58817a62bbe74651b4)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:33:52.204596 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1903424-e190-449e-b5d4-c13cb4ebc8d8 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:33:52.217010 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1221/2480] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 19 10:33:52 2022] PUT /identity/v3/projects/9fd979da6f7749779f7f0d029da53e5a/users/32c1b3f5141e43a3ae0af5ca2317ad3f/roles/cd5b42ed3b754b58817a62bbe74651b4 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 10:33:52.222156 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d179720-e868-4a15-8048-d3f08da3073b None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:33:52.222462 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d179720-e868-4a15-8048-d3f08da3073b None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:33:52.222731 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d179720-e868-4a15-8048-d3f08da3073b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:33:52.242026 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-2d179720-e868-4a15-8048-d3f08da3073b None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:33:52.243271 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-2d179720-e868-4a15-8048-d3f08da3073b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:33:52.303207 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1260/2481] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:33:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:33:52.312875 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1903424-e190-449e-b5d4-c13cb4ebc8d8 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:33:52.314576 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-b1903424-e190-449e-b5d4-c13cb4ebc8d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:33:52.329682 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:33:52.373001 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1903424-e190-449e-b5d4-c13cb4ebc8d8 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:33:52.376559 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205d51c6-beb9-4e3d-a327-f243140e1f95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c1289b015854c6bb6aee8fed6b807db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:33:52.377153 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205d51c6-beb9-4e3d-a327-f243140e1f95 service neutron] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:33:52.377430 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205d51c6-beb9-4e3d-a327-f243140e1f95 service neutron] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:33:52.377700 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205d51c6-beb9-4e3d-a327-f243140e1f95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:33:52.387145 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205d51c6-beb9-4e3d-a327-f243140e1f95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:33:52.388618 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205d51c6-beb9-4e3d-a327-f243140e1f95 service neutron] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:33:52.398077 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1222/2482] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:33:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:33:56.522928 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec65a130-4c63-4c31-9a5e-cab023f6fa41 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:33:56.523471 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec65a130-4c63-4c31-9a5e-cab023f6fa41 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:33:56.523471 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec65a130-4c63-4c31-9a5e-cab023f6fa41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:33:56.551346 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-ec65a130-4c63-4c31-9a5e-cab023f6fa41 None None] MFA Rules not processed for user `32c1b3f5141e43a3ae0af5ca2317ad3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:33:56.552605 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-ec65a130-4c63-4c31-9a5e-cab023f6fa41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:33:56.565625 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:33:56.623598 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1261/2483] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:33:56 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:33:56.638481 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205d51c6-beb9-4e3d-a327-f243140e1f95 service neutron] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:33:56.640615 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-205d51c6-beb9-4e3d-a327-f243140e1f95 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:33:56.722535 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205d51c6-beb9-4e3d-a327-f243140e1f95 service neutron] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:33:56.728303 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70a5144-2718-4e67-9472-73d7ff0392e4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15c70bfb085a44e9b84942b480ff22f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:33:56.728959 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70a5144-2718-4e67-9472-73d7ff0392e4 service nova] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:33:56.729282 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70a5144-2718-4e67-9472-73d7ff0392e4 service nova] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:33:56.729540 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70a5144-2718-4e67-9472-73d7ff0392e4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:33:56.737763 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70a5144-2718-4e67-9472-73d7ff0392e4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:33:56.739843 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70a5144-2718-4e67-9472-73d7ff0392e4 service nova] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:33:56.748954 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1223/2484] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:33:56 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:33:58.107782 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38e29b3-3344-45c1-b91f-5f08ddac4b1a None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:33:58.108689 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38e29b3-3344-45c1-b91f-5f08ddac4b1a None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:33:58.109025 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38e29b3-3344-45c1-b91f-5f08ddac4b1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:33:58.128944 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-a38e29b3-3344-45c1-b91f-5f08ddac4b1a None None] MFA Rules not processed for user `32c1b3f5141e43a3ae0af5ca2317ad3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:33:58.130770 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-a38e29b3-3344-45c1-b91f-5f08ddac4b1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:33:58.137760 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1262/2485] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:33:58 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:34:06.744844 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=54 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:34:08.123334 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=23 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:34:19.397295 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03321ed6-d7a4-4625-ae80-25218be01394 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:34:19.397748 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03321ed6-d7a4-4625-ae80-25218be01394 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:34:19.397856 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03321ed6-d7a4-4625-ae80-25218be01394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:34:19.418432 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-03321ed6-d7a4-4625-ae80-25218be01394 None None] MFA Rules not processed for user `e4d1160b71a84e2fa44a8ca6edf1846e`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:34:19.419960 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-03321ed6-d7a4-4625-ae80-25218be01394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:34:19.474906 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1224/2486] 10.222.0.66 () {58 vars in 967 bytes} [Mon Sep 19 10:34:19 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:34:19.515668 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38e29b3-3344-45c1-b91f-5f08ddac4b1a None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:34:19.517094 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-a38e29b3-3344-45c1-b91f-5f08ddac4b1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:34:19.588976 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38e29b3-3344-45c1-b91f-5f08ddac4b1a None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:34:19.594026 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb05259e-75ac-4aec-a693-67dcf14bb598 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6677354e36614c9fb3d03413749be5ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:34:19.594636 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb05259e-75ac-4aec-a693-67dcf14bb598 service swift] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:34:19.594917 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb05259e-75ac-4aec-a693-67dcf14bb598 service swift] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:34:19.595193 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb05259e-75ac-4aec-a693-67dcf14bb598 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:34:19.603330 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb05259e-75ac-4aec-a693-67dcf14bb598 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:34:19.604951 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb05259e-75ac-4aec-a693-67dcf14bb598 service swift] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:34:19.613029 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1263/2487] 10.222.0.66 () {60 vars in 1384 bytes} [Mon Sep 19 10:34:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 19 10:34:26.408751 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf4b43f-250b-4261-95a8-6202f914616b None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:34:26.409277 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf4b43f-250b-4261-95a8-6202f914616b None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:34:26.409498 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf4b43f-250b-4261-95a8-6202f914616b None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:34:26.411046 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1225/2488] 10.222.0.66 () {54 vars in 921 bytes} [Mon Sep 19 10:34:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 10:34:26.426444 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b8e66d-3326-4179-a432-ad076d50448d None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:34:26.427008 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b8e66d-3326-4179-a432-ad076d50448d None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:34:26.427008 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b8e66d-3326-4179-a432-ad076d50448d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:34:26.449248 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-71b8e66d-3326-4179-a432-ad076d50448d None None] MFA Rules not processed for user `46b78120cac64f09bd0f4cdc42424163`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:34:26.450818 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-71b8e66d-3326-4179-a432-ad076d50448d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:34:26.505738 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf4b43f-250b-4261-95a8-6202f914616b None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:34:26.507689 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-eaf4b43f-250b-4261-95a8-6202f914616b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:34:26.524336 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf4b43f-250b-4261-95a8-6202f914616b None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:34:26.528926 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55191db3-858c-44b5-bd01-6d017fae4d0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:34:26.529550 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55191db3-858c-44b5-bd01-6d017fae4d0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:34:26.529830 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55191db3-858c-44b5-bd01-6d017fae4d0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:34:26.530102 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55191db3-858c-44b5-bd01-6d017fae4d0f admin admin] PATH_INFO: `/v3/users/de544cb21c79468eabf416c122ef7b0c` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:34:26.531221 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55191db3-858c-44b5-bd01-6d017fae4d0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=de544cb21c79468eabf416c122ef7b0c)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:34:26.533179 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55191db3-858c-44b5-bd01-6d017fae4d0f admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:34:26.534798 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1264/2489] 10.222.0.66 () {58 vars in 1018 bytes} [Mon Sep 19 10:34:26 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:34:26.545997 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b8e66d-3326-4179-a432-ad076d50448d None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:34:26.547505 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-71b8e66d-3326-4179-a432-ad076d50448d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:34:26.561547 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b8e66d-3326-4179-a432-ad076d50448d None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:34:26.570318 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8d6a08-f1e3-4d55-8703-728384ceb45c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46b78120cac64f09bd0f4cdc42424163', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:34:26.570953 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8d6a08-f1e3-4d55-8703-728384ceb45c service placement] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:34:26.571311 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8d6a08-f1e3-4d55-8703-728384ceb45c service placement] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:34:26.571626 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8d6a08-f1e3-4d55-8703-728384ceb45c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:34:26.586509 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-55191db3-858c-44b5-bd01-6d017fae4d0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de544cb21c79468eabf416c122ef7b0c'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:34:26.590383 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8d6a08-f1e3-4d55-8703-728384ceb45c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:34:26.592260 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8d6a08-f1e3-4d55-8703-728384ceb45c service placement] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:34:26.594115 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-55191db3-858c-44b5-bd01-6d017fae4d0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de544cb21c79468eabf416c122ef7b0c'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:34:26.594881 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-55191db3-858c-44b5-bd01-6d017fae4d0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de544cb21c79468eabf416c122ef7b0c'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:34:26.595535 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-55191db3-858c-44b5-bd01-6d017fae4d0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de544cb21c79468eabf416c122ef7b0c'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:34:26.602652 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-55191db3-858c-44b5-bd01-6d017fae4d0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de544cb21c79468eabf416c122ef7b0c'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:34:26.603219 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1265/2490] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:34:26 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:34:26.621488 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1226/2491] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 19 10:34:26 2022] DELETE /identity/v3/users/de544cb21c79468eabf416c122ef7b0c => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:34:26.800575 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8d6a08-f1e3-4d55-8703-728384ceb45c service placement] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:34:26.819004 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8d6a08-f1e3-4d55-8703-728384ceb45c service placement] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:34:26.876124 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164b9a6e-bfdf-4969-875f-c08ad5a847ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:34:26.876775 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164b9a6e-bfdf-4969-875f-c08ad5a847ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:34:26.877051 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164b9a6e-bfdf-4969-875f-c08ad5a847ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:34:26.877320 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164b9a6e-bfdf-4969-875f-c08ad5a847ac admin admin] PATH_INFO: `/v3/projects/eebabf8ce54d44cc99526d8396f92ba5` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:34:26.878968 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164b9a6e-bfdf-4969-875f-c08ad5a847ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=eebabf8ce54d44cc99526d8396f92ba5)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:34:26.880921 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164b9a6e-bfdf-4969-875f-c08ad5a847ac admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:34:26.899075 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:34:26.929621 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-164b9a6e-bfdf-4969-875f-c08ad5a847ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eebabf8ce54d44cc99526d8396f92ba5', 'request_id': 'req-164b9a6e-bfdf-4969-875f-c08ad5a847ac'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:34:26.935891 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-164b9a6e-bfdf-4969-875f-c08ad5a847ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eebabf8ce54d44cc99526d8396f92ba5', 'request_id': 'req-164b9a6e-bfdf-4969-875f-c08ad5a847ac'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:34:26.943977 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-164b9a6e-bfdf-4969-875f-c08ad5a847ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eebabf8ce54d44cc99526d8396f92ba5', 'request_id': 'req-164b9a6e-bfdf-4969-875f-c08ad5a847ac'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:34:26.954504 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-164b9a6e-bfdf-4969-875f-c08ad5a847ac admin admin] The token cache is being invalidate because project eebabf8ce54d44cc99526d8396f92ba5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 10:34:26.954792 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-164b9a6e-bfdf-4969-875f-c08ad5a847ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:34:26.955454 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-164b9a6e-bfdf-4969-875f-c08ad5a847ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:34:26.957010 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1266/2492] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 19 10:34:26 2022] DELETE /identity/v3/projects/eebabf8ce54d44cc99526d8396f92ba5 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 10:34:26.960995 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55191db3-858c-44b5-bd01-6d017fae4d0f admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:34:26.962433 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-55191db3-858c-44b5-bd01-6d017fae4d0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:34:26.975882 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55191db3-858c-44b5-bd01-6d017fae4d0f admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:34:27.035814 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dd577b-5c69-43b8-aa23-b8c1ff5a4fa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:34:27.036486 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dd577b-5c69-43b8-aa23-b8c1ff5a4fa7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:34:27.036765 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dd577b-5c69-43b8-aa23-b8c1ff5a4fa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:34:27.037037 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dd577b-5c69-43b8-aa23-b8c1ff5a4fa7 admin admin] PATH_INFO: `/v3/users/8b6a4194b3e34809bcea8a2eac7ac1ed` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:34:27.038189 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dd577b-5c69-43b8-aa23-b8c1ff5a4fa7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b6a4194b3e34809bcea8a2eac7ac1ed)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:34:27.040119 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dd577b-5c69-43b8-aa23-b8c1ff5a4fa7 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:34:27.061200 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:34:27.088125 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-79dd577b-5c69-43b8-aa23-b8c1ff5a4fa7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b6a4194b3e34809bcea8a2eac7ac1ed'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:34:27.095416 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-79dd577b-5c69-43b8-aa23-b8c1ff5a4fa7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b6a4194b3e34809bcea8a2eac7ac1ed'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:34:27.096050 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-79dd577b-5c69-43b8-aa23-b8c1ff5a4fa7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b6a4194b3e34809bcea8a2eac7ac1ed'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:34:27.097276 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-79dd577b-5c69-43b8-aa23-b8c1ff5a4fa7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b6a4194b3e34809bcea8a2eac7ac1ed'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:34:27.105268 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-79dd577b-5c69-43b8-aa23-b8c1ff5a4fa7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b6a4194b3e34809bcea8a2eac7ac1ed'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:34:27.124384 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1227/2493] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 19 10:34:26 2022] DELETE /identity/v3/users/8b6a4194b3e34809bcea8a2eac7ac1ed => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:34:27.302245 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164b9a6e-bfdf-4969-875f-c08ad5a847ac admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:34:27.303581 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-164b9a6e-bfdf-4969-875f-c08ad5a847ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:34:27.316626 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164b9a6e-bfdf-4969-875f-c08ad5a847ac admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:34:27.375052 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6656b0b7-3036-4c01-87d8-5c8b524e6d84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:34:27.375721 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6656b0b7-3036-4c01-87d8-5c8b524e6d84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:34:27.376002 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6656b0b7-3036-4c01-87d8-5c8b524e6d84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:34:27.376307 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6656b0b7-3036-4c01-87d8-5c8b524e6d84 admin admin] PATH_INFO: `/v3/projects/dab09be80f904f888bcf7deb0acb971f` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:34:27.377443 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6656b0b7-3036-4c01-87d8-5c8b524e6d84 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dab09be80f904f888bcf7deb0acb971f)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:34:27.379392 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6656b0b7-3036-4c01-87d8-5c8b524e6d84 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:34:27.434514 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-6656b0b7-3036-4c01-87d8-5c8b524e6d84 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dab09be80f904f888bcf7deb0acb971f', 'request_id': 'req-6656b0b7-3036-4c01-87d8-5c8b524e6d84'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:34:27.440884 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-6656b0b7-3036-4c01-87d8-5c8b524e6d84 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dab09be80f904f888bcf7deb0acb971f', 'request_id': 'req-6656b0b7-3036-4c01-87d8-5c8b524e6d84'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:34:27.448383 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-6656b0b7-3036-4c01-87d8-5c8b524e6d84 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dab09be80f904f888bcf7deb0acb971f', 'request_id': 'req-6656b0b7-3036-4c01-87d8-5c8b524e6d84'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:34:27.459292 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-6656b0b7-3036-4c01-87d8-5c8b524e6d84 admin admin] The token cache is being invalidate because project dab09be80f904f888bcf7deb0acb971f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 10:34:27.459575 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-6656b0b7-3036-4c01-87d8-5c8b524e6d84 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:34:27.460235 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-6656b0b7-3036-4c01-87d8-5c8b524e6d84 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:34:27.461750 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1267/2494] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 19 10:34:27 2022] DELETE /identity/v3/projects/dab09be80f904f888bcf7deb0acb971f => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:34:37.120573 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:DELETE=8,keystone:SELECT=20,keystone:INSERT=1 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:34:37.455614 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=69,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:34:52.659174 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dd577b-5c69-43b8-aa23-b8c1ff5a4fa7 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:34:52.660658 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-79dd577b-5c69-43b8-aa23-b8c1ff5a4fa7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:34:52.746236 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dd577b-5c69-43b8-aa23-b8c1ff5a4fa7 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:34:52.795831 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6d4193-c471-461e-b716-880519883d41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c1289b015854c6bb6aee8fed6b807db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:34:52.796482 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6d4193-c471-461e-b716-880519883d41 service neutron] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:34:52.796772 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6d4193-c471-461e-b716-880519883d41 service neutron] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:34:52.797045 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6d4193-c471-461e-b716-880519883d41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:34:52.798800 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-3b6d4193-c471-461e-b716-880519883d41 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:34:52.908019 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6d4193-c471-461e-b716-880519883d41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:34:52.909413 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6d4193-c471-461e-b716-880519883d41 service neutron] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:34:52.913332 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:34:52.932138 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1228/2495] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:34:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:34:56.920397 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6656b0b7-3036-4c01-87d8-5c8b524e6d84 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:34:56.922561 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-6656b0b7-3036-4c01-87d8-5c8b524e6d84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:34:57.004555 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6656b0b7-3036-4c01-87d8-5c8b524e6d84 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:34:57.010868 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8b8d3d-f22b-4a4a-8952-2beb52c06dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:34:57.011648 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8b8d3d-f22b-4a4a-8952-2beb52c06dc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:34:57.011937 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8b8d3d-f22b-4a4a-8952-2beb52c06dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:34:57.012236 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8b8d3d-f22b-4a4a-8952-2beb52c06dc7 admin admin] PATH_INFO: `/v3/users/d37107a7553248409c6cd63406c3ddef` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:34:57.013738 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8b8d3d-f22b-4a4a-8952-2beb52c06dc7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d37107a7553248409c6cd63406c3ddef)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:34:57.015930 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8b8d3d-f22b-4a4a-8952-2beb52c06dc7 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:34:57.077612 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-ec8b8d3d-f22b-4a4a-8952-2beb52c06dc7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd37107a7553248409c6cd63406c3ddef'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:34:57.086920 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-ec8b8d3d-f22b-4a4a-8952-2beb52c06dc7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd37107a7553248409c6cd63406c3ddef'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:34:57.088241 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-ec8b8d3d-f22b-4a4a-8952-2beb52c06dc7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd37107a7553248409c6cd63406c3ddef'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:34:57.089682 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-ec8b8d3d-f22b-4a4a-8952-2beb52c06dc7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd37107a7553248409c6cd63406c3ddef'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:34:57.098073 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-ec8b8d3d-f22b-4a4a-8952-2beb52c06dc7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd37107a7553248409c6cd63406c3ddef'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:34:57.117617 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1268/2496] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 19 10:34:56 2022] DELETE /identity/v3/users/d37107a7553248409c6cd63406c3ddef => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:34:57.324022 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6d4193-c471-461e-b716-880519883d41 service neutron] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:34:57.339532 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6d4193-c471-461e-b716-880519883d41 service neutron] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:34:57.399803 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbed58a-94cb-43ef-ab8b-d17c421dd2ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:34:57.400467 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbed58a-94cb-43ef-ab8b-d17c421dd2ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:34:57.400748 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbed58a-94cb-43ef-ab8b-d17c421dd2ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:34:57.401019 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbed58a-94cb-43ef-ab8b-d17c421dd2ae admin admin] PATH_INFO: `/v3/projects/ccc7a89363f147aaa48d3b5e28b6d821` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:34:57.402143 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbed58a-94cb-43ef-ab8b-d17c421dd2ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=ccc7a89363f147aaa48d3b5e28b6d821)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:34:57.404055 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbed58a-94cb-43ef-ab8b-d17c421dd2ae admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:34:57.467084 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-1bbed58a-94cb-43ef-ab8b-d17c421dd2ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ccc7a89363f147aaa48d3b5e28b6d821', 'request_id': 'req-1bbed58a-94cb-43ef-ab8b-d17c421dd2ae'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:34:57.473849 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-1bbed58a-94cb-43ef-ab8b-d17c421dd2ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ccc7a89363f147aaa48d3b5e28b6d821', 'request_id': 'req-1bbed58a-94cb-43ef-ab8b-d17c421dd2ae'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:34:57.482188 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-1bbed58a-94cb-43ef-ab8b-d17c421dd2ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ccc7a89363f147aaa48d3b5e28b6d821', 'request_id': 'req-1bbed58a-94cb-43ef-ab8b-d17c421dd2ae'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:34:57.493675 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-1bbed58a-94cb-43ef-ab8b-d17c421dd2ae admin admin] The token cache is being invalidate because project ccc7a89363f147aaa48d3b5e28b6d821 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 10:34:57.493957 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-1bbed58a-94cb-43ef-ab8b-d17c421dd2ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:34:57.494603 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-1bbed58a-94cb-43ef-ab8b-d17c421dd2ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:34:57.496072 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1229/2497] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 19 10:34:57 2022] DELETE /identity/v3/projects/ccc7a89363f147aaa48d3b5e28b6d821 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:34:57.500976 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed0ca64-efc8-4e38-9d2e-6b10fd85a86d None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:34:57.501264 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed0ca64-efc8-4e38-9d2e-6b10fd85a86d None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:34:57.501541 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed0ca64-efc8-4e38-9d2e-6b10fd85a86d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:34:57.560545 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-2ed0ca64-efc8-4e38-9d2e-6b10fd85a86d None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:34:57.561771 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-2ed0ca64-efc8-4e38-9d2e-6b10fd85a86d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:34:57.609091 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:34:57.631179 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1269/2498] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:34:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:34:57.639528 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f203ffd7-2515-4625-90c0-2a305284e869 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:34:57.639814 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f203ffd7-2515-4625-90c0-2a305284e869 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:34:57.640092 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f203ffd7-2515-4625-90c0-2a305284e869 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:34:57.659952 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-f203ffd7-2515-4625-90c0-2a305284e869 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:34:57.661325 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-f203ffd7-2515-4625-90c0-2a305284e869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:34:57.669583 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1230/2499] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:34:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:34:57.673872 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed0ca64-efc8-4e38-9d2e-6b10fd85a86d None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:34:57.684218 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed0ca64-efc8-4e38-9d2e-6b10fd85a86d None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:34:57.688975 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48b0b0a-2d47-4c99-be3f-a2f1649e12a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:34:57.689514 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48b0b0a-2d47-4c99-be3f-a2f1649e12a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:34:57.689796 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48b0b0a-2d47-4c99-be3f-a2f1649e12a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:34:57.690616 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48b0b0a-2d47-4c99-be3f-a2f1649e12a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:34:57.691270 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48b0b0a-2d47-4c99-be3f-a2f1649e12a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:34:57.691976 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48b0b0a-2d47-4c99-be3f-a2f1649e12a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:34:57.693209 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48b0b0a-2d47-4c99-be3f-a2f1649e12a5 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:34:57.705849 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1270/2500] 10.222.0.66 () {58 vars in 1153 bytes} [Mon Sep 19 10:34:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:34:57.710044 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f203ffd7-2515-4625-90c0-2a305284e869 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:34:57.719690 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f203ffd7-2515-4625-90c0-2a305284e869 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:34:57.725123 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e06bd7e-1676-445d-a7c9-a02eaa9beb4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:34:57.725728 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e06bd7e-1676-445d-a7c9-a02eaa9beb4d admin admin] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:34:57.726007 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e06bd7e-1676-445d-a7c9-a02eaa9beb4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:34:57.726278 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e06bd7e-1676-445d-a7c9-a02eaa9beb4d admin admin] PATH_INFO: `/v3/projects` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:34:57.726963 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e06bd7e-1676-445d-a7c9-a02eaa9beb4d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:34:57.728969 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e06bd7e-1676-445d-a7c9-a02eaa9beb4d admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:34:57.756563 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1231/2501] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 19 10:34:57 2022] POST /identity/v3/projects => generated 375 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:34:57.760900 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48b0b0a-2d47-4c99-be3f-a2f1649e12a5 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:34:57.770964 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48b0b0a-2d47-4c99-be3f-a2f1649e12a5 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:34:57.828132 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5188e500-8700-4fc6-afcc-14789cf42ca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:34:57.828783 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5188e500-8700-4fc6-afcc-14789cf42ca8 admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:34:57.829325 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5188e500-8700-4fc6-afcc-14789cf42ca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:34:57.829603 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5188e500-8700-4fc6-afcc-14789cf42ca8 admin admin] PATH_INFO: `/v3/users` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:34:57.830451 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5188e500-8700-4fc6-afcc-14789cf42ca8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:34:57.832772 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5188e500-8700-4fc6-afcc-14789cf42ca8 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:34:57.854778 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1271/2502] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 19 10:34:57 2022] POST /identity/v3/users => generated 288 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 10:34:57.860235 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e06bd7e-1676-445d-a7c9-a02eaa9beb4d admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:34:57.871310 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e06bd7e-1676-445d-a7c9-a02eaa9beb4d admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:34:57.876115 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1244ecc1-38f3-4102-861f-0f76de7f8af9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:34:57.876742 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1244ecc1-38f3-4102-861f-0f76de7f8af9 admin admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:34:57.877022 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1244ecc1-38f3-4102-861f-0f76de7f8af9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:34:57.877296 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1244ecc1-38f3-4102-861f-0f76de7f8af9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:34:57.877931 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1244ecc1-38f3-4102-861f-0f76de7f8af9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:34:57.879554 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1244ecc1-38f3-4102-861f-0f76de7f8af9 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:34:57.889967 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1232/2503] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:34:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 10:34:57.895288 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5188e500-8700-4fc6-afcc-14789cf42ca8 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:34:57.907390 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5188e500-8700-4fc6-afcc-14789cf42ca8 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:34:57.912716 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc4981d-52db-433e-be67-9a50e8021a84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:34:57.913323 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc4981d-52db-433e-be67-9a50e8021a84 admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:34:57.913605 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc4981d-52db-433e-be67-9a50e8021a84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:34:57.913878 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc4981d-52db-433e-be67-9a50e8021a84 admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:34:57.914546 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc4981d-52db-433e-be67-9a50e8021a84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:34:57.916120 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc4981d-52db-433e-be67-9a50e8021a84 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:34:57.928738 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1272/2504] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:34:57 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 10:34:57.933276 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1244ecc1-38f3-4102-861f-0f76de7f8af9 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:34:57.943589 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1244ecc1-38f3-4102-861f-0f76de7f8af9 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:34:57.949149 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0863f1d5-798d-4fa9-a8ea-48cf59bfc9b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:34:57.949149 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0863f1d5-798d-4fa9-a8ea-48cf59bfc9b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:34:57.949433 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0863f1d5-798d-4fa9-a8ea-48cf59bfc9b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:34:57.949681 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0863f1d5-798d-4fa9-a8ea-48cf59bfc9b2 admin admin] PATH_INFO: `/v3/projects/f5e58b427c484e6ea60c2b9509fabcc6/users/4a03cf7194b04f7892705e67e1a627c0/roles/cd5b42ed3b754b58817a62bbe74651b4` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:34:57.975234 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0863f1d5-798d-4fa9-a8ea-48cf59bfc9b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5e58b427c484e6ea60c2b9509fabcc6, user_id=4a03cf7194b04f7892705e67e1a627c0, role_id=cd5b42ed3b754b58817a62bbe74651b4)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:34:57.977927 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0863f1d5-798d-4fa9-a8ea-48cf59bfc9b2 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:34:57.992511 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1233/2505] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 19 10:34:57 2022] PUT /identity/v3/projects/f5e58b427c484e6ea60c2b9509fabcc6/users/4a03cf7194b04f7892705e67e1a627c0/roles/cd5b42ed3b754b58817a62bbe74651b4 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:34:58.003180 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b984d335-4751-4746-b9ea-937efca31eb4 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:34:58.004190 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b984d335-4751-4746-b9ea-937efca31eb4 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:34:58.004190 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b984d335-4751-4746-b9ea-937efca31eb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:34:58.031577 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-b984d335-4751-4746-b9ea-937efca31eb4 None None] MFA Rules not processed for user `4a03cf7194b04f7892705e67e1a627c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:34:58.032912 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-b984d335-4751-4746-b9ea-937efca31eb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:34:58.099150 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1273/2506] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:34:58 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:34:58.110149 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0863f1d5-798d-4fa9-a8ea-48cf59bfc9b2 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:34:58.111947 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-0863f1d5-798d-4fa9-a8ea-48cf59bfc9b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:34:58.134135 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:34:58.226085 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0863f1d5-798d-4fa9-a8ea-48cf59bfc9b2 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:34:58.231792 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825b4bb3-169a-4d08-af4f-83ed82528c1b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15c70bfb085a44e9b84942b480ff22f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:34:58.232487 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825b4bb3-169a-4d08-af4f-83ed82528c1b service nova] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:34:58.232768 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825b4bb3-169a-4d08-af4f-83ed82528c1b service nova] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:34:58.233229 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825b4bb3-169a-4d08-af4f-83ed82528c1b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:34:58.241523 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825b4bb3-169a-4d08-af4f-83ed82528c1b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:34:58.243147 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825b4bb3-169a-4d08-af4f-83ed82528c1b service nova] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:34:58.253714 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1234/2507] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:34:58 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:34:58.482465 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b984d335-4751-4746-b9ea-937efca31eb4 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:34:58.539157 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:34:58.558634 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b984d335-4751-4746-b9ea-937efca31eb4 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:34:58.566999 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d00f28-cdec-4057-9760-60103f97450a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:34:58.567756 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d00f28-cdec-4057-9760-60103f97450a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:34:58.568107 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d00f28-cdec-4057-9760-60103f97450a admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:34:58.568484 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d00f28-cdec-4057-9760-60103f97450a admin admin] PATH_INFO: `/v3/users/4a03cf7194b04f7892705e67e1a627c0` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:34:58.569753 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d00f28-cdec-4057-9760-60103f97450a admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a03cf7194b04f7892705e67e1a627c0)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:34:58.573031 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d00f28-cdec-4057-9760-60103f97450a admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:34:58.627121 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-b9d00f28-cdec-4057-9760-60103f97450a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a03cf7194b04f7892705e67e1a627c0'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:34:58.636600 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-b9d00f28-cdec-4057-9760-60103f97450a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a03cf7194b04f7892705e67e1a627c0'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:34:58.637452 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-b9d00f28-cdec-4057-9760-60103f97450a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a03cf7194b04f7892705e67e1a627c0'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:34:58.638122 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-b9d00f28-cdec-4057-9760-60103f97450a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a03cf7194b04f7892705e67e1a627c0'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:34:58.648632 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-b9d00f28-cdec-4057-9760-60103f97450a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a03cf7194b04f7892705e67e1a627c0'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:34:58.675246 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1274/2508] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 19 10:34:58 2022] DELETE /identity/v3/users/4a03cf7194b04f7892705e67e1a627c0 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:34:58.679974 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9320b9f3-66a1-465e-b0ab-b1199248651b None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:34:58.680484 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9320b9f3-66a1-465e-b0ab-b1199248651b None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:34:58.680592 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9320b9f3-66a1-465e-b0ab-b1199248651b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:34:58.706404 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-9320b9f3-66a1-465e-b0ab-b1199248651b None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:34:58.707891 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-9320b9f3-66a1-465e-b0ab-b1199248651b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:34:58.773921 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1235/2509] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:34:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:34:58.783907 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d00f28-cdec-4057-9760-60103f97450a admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:34:58.785462 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-b9d00f28-cdec-4057-9760-60103f97450a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:34:58.844928 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d00f28-cdec-4057-9760-60103f97450a admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:34:58.848925 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775e567f-248d-4af8-87f2-e5ee9cf62840 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c1289b015854c6bb6aee8fed6b807db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:34:58.849537 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775e567f-248d-4af8-87f2-e5ee9cf62840 service neutron] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:34:58.849820 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775e567f-248d-4af8-87f2-e5ee9cf62840 service neutron] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:34:58.850109 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775e567f-248d-4af8-87f2-e5ee9cf62840 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:34:58.859190 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775e567f-248d-4af8-87f2-e5ee9cf62840 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:34:58.860663 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775e567f-248d-4af8-87f2-e5ee9cf62840 service neutron] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:34:58.870648 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1275/2510] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:34:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:34:59.165287 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9320b9f3-66a1-465e-b0ab-b1199248651b None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:34:59.166915 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-9320b9f3-66a1-465e-b0ab-b1199248651b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:34:59.179954 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9320b9f3-66a1-465e-b0ab-b1199248651b None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:34:59.184744 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4279d269-e212-432d-b01d-37be3be5ef4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:34:59.185380 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4279d269-e212-432d-b01d-37be3be5ef4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:34:59.185655 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4279d269-e212-432d-b01d-37be3be5ef4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:34:59.185935 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4279d269-e212-432d-b01d-37be3be5ef4d admin admin] PATH_INFO: `/v3/projects/f5e58b427c484e6ea60c2b9509fabcc6` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:34:59.187056 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4279d269-e212-432d-b01d-37be3be5ef4d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5e58b427c484e6ea60c2b9509fabcc6)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:34:59.189026 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4279d269-e212-432d-b01d-37be3be5ef4d admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:34:59.238552 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-4279d269-e212-432d-b01d-37be3be5ef4d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5e58b427c484e6ea60c2b9509fabcc6', 'request_id': 'req-4279d269-e212-432d-b01d-37be3be5ef4d'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:34:59.244870 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-4279d269-e212-432d-b01d-37be3be5ef4d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5e58b427c484e6ea60c2b9509fabcc6', 'request_id': 'req-4279d269-e212-432d-b01d-37be3be5ef4d'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:34:59.252496 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-4279d269-e212-432d-b01d-37be3be5ef4d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5e58b427c484e6ea60c2b9509fabcc6', 'request_id': 'req-4279d269-e212-432d-b01d-37be3be5ef4d'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:34:59.258952 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:34:59.264603 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-4279d269-e212-432d-b01d-37be3be5ef4d admin admin] The token cache is being invalidate because project f5e58b427c484e6ea60c2b9509fabcc6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 10:34:59.264914 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-4279d269-e212-432d-b01d-37be3be5ef4d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:34:59.265990 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-4279d269-e212-432d-b01d-37be3be5ef4d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:34:59.268709 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1236/2511] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 19 10:34:59 2022] DELETE /identity/v3/projects/f5e58b427c484e6ea60c2b9509fabcc6 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:34:59.274246 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea54ce5-35f8-4f21-8169-d2bd58b233bb None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:34:59.274720 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea54ce5-35f8-4f21-8169-d2bd58b233bb None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:34:59.274829 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea54ce5-35f8-4f21-8169-d2bd58b233bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:34:59.295222 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-eea54ce5-35f8-4f21-8169-d2bd58b233bb None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:34:59.296630 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-eea54ce5-35f8-4f21-8169-d2bd58b233bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:34:59.356466 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1276/2512] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:34:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:34:59.365227 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d119a0be-f6d3-4e7b-80a2-815fdb7106be None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:34:59.365450 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d119a0be-f6d3-4e7b-80a2-815fdb7106be None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:34:59.365723 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d119a0be-f6d3-4e7b-80a2-815fdb7106be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:34:59.385886 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-d119a0be-f6d3-4e7b-80a2-815fdb7106be None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:34:59.387444 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-d119a0be-f6d3-4e7b-80a2-815fdb7106be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:34:59.395987 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1237/2513] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:34:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:34:59.400300 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea54ce5-35f8-4f21-8169-d2bd58b233bb None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:34:59.410517 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea54ce5-35f8-4f21-8169-d2bd58b233bb None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:34:59.415125 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b695790-4a58-4d8f-8b84-945cd005cbcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:34:59.415726 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b695790-4a58-4d8f-8b84-945cd005cbcd admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:34:59.416009 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b695790-4a58-4d8f-8b84-945cd005cbcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:34:59.416325 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b695790-4a58-4d8f-8b84-945cd005cbcd admin admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:34:59.417048 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b695790-4a58-4d8f-8b84-945cd005cbcd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:34:59.417360 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b695790-4a58-4d8f-8b84-945cd005cbcd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:34:59.419426 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b695790-4a58-4d8f-8b84-945cd005cbcd admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:34:59.421004 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:34:59.434772 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1277/2514] 10.222.0.66 () {58 vars in 1153 bytes} [Mon Sep 19 10:34:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:34:59.439119 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d119a0be-f6d3-4e7b-80a2-815fdb7106be None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:34:59.448596 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d119a0be-f6d3-4e7b-80a2-815fdb7106be None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:34:59.453283 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8010fc3-07e8-43ad-af72-7ca9d416ebba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:34:59.453876 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8010fc3-07e8-43ad-af72-7ca9d416ebba admin admin] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:34:59.454155 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8010fc3-07e8-43ad-af72-7ca9d416ebba admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:34:59.454429 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8010fc3-07e8-43ad-af72-7ca9d416ebba admin admin] PATH_INFO: `/v3/projects` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:34:59.455062 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8010fc3-07e8-43ad-af72-7ca9d416ebba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:34:59.457032 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8010fc3-07e8-43ad-af72-7ca9d416ebba admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:34:59.484680 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1238/2515] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 19 10:34:59 2022] POST /identity/v3/projects => generated 367 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:34:59.489610 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b695790-4a58-4d8f-8b84-945cd005cbcd admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:34:59.499534 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b695790-4a58-4d8f-8b84-945cd005cbcd admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:34:59.554518 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b81309e-6fd5-4d62-8818-7eb20947cec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:34:59.555117 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b81309e-6fd5-4d62-8818-7eb20947cec1 admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:34:59.555395 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b81309e-6fd5-4d62-8818-7eb20947cec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:34:59.555665 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b81309e-6fd5-4d62-8818-7eb20947cec1 admin admin] PATH_INFO: `/v3/users` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:34:59.556323 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b81309e-6fd5-4d62-8818-7eb20947cec1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:34:59.558227 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b81309e-6fd5-4d62-8818-7eb20947cec1 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:34:59.580208 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1278/2516] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 19 10:34:59 2022] POST /identity/v3/users => generated 284 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:34:59.584908 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8010fc3-07e8-43ad-af72-7ca9d416ebba admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:34:59.595599 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8010fc3-07e8-43ad-af72-7ca9d416ebba admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:34:59.600737 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca0583a-36f7-42e5-807b-c3ca8b299320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:34:59.601330 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca0583a-36f7-42e5-807b-c3ca8b299320 admin admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:34:59.601608 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca0583a-36f7-42e5-807b-c3ca8b299320 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:34:59.601908 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca0583a-36f7-42e5-807b-c3ca8b299320 admin admin] PATH_INFO: `/v3/roles` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:34:59.602542 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca0583a-36f7-42e5-807b-c3ca8b299320 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:34:59.604137 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca0583a-36f7-42e5-807b-c3ca8b299320 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:34:59.614034 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1239/2517] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:34:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 10:34:59.618043 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b81309e-6fd5-4d62-8818-7eb20947cec1 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:34:59.628030 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b81309e-6fd5-4d62-8818-7eb20947cec1 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:34:59.632669 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4e5d3f-813d-4804-b033-2cd0e804332f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:34:59.633261 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4e5d3f-813d-4804-b033-2cd0e804332f admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:34:59.633541 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4e5d3f-813d-4804-b033-2cd0e804332f admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:34:59.633817 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4e5d3f-813d-4804-b033-2cd0e804332f admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:34:59.634447 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4e5d3f-813d-4804-b033-2cd0e804332f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:34:59.636347 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4e5d3f-813d-4804-b033-2cd0e804332f admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:34:59.647343 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1279/2518] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:34:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 10:34:59.651478 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca0583a-36f7-42e5-807b-c3ca8b299320 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:34:59.662977 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca0583a-36f7-42e5-807b-c3ca8b299320 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:34:59.667594 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdfbaac-99e7-452f-8c68-229edf97c6ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:34:59.668272 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdfbaac-99e7-452f-8c68-229edf97c6ca admin admin] REQUEST_METHOD: `PUT` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:34:59.668817 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdfbaac-99e7-452f-8c68-229edf97c6ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:34:59.669096 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdfbaac-99e7-452f-8c68-229edf97c6ca admin admin] PATH_INFO: `/v3/projects/6c8b189fa2e549f4ad54a77dc2ec188a/users/71168782e3d1408c8b4482b0e41ed6a5/roles/cd5b42ed3b754b58817a62bbe74651b4` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:34:59.683982 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdfbaac-99e7-452f-8c68-229edf97c6ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c8b189fa2e549f4ad54a77dc2ec188a, user_id=71168782e3d1408c8b4482b0e41ed6a5, role_id=cd5b42ed3b754b58817a62bbe74651b4)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:34:59.687157 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdfbaac-99e7-452f-8c68-229edf97c6ca admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:34:59.700125 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1240/2519] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 19 10:34:59 2022] PUT /identity/v3/projects/6c8b189fa2e549f4ad54a77dc2ec188a/users/71168782e3d1408c8b4482b0e41ed6a5/roles/cd5b42ed3b754b58817a62bbe74651b4 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 10:34:59.712453 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdb7ab6-c937-40fb-9c8e-c3c9f2c4d892 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:34:59.712743 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdb7ab6-c937-40fb-9c8e-c3c9f2c4d892 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:34:59.713022 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdb7ab6-c937-40fb-9c8e-c3c9f2c4d892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:34:59.741016 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-9cdb7ab6-c937-40fb-9c8e-c3c9f2c4d892 None None] MFA Rules not processed for user `71168782e3d1408c8b4482b0e41ed6a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:34:59.742330 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-9cdb7ab6-c937-40fb-9c8e-c3c9f2c4d892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:34:59.809861 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1280/2520] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:34:59 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:34:59.814524 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdfbaac-99e7-452f-8c68-229edf97c6ca admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:34:59.888765 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdfbaac-99e7-452f-8c68-229edf97c6ca admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:34:59.895433 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29723b0-4b7f-4183-b1fc-ec849fe6231f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:34:59.896207 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29723b0-4b7f-4183-b1fc-ec849fe6231f admin admin] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:34:59.896492 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29723b0-4b7f-4183-b1fc-ec849fe6231f admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:34:59.896763 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29723b0-4b7f-4183-b1fc-ec849fe6231f admin admin] PATH_INFO: `/v3/projects` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:34:59.897409 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29723b0-4b7f-4183-b1fc-ec849fe6231f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:34:59.899353 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29723b0-4b7f-4183-b1fc-ec849fe6231f admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:34:59.928752 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1241/2521] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 19 10:34:59 2022] POST /identity/v3/projects => generated 369 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:34:59.932936 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdb7ab6-c937-40fb-9c8e-c3c9f2c4d892 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:34:59.944849 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdb7ab6-c937-40fb-9c8e-c3c9f2c4d892 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:35:00.009530 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8961f17f-c087-4e6e-95ab-87ee96c74ee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:35:00.010144 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8961f17f-c087-4e6e-95ab-87ee96c74ee4 admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:00.010448 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8961f17f-c087-4e6e-95ab-87ee96c74ee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:00.010724 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8961f17f-c087-4e6e-95ab-87ee96c74ee4 admin admin] PATH_INFO: `/v3/users` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:00.011386 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8961f17f-c087-4e6e-95ab-87ee96c74ee4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:35:00.013373 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8961f17f-c087-4e6e-95ab-87ee96c74ee4 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:35:00.022714 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:35:00.035453 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1281/2522] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 19 10:34:59 2022] POST /identity/v3/users => generated 291 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:35:00.039620 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29723b0-4b7f-4183-b1fc-ec849fe6231f admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:35:00.050336 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29723b0-4b7f-4183-b1fc-ec849fe6231f admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:35:00.055166 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f764a49-64d4-4e1b-b490-0e5e9e98787a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:35:00.055800 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f764a49-64d4-4e1b-b490-0e5e9e98787a admin admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:00.056081 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f764a49-64d4-4e1b-b490-0e5e9e98787a admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:00.056428 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f764a49-64d4-4e1b-b490-0e5e9e98787a admin admin] PATH_INFO: `/v3/roles` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:00.057155 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f764a49-64d4-4e1b-b490-0e5e9e98787a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:35:00.058789 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f764a49-64d4-4e1b-b490-0e5e9e98787a admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:35:00.069809 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1242/2523] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:35:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 10:35:00.074055 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8961f17f-c087-4e6e-95ab-87ee96c74ee4 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:35:00.085575 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8961f17f-c087-4e6e-95ab-87ee96c74ee4 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:35:00.090280 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7adea8-6ca3-4887-a700-fd2e9facfcb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:35:00.090925 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7adea8-6ca3-4887-a700-fd2e9facfcb3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:00.091204 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7adea8-6ca3-4887-a700-fd2e9facfcb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:00.091482 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7adea8-6ca3-4887-a700-fd2e9facfcb3 admin admin] PATH_INFO: `/v3/projects/20e7261d97d14f818bb11e226f3ea14e/users/51ada32d0a6e4e9d8f8eb4cc292da983/roles/5c8b89fae4fa45bd944cbeaf442136e1` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:00.106454 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7adea8-6ca3-4887-a700-fd2e9facfcb3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20e7261d97d14f818bb11e226f3ea14e, user_id=51ada32d0a6e4e9d8f8eb4cc292da983, role_id=5c8b89fae4fa45bd944cbeaf442136e1)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:35:00.109177 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7adea8-6ca3-4887-a700-fd2e9facfcb3 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:35:00.122044 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1282/2524] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 19 10:35:00 2022] PUT /identity/v3/projects/20e7261d97d14f818bb11e226f3ea14e/users/51ada32d0a6e4e9d8f8eb4cc292da983/roles/5c8b89fae4fa45bd944cbeaf442136e1 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:35:00.126113 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f764a49-64d4-4e1b-b490-0e5e9e98787a admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:35:00.137333 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f764a49-64d4-4e1b-b490-0e5e9e98787a admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:35:00.194939 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bdd5ec-4dad-4c56-84ad-716aab746174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:35:00.195542 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bdd5ec-4dad-4c56-84ad-716aab746174 admin admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:00.195819 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bdd5ec-4dad-4c56-84ad-716aab746174 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:00.196088 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bdd5ec-4dad-4c56-84ad-716aab746174 admin admin] PATH_INFO: `/v3/roles` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:00.196750 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bdd5ec-4dad-4c56-84ad-716aab746174 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:35:00.198338 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bdd5ec-4dad-4c56-84ad-716aab746174 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:35:00.208289 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1243/2525] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:35:00 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 10:35:00.212768 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7adea8-6ca3-4887-a700-fd2e9facfcb3 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:35:00.223052 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7adea8-6ca3-4887-a700-fd2e9facfcb3 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:35:00.230235 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a7ccb3-7bd3-4f54-9a7a-fa5621e52ccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:35:00.230926 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a7ccb3-7bd3-4f54-9a7a-fa5621e52ccd admin admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:00.231211 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a7ccb3-7bd3-4f54-9a7a-fa5621e52ccd admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:00.231496 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a7ccb3-7bd3-4f54-9a7a-fa5621e52ccd admin admin] PATH_INFO: `/v3/projects/20e7261d97d14f818bb11e226f3ea14e/users/51ada32d0a6e4e9d8f8eb4cc292da983/roles/5c8b89fae4fa45bd944cbeaf442136e1` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:00.233586 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a7ccb3-7bd3-4f54-9a7a-fa5621e52ccd admin admin] RBAC: Authorizing `identity:create_grant(project_id=20e7261d97d14f818bb11e226f3ea14e, user_id=51ada32d0a6e4e9d8f8eb4cc292da983, role_id=5c8b89fae4fa45bd944cbeaf442136e1)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:35:00.236305 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a7ccb3-7bd3-4f54-9a7a-fa5621e52ccd admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:35:00.247674 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1283/2526] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 19 10:35:00 2022] PUT /identity/v3/projects/20e7261d97d14f818bb11e226f3ea14e/users/51ada32d0a6e4e9d8f8eb4cc292da983/roles/5c8b89fae4fa45bd944cbeaf442136e1 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:35:00.258568 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59ea2b4-02d4-4e31-b5c6-52548bfc2ce1 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:00.258852 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59ea2b4-02d4-4e31-b5c6-52548bfc2ce1 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:00.259154 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59ea2b4-02d4-4e31-b5c6-52548bfc2ce1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:00.267364 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:35:00.288849 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-a59ea2b4-02d4-4e31-b5c6-52548bfc2ce1 None None] MFA Rules not processed for user `51ada32d0a6e4e9d8f8eb4cc292da983`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:35:00.290043 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-a59ea2b4-02d4-4e31-b5c6-52548bfc2ce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:35:00.358867 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1244/2527] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:35:00 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:35:00.370497 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a7ccb3-7bd3-4f54-9a7a-fa5621e52ccd admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:35:00.372313 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-85a7ccb3-7bd3-4f54-9a7a-fa5621e52ccd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:35:00.430787 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a7ccb3-7bd3-4f54-9a7a-fa5621e52ccd admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:35:00.434371 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e556ea-bb58-408c-8fa1-aded90675819 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa4d004fd44482cae761c4b3bdfab31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:35:00.434970 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e556ea-bb58-408c-8fa1-aded90675819 service cinder] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:00.435247 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e556ea-bb58-408c-8fa1-aded90675819 service cinder] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:00.435517 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e556ea-bb58-408c-8fa1-aded90675819 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:00.445042 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e556ea-bb58-408c-8fa1-aded90675819 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:35:00.446461 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e556ea-bb58-408c-8fa1-aded90675819 service cinder] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:35:00.455737 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1284/2528] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:35:00 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:35:00.500101 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59ea2b4-02d4-4e31-b5c6-52548bfc2ce1 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:35:00.501545 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-a59ea2b4-02d4-4e31-b5c6-52548bfc2ce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:35:00.514884 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59ea2b4-02d4-4e31-b5c6-52548bfc2ce1 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:35:00.518693 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797574f0-0b95-48aa-8380-5b6cae001e04 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa4d004fd44482cae761c4b3bdfab31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:35:00.519288 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797574f0-0b95-48aa-8380-5b6cae001e04 service cinder] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:00.519566 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797574f0-0b95-48aa-8380-5b6cae001e04 service cinder] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:00.519841 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797574f0-0b95-48aa-8380-5b6cae001e04 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:00.588972 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797574f0-0b95-48aa-8380-5b6cae001e04 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:35:00.590425 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797574f0-0b95-48aa-8380-5b6cae001e04 service cinder] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:35:00.599488 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1245/2529] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:35:00 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:35:02.372065 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e556ea-bb58-408c-8fa1-aded90675819 service cinder] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:35:02.373641 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-67e556ea-bb58-408c-8fa1-aded90675819 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:35:02.436265 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e556ea-bb58-408c-8fa1-aded90675819 service cinder] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:35:02.440561 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17abdcba-26c9-4148-a038-4e350bbee3c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c1289b015854c6bb6aee8fed6b807db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:35:02.441187 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17abdcba-26c9-4148-a038-4e350bbee3c6 service neutron] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:02.441472 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17abdcba-26c9-4148-a038-4e350bbee3c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:02.441749 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17abdcba-26c9-4148-a038-4e350bbee3c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:02.443733 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-17abdcba-26c9-4148-a038-4e350bbee3c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:35:02.508532 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17abdcba-26c9-4148-a038-4e350bbee3c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:35:02.510019 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17abdcba-26c9-4148-a038-4e350bbee3c6 service neutron] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:35:02.520889 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1285/2530] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:35:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:35:04.023303 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797574f0-0b95-48aa-8380-5b6cae001e04 service cinder] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:35:04.035110 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797574f0-0b95-48aa-8380-5b6cae001e04 service cinder] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:35:04.040033 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dad682-b233-4902-90d7-4e466f0048f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:35:04.040803 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dad682-b233-4902-90d7-4e466f0048f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:04.041157 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dad682-b233-4902-90d7-4e466f0048f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:04.041506 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dad682-b233-4902-90d7-4e466f0048f4 admin admin] PATH_INFO: `/v3/users/71168782e3d1408c8b4482b0e41ed6a5` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:04.042721 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dad682-b233-4902-90d7-4e466f0048f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=71168782e3d1408c8b4482b0e41ed6a5)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:35:04.045033 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dad682-b233-4902-90d7-4e466f0048f4 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:35:04.094549 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-c4dad682-b233-4902-90d7-4e466f0048f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71168782e3d1408c8b4482b0e41ed6a5'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:04.103234 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-c4dad682-b233-4902-90d7-4e466f0048f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71168782e3d1408c8b4482b0e41ed6a5'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:04.104027 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-c4dad682-b233-4902-90d7-4e466f0048f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71168782e3d1408c8b4482b0e41ed6a5'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:04.104872 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-c4dad682-b233-4902-90d7-4e466f0048f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71168782e3d1408c8b4482b0e41ed6a5'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:04.112615 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-c4dad682-b233-4902-90d7-4e466f0048f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71168782e3d1408c8b4482b0e41ed6a5'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:04.127345 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:35:04.132403 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1246/2531] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 19 10:35:04 2022] DELETE /identity/v3/users/71168782e3d1408c8b4482b0e41ed6a5 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:35:04.137094 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7863717-fab2-4e05-919c-7265702be2dc None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:04.137653 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7863717-fab2-4e05-919c-7265702be2dc None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:04.137653 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7863717-fab2-4e05-919c-7265702be2dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:04.160550 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:35:04.170366 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-a7863717-fab2-4e05-919c-7265702be2dc None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:35:04.171733 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-a7863717-fab2-4e05-919c-7265702be2dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:35:04.238403 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1286/2532] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:35:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:35:04.255181 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dad682-b233-4902-90d7-4e466f0048f4 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:35:04.256940 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-c4dad682-b233-4902-90d7-4e466f0048f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:35:04.323054 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dad682-b233-4902-90d7-4e466f0048f4 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:35:04.327954 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eeb0d5-43c7-4703-89f1-3a93defe2059 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c1289b015854c6bb6aee8fed6b807db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:35:04.328817 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eeb0d5-43c7-4703-89f1-3a93defe2059 service neutron] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:04.329248 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eeb0d5-43c7-4703-89f1-3a93defe2059 service neutron] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:04.329683 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eeb0d5-43c7-4703-89f1-3a93defe2059 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:04.340732 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19eeb0d5-43c7-4703-89f1-3a93defe2059 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:35:04.342287 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19eeb0d5-43c7-4703-89f1-3a93defe2059 service neutron] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:35:04.354179 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1247/2533] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:35:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:35:04.642755 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7863717-fab2-4e05-919c-7265702be2dc None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:35:04.646020 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-a7863717-fab2-4e05-919c-7265702be2dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:35:04.677634 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7863717-fab2-4e05-919c-7265702be2dc None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:35:04.683810 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f361236-36e6-498c-8b5a-a86a4ed25006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:35:04.685033 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f361236-36e6-498c-8b5a-a86a4ed25006 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:04.685555 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f361236-36e6-498c-8b5a-a86a4ed25006 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:04.686056 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f361236-36e6-498c-8b5a-a86a4ed25006 admin admin] PATH_INFO: `/v3/projects/6c8b189fa2e549f4ad54a77dc2ec188a` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:04.691186 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f361236-36e6-498c-8b5a-a86a4ed25006 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c8b189fa2e549f4ad54a77dc2ec188a)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:35:04.695231 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f361236-36e6-498c-8b5a-a86a4ed25006 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:35:04.767918 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-0f361236-36e6-498c-8b5a-a86a4ed25006 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c8b189fa2e549f4ad54a77dc2ec188a', 'request_id': 'req-0f361236-36e6-498c-8b5a-a86a4ed25006'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:04.776072 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-0f361236-36e6-498c-8b5a-a86a4ed25006 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c8b189fa2e549f4ad54a77dc2ec188a', 'request_id': 'req-0f361236-36e6-498c-8b5a-a86a4ed25006'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:04.784646 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-0f361236-36e6-498c-8b5a-a86a4ed25006 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c8b189fa2e549f4ad54a77dc2ec188a', 'request_id': 'req-0f361236-36e6-498c-8b5a-a86a4ed25006'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:04.797327 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-0f361236-36e6-498c-8b5a-a86a4ed25006 admin admin] The token cache is being invalidate because project 6c8b189fa2e549f4ad54a77dc2ec188a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 10:35:04.797617 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-0f361236-36e6-498c-8b5a-a86a4ed25006 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:04.798289 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-0f361236-36e6-498c-8b5a-a86a4ed25006 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:04.800414 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1287/2534] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 19 10:35:04 2022] DELETE /identity/v3/projects/6c8b189fa2e549f4ad54a77dc2ec188a => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:35:04.804568 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eeb0d5-43c7-4703-89f1-3a93defe2059 service neutron] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:35:04.814362 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eeb0d5-43c7-4703-89f1-3a93defe2059 service neutron] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:35:04.877128 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9c2307-492f-4c67-8318-e018fdb7b652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:35:04.878479 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9c2307-492f-4c67-8318-e018fdb7b652 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:04.878858 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9c2307-492f-4c67-8318-e018fdb7b652 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:04.879251 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9c2307-492f-4c67-8318-e018fdb7b652 admin admin] PATH_INFO: `/v3/users/51ada32d0a6e4e9d8f8eb4cc292da983` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:04.881005 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9c2307-492f-4c67-8318-e018fdb7b652 admin admin] RBAC: Authorizing `identity:delete_user(user_id=51ada32d0a6e4e9d8f8eb4cc292da983)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:35:04.883155 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9c2307-492f-4c67-8318-e018fdb7b652 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:35:04.935525 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-fd9c2307-492f-4c67-8318-e018fdb7b652 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51ada32d0a6e4e9d8f8eb4cc292da983'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:04.945181 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-fd9c2307-492f-4c67-8318-e018fdb7b652 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51ada32d0a6e4e9d8f8eb4cc292da983'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:04.945911 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-fd9c2307-492f-4c67-8318-e018fdb7b652 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51ada32d0a6e4e9d8f8eb4cc292da983'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:04.946526 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-fd9c2307-492f-4c67-8318-e018fdb7b652 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51ada32d0a6e4e9d8f8eb4cc292da983'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:04.954482 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-fd9c2307-492f-4c67-8318-e018fdb7b652 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51ada32d0a6e4e9d8f8eb4cc292da983'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:04.972664 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1248/2535] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 19 10:35:04 2022] DELETE /identity/v3/users/51ada32d0a6e4e9d8f8eb4cc292da983 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:35:05.429560 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f361236-36e6-498c-8b5a-a86a4ed25006 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:35:05.431273 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-0f361236-36e6-498c-8b5a-a86a4ed25006 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:35:05.451389 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f361236-36e6-498c-8b5a-a86a4ed25006 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:35:05.536578 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409876fd-0b8a-4123-997f-e77d8044558d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:35:05.537528 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409876fd-0b8a-4123-997f-e77d8044558d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:05.537816 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409876fd-0b8a-4123-997f-e77d8044558d admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:05.538092 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409876fd-0b8a-4123-997f-e77d8044558d admin admin] PATH_INFO: `/v3/projects/20e7261d97d14f818bb11e226f3ea14e` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:05.539428 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409876fd-0b8a-4123-997f-e77d8044558d admin admin] RBAC: Authorizing `identity:delete_project(project_id=20e7261d97d14f818bb11e226f3ea14e)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:35:05.541409 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409876fd-0b8a-4123-997f-e77d8044558d admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:35:05.596803 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:35:05.624456 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-409876fd-0b8a-4123-997f-e77d8044558d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20e7261d97d14f818bb11e226f3ea14e', 'request_id': 'req-409876fd-0b8a-4123-997f-e77d8044558d'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:05.632741 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-409876fd-0b8a-4123-997f-e77d8044558d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20e7261d97d14f818bb11e226f3ea14e', 'request_id': 'req-409876fd-0b8a-4123-997f-e77d8044558d'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:05.641653 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-409876fd-0b8a-4123-997f-e77d8044558d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20e7261d97d14f818bb11e226f3ea14e', 'request_id': 'req-409876fd-0b8a-4123-997f-e77d8044558d'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:05.655876 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-409876fd-0b8a-4123-997f-e77d8044558d admin admin] The token cache is being invalidate because project 20e7261d97d14f818bb11e226f3ea14e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 10:35:05.656289 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-409876fd-0b8a-4123-997f-e77d8044558d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:05.657258 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-409876fd-0b8a-4123-997f-e77d8044558d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:05.660244 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1288/2536] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 19 10:35:05 2022] DELETE /identity/v3/projects/20e7261d97d14f818bb11e226f3ea14e => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:35:05.665917 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76713d09-4c81-4d78-922d-f54b01ed2a0a None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:05.666436 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76713d09-4c81-4d78-922d-f54b01ed2a0a None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:05.666545 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76713d09-4c81-4d78-922d-f54b01ed2a0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:05.709446 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-76713d09-4c81-4d78-922d-f54b01ed2a0a None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:35:05.716010 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-76713d09-4c81-4d78-922d-f54b01ed2a0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:35:05.745755 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:35:05.800699 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1249/2537] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:35:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:35:05.810475 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1145d070-d95b-41e8-b666-bef626bc5032 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:05.810975 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1145d070-d95b-41e8-b666-bef626bc5032 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:05.811511 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1145d070-d95b-41e8-b666-bef626bc5032 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:05.848459 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-1145d070-d95b-41e8-b666-bef626bc5032 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:35:05.849847 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-1145d070-d95b-41e8-b666-bef626bc5032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:35:05.864977 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1289/2538] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:35:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:35:05.865434 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76713d09-4c81-4d78-922d-f54b01ed2a0a None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:35:05.875960 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76713d09-4c81-4d78-922d-f54b01ed2a0a None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:35:05.882661 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf716456-ae39-454a-ad98-9ea3b2bffdc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:35:05.883751 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf716456-ae39-454a-ad98-9ea3b2bffdc5 admin admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:05.884245 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf716456-ae39-454a-ad98-9ea3b2bffdc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:05.884816 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf716456-ae39-454a-ad98-9ea3b2bffdc5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:05.886655 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf716456-ae39-454a-ad98-9ea3b2bffdc5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:35:05.887354 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf716456-ae39-454a-ad98-9ea3b2bffdc5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:35:05.890458 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf716456-ae39-454a-ad98-9ea3b2bffdc5 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:35:05.905662 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1250/2539] 10.222.0.66 () {58 vars in 1153 bytes} [Mon Sep 19 10:35:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 10:35:05.910878 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1145d070-d95b-41e8-b666-bef626bc5032 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:35:05.925110 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1145d070-d95b-41e8-b666-bef626bc5032 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:35:05.931586 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834b9dd5-802b-41fc-9c2f-ab4b454219ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:35:05.932286 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834b9dd5-802b-41fc-9c2f-ab4b454219ae admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:05.932667 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834b9dd5-802b-41fc-9c2f-ab4b454219ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:05.933132 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834b9dd5-802b-41fc-9c2f-ab4b454219ae admin admin] PATH_INFO: `/v3/projects` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:05.933878 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834b9dd5-802b-41fc-9c2f-ab4b454219ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:35:05.935879 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834b9dd5-802b-41fc-9c2f-ab4b454219ae admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:35:05.979825 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1290/2540] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 19 10:35:05 2022] POST /identity/v3/projects => generated 377 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:35:05.985108 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf716456-ae39-454a-ad98-9ea3b2bffdc5 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:35:05.999591 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf716456-ae39-454a-ad98-9ea3b2bffdc5 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:35:06.010295 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834b9dd5-802b-41fc-9c2f-ab4b454219ae admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:35:06.016589 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-834b9dd5-802b-41fc-9c2f-ab4b454219ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:35:06.085373 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4421d2-2574-47ee-b3e4-cc9ace0e8718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:35:06.085995 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4421d2-2574-47ee-b3e4-cc9ace0e8718 admin admin] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:06.086293 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4421d2-2574-47ee-b3e4-cc9ace0e8718 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:06.086560 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4421d2-2574-47ee-b3e4-cc9ace0e8718 admin admin] PATH_INFO: `/v3/users` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:06.087239 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4421d2-2574-47ee-b3e4-cc9ace0e8718 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:35:06.089309 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4421d2-2574-47ee-b3e4-cc9ace0e8718 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:35:06.106129 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834b9dd5-802b-41fc-9c2f-ab4b454219ae admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:35:06.111079 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc0b78f-c522-49d4-a443-975c499cb36e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:35:06.111611 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1251/2541] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 19 10:35:05 2022] POST /identity/v3/users => generated 289 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:35:06.111772 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc0b78f-c522-49d4-a443-975c499cb36e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:06.112019 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc0b78f-c522-49d4-a443-975c499cb36e admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:06.112331 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc0b78f-c522-49d4-a443-975c499cb36e admin admin] PATH_INFO: `/v3/users/f66555915f3b46f0a687df2a69fc7eee` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:06.113492 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc0b78f-c522-49d4-a443-975c499cb36e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f66555915f3b46f0a687df2a69fc7eee)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:35:06.115429 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc0b78f-c522-49d4-a443-975c499cb36e admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:35:06.115636 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4421d2-2574-47ee-b3e4-cc9ace0e8718 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:35:06.126034 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4421d2-2574-47ee-b3e4-cc9ace0e8718 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:35:06.131323 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0294707-5e3c-4282-8d54-fc8128ed9651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:35:06.131918 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0294707-5e3c-4282-8d54-fc8128ed9651 admin admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:06.132227 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0294707-5e3c-4282-8d54-fc8128ed9651 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:06.132508 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0294707-5e3c-4282-8d54-fc8128ed9651 admin admin] PATH_INFO: `/v3/roles` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:06.133144 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0294707-5e3c-4282-8d54-fc8128ed9651 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:35:06.134745 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0294707-5e3c-4282-8d54-fc8128ed9651 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:35:06.146847 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1252/2542] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:35:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 10:35:06.151685 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0294707-5e3c-4282-8d54-fc8128ed9651 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:35:06.161824 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0294707-5e3c-4282-8d54-fc8128ed9651 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:35:06.165967 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-8dc0b78f-c522-49d4-a443-975c499cb36e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f66555915f3b46f0a687df2a69fc7eee'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:06.166585 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5aec50-8815-44c8-95e1-87519fcad8ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:35:06.167226 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5aec50-8815-44c8-95e1-87519fcad8ae admin admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:06.167510 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5aec50-8815-44c8-95e1-87519fcad8ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:06.167786 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5aec50-8815-44c8-95e1-87519fcad8ae admin admin] PATH_INFO: `/v3/roles` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:06.168761 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5aec50-8815-44c8-95e1-87519fcad8ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:35:06.170400 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5aec50-8815-44c8-95e1-87519fcad8ae admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:35:06.173951 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-8dc0b78f-c522-49d4-a443-975c499cb36e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f66555915f3b46f0a687df2a69fc7eee'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:06.174675 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-8dc0b78f-c522-49d4-a443-975c499cb36e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f66555915f3b46f0a687df2a69fc7eee'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:06.175351 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-8dc0b78f-c522-49d4-a443-975c499cb36e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f66555915f3b46f0a687df2a69fc7eee'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:06.180875 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1253/2543] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:35:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 10:35:06.183385 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-8dc0b78f-c522-49d4-a443-975c499cb36e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f66555915f3b46f0a687df2a69fc7eee'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:06.185025 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5aec50-8815-44c8-95e1-87519fcad8ae admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:35:06.187009 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-dd5aec50-8815-44c8-95e1-87519fcad8ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:35:06.201084 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5aec50-8815-44c8-95e1-87519fcad8ae admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:35:06.203098 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1291/2544] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 19 10:35:06 2022] DELETE /identity/v3/users/f66555915f3b46f0a687df2a69fc7eee => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:35:06.209354 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67277a48-7ef9-45dd-bc0e-ec5e78919ed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:35:06.210023 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67277a48-7ef9-45dd-bc0e-ec5e78919ed1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:06.210301 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67277a48-7ef9-45dd-bc0e-ec5e78919ed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:06.210574 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67277a48-7ef9-45dd-bc0e-ec5e78919ed1 admin admin] PATH_INFO: `/v3/projects/de88122d29de47188ac7faeacfd436a3/users/c7aa7ac72fbe40549de8dcf8da904eba/roles/cd5b42ed3b754b58817a62bbe74651b4` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:06.225755 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67277a48-7ef9-45dd-bc0e-ec5e78919ed1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de88122d29de47188ac7faeacfd436a3, user_id=c7aa7ac72fbe40549de8dcf8da904eba, role_id=cd5b42ed3b754b58817a62bbe74651b4)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:35:06.228423 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67277a48-7ef9-45dd-bc0e-ec5e78919ed1 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:35:06.248898 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1254/2545] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 19 10:35:06 2022] PUT /identity/v3/projects/de88122d29de47188ac7faeacfd436a3/users/c7aa7ac72fbe40549de8dcf8da904eba/roles/cd5b42ed3b754b58817a62bbe74651b4 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 10:35:06.261313 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fd0da0-fad2-4ec8-b9a3-f9ab88e59e44 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:06.261606 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fd0da0-fad2-4ec8-b9a3-f9ab88e59e44 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:06.261883 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fd0da0-fad2-4ec8-b9a3-f9ab88e59e44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:06.284083 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=82,keystone:DELETE=15,keystone:INSERT=3 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:35:06.296944 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-45fd0da0-fad2-4ec8-b9a3-f9ab88e59e44 None None] MFA Rules not processed for user `c7aa7ac72fbe40549de8dcf8da904eba`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:35:06.300514 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-45fd0da0-fad2-4ec8-b9a3-f9ab88e59e44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:35:06.370119 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1292/2546] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:35:06 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:35:06.375376 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67277a48-7ef9-45dd-bc0e-ec5e78919ed1 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:35:06.383174 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fd0da0-fad2-4ec8-b9a3-f9ab88e59e44 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:35:06.384898 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-45fd0da0-fad2-4ec8-b9a3-f9ab88e59e44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:35:06.436129 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:35:06.450208 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67277a48-7ef9-45dd-bc0e-ec5e78919ed1 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:35:06.455096 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f601670-2e00-4231-a9af-c475218feef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:35:06.455741 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f601670-2e00-4231-a9af-c475218feef9 admin admin] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:06.456024 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f601670-2e00-4231-a9af-c475218feef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:06.456344 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f601670-2e00-4231-a9af-c475218feef9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:06.456974 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f601670-2e00-4231-a9af-c475218feef9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:35:06.458897 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f601670-2e00-4231-a9af-c475218feef9 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:35:06.468694 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fd0da0-fad2-4ec8-b9a3-f9ab88e59e44 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:35:06.474143 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5013ef1-d08f-4df9-8a5e-65c8755cb087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:35:06.475267 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5013ef1-d08f-4df9-8a5e-65c8755cb087 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:06.475585 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5013ef1-d08f-4df9-8a5e-65c8755cb087 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:06.476217 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5013ef1-d08f-4df9-8a5e-65c8755cb087 admin admin] PATH_INFO: `/v3/projects/2d73df62bc2a44d1976316eaccf2e06c` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:06.477727 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5013ef1-d08f-4df9-8a5e-65c8755cb087 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d73df62bc2a44d1976316eaccf2e06c)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:35:06.479943 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5013ef1-d08f-4df9-8a5e-65c8755cb087 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:35:06.487185 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1255/2547] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 19 10:35:06 2022] POST /identity/v3/projects => generated 377 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:35:06.491170 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f601670-2e00-4231-a9af-c475218feef9 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:35:06.530346 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-e5013ef1-d08f-4df9-8a5e-65c8755cb087 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d73df62bc2a44d1976316eaccf2e06c', 'request_id': 'req-e5013ef1-d08f-4df9-8a5e-65c8755cb087'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:06.536578 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-e5013ef1-d08f-4df9-8a5e-65c8755cb087 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d73df62bc2a44d1976316eaccf2e06c', 'request_id': 'req-e5013ef1-d08f-4df9-8a5e-65c8755cb087'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:06.544736 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-e5013ef1-d08f-4df9-8a5e-65c8755cb087 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d73df62bc2a44d1976316eaccf2e06c', 'request_id': 'req-e5013ef1-d08f-4df9-8a5e-65c8755cb087'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:06.556232 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f601670-2e00-4231-a9af-c475218feef9 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:35:06.556996 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-e5013ef1-d08f-4df9-8a5e-65c8755cb087 admin admin] The token cache is being invalidate because project 2d73df62bc2a44d1976316eaccf2e06c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 10:35:06.557288 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-e5013ef1-d08f-4df9-8a5e-65c8755cb087 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:06.557926 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-e5013ef1-d08f-4df9-8a5e-65c8755cb087 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:06.559415 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1293/2548] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 19 10:35:06 2022] DELETE /identity/v3/projects/2d73df62bc2a44d1976316eaccf2e06c => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 10:35:06.564299 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2998743-d685-45cc-b571-1b99f9a8f327 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:06.564649 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2998743-d685-45cc-b571-1b99f9a8f327 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:06.565583 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2998743-d685-45cc-b571-1b99f9a8f327 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:06.588920 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-b2998743-d685-45cc-b571-1b99f9a8f327 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:35:06.590177 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-b2998743-d685-45cc-b571-1b99f9a8f327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:35:06.617849 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:35:06.618833 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4c520e-d998-4843-b6ee-9632c1583a5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:35:06.619537 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4c520e-d998-4843-b6ee-9632c1583a5a admin admin] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:06.619857 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4c520e-d998-4843-b6ee-9632c1583a5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:06.620184 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4c520e-d998-4843-b6ee-9632c1583a5a admin admin] PATH_INFO: `/v3/users` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:06.620882 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4c520e-d998-4843-b6ee-9632c1583a5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:35:06.623016 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4c520e-d998-4843-b6ee-9632c1583a5a admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:35:06.646329 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1256/2549] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 19 10:35:06 2022] POST /identity/v3/users => generated 295 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 10:35:06.650209 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4c520e-d998-4843-b6ee-9632c1583a5a admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:35:06.651885 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-cf4c520e-d998-4843-b6ee-9632c1583a5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:35:06.657418 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1294/2550] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:35:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 10:35:06.663899 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4c520e-d998-4843-b6ee-9632c1583a5a admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:35:06.665349 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05efd58-8e87-4cc2-bb8b-be8cb1930053 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:06.665641 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05efd58-8e87-4cc2-bb8b-be8cb1930053 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:06.665920 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05efd58-8e87-4cc2-bb8b-be8cb1930053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:06.669845 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbd5a62-b964-46b9-ae4d-68d154452261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:35:06.670456 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbd5a62-b964-46b9-ae4d-68d154452261 admin admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:06.670738 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbd5a62-b964-46b9-ae4d-68d154452261 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:06.671010 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbd5a62-b964-46b9-ae4d-68d154452261 admin admin] PATH_INFO: `/v3/roles` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:06.671655 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbd5a62-b964-46b9-ae4d-68d154452261 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:35:06.673289 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbd5a62-b964-46b9-ae4d-68d154452261 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:35:06.686141 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1257/2551] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:35:06 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 10:35:06.691025 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbd5a62-b964-46b9-ae4d-68d154452261 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:35:06.694850 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-f05efd58-8e87-4cc2-bb8b-be8cb1930053 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:35:06.696208 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-f05efd58-8e87-4cc2-bb8b-be8cb1930053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:35:06.701011 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbd5a62-b964-46b9-ae4d-68d154452261 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:35:06.704186 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1295/2552] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:35:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 10:35:06.706092 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059fae9d-00ab-497a-a61a-b95e25a725a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:35:06.706863 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059fae9d-00ab-497a-a61a-b95e25a725a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:06.707360 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059fae9d-00ab-497a-a61a-b95e25a725a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:06.707712 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059fae9d-00ab-497a-a61a-b95e25a725a3 admin admin] PATH_INFO: `/v3/projects/43b3eae92a8b4cd29a85da4f0f6c091b/users/4f58b07d6a1449c88ba0ac0e1ea95ce3/roles/5c8b89fae4fa45bd944cbeaf442136e1` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:06.708360 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05efd58-8e87-4cc2-bb8b-be8cb1930053 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:35:06.717420 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05efd58-8e87-4cc2-bb8b-be8cb1930053 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:35:06.722585 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bf82ca-6068-4cc0-9789-47f216a82502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:35:06.723186 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bf82ca-6068-4cc0-9789-47f216a82502 admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:06.723487 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bf82ca-6068-4cc0-9789-47f216a82502 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:06.723603 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059fae9d-00ab-497a-a61a-b95e25a725a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43b3eae92a8b4cd29a85da4f0f6c091b, user_id=4f58b07d6a1449c88ba0ac0e1ea95ce3, role_id=5c8b89fae4fa45bd944cbeaf442136e1)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:35:06.723757 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bf82ca-6068-4cc0-9789-47f216a82502 admin admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:06.724425 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bf82ca-6068-4cc0-9789-47f216a82502 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:35:06.724722 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bf82ca-6068-4cc0-9789-47f216a82502 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:35:06.726358 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bf82ca-6068-4cc0-9789-47f216a82502 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:35:06.726479 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059fae9d-00ab-497a-a61a-b95e25a725a3 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:35:06.739191 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1296/2553] 10.222.0.66 () {58 vars in 1153 bytes} [Mon Sep 19 10:35:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 10:35:06.743034 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1258/2554] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 19 10:35:06 2022] PUT /identity/v3/projects/43b3eae92a8b4cd29a85da4f0f6c091b/users/4f58b07d6a1449c88ba0ac0e1ea95ce3/roles/5c8b89fae4fa45bd944cbeaf442136e1 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 10:35:06.743883 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bf82ca-6068-4cc0-9789-47f216a82502 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:35:06.746434 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059fae9d-00ab-497a-a61a-b95e25a725a3 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:35:06.753711 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bf82ca-6068-4cc0-9789-47f216a82502 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:35:06.788777 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:35:06.810304 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059fae9d-00ab-497a-a61a-b95e25a725a3 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:35:06.810764 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba6aca0-a77f-414f-b5c2-c2e2073b25e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:35:06.811373 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba6aca0-a77f-414f-b5c2-c2e2073b25e5 admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:06.811647 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba6aca0-a77f-414f-b5c2-c2e2073b25e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:06.811916 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba6aca0-a77f-414f-b5c2-c2e2073b25e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:06.812578 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba6aca0-a77f-414f-b5c2-c2e2073b25e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:35:06.814464 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba6aca0-a77f-414f-b5c2-c2e2073b25e5 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:35:06.815283 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f88865-717d-465a-8017-898077360f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:35:06.815895 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f88865-717d-465a-8017-898077360f3a admin admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:06.816191 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f88865-717d-465a-8017-898077360f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:06.816478 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f88865-717d-465a-8017-898077360f3a admin admin] PATH_INFO: `/v3/roles` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:06.817128 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f88865-717d-465a-8017-898077360f3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:35:06.818754 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f88865-717d-465a-8017-898077360f3a admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:35:06.829027 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1259/2555] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:35:06 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 10:35:06.833735 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f88865-717d-465a-8017-898077360f3a admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:35:06.841980 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1297/2556] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 19 10:35:06 2022] POST /identity/v3/projects => generated 357 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 10:35:06.845098 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f88865-717d-465a-8017-898077360f3a admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:35:06.846826 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba6aca0-a77f-414f-b5c2-c2e2073b25e5 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:35:06.906353 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d797ce42-f2ea-4381-879c-faccd632a8d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:35:06.907173 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d797ce42-f2ea-4381-879c-faccd632a8d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:06.907457 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d797ce42-f2ea-4381-879c-faccd632a8d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:06.907754 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d797ce42-f2ea-4381-879c-faccd632a8d2 admin admin] PATH_INFO: `/v3/projects/43b3eae92a8b4cd29a85da4f0f6c091b/users/4f58b07d6a1449c88ba0ac0e1ea95ce3/roles/5c8b89fae4fa45bd944cbeaf442136e1` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:06.909861 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba6aca0-a77f-414f-b5c2-c2e2073b25e5 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:35:06.910206 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d797ce42-f2ea-4381-879c-faccd632a8d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43b3eae92a8b4cd29a85da4f0f6c091b, user_id=4f58b07d6a1449c88ba0ac0e1ea95ce3, role_id=5c8b89fae4fa45bd944cbeaf442136e1)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:35:06.912939 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d797ce42-f2ea-4381-879c-faccd632a8d2 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:35:06.914620 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12f197f-224a-4e87-a8b2-55896d5f2456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:35:06.915228 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12f197f-224a-4e87-a8b2-55896d5f2456 admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:06.915509 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12f197f-224a-4e87-a8b2-55896d5f2456 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:06.916031 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12f197f-224a-4e87-a8b2-55896d5f2456 admin admin] PATH_INFO: `/v3/users` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:06.916448 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12f197f-224a-4e87-a8b2-55896d5f2456 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:35:06.918363 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12f197f-224a-4e87-a8b2-55896d5f2456 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:35:06.923579 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1260/2557] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 19 10:35:06 2022] PUT /identity/v3/projects/43b3eae92a8b4cd29a85da4f0f6c091b/users/4f58b07d6a1449c88ba0ac0e1ea95ce3/roles/5c8b89fae4fa45bd944cbeaf442136e1 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:35:06.934863 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852203d8-31fd-400e-9c1d-6e4a71d5ffaf None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:06.935219 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852203d8-31fd-400e-9c1d-6e4a71d5ffaf None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:06.935539 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852203d8-31fd-400e-9c1d-6e4a71d5ffaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:06.941273 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1298/2558] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 19 10:35:06 2022] POST /identity/v3/users => generated 279 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 10:35:06.945622 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12f197f-224a-4e87-a8b2-55896d5f2456 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:35:06.955999 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12f197f-224a-4e87-a8b2-55896d5f2456 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:35:06.964494 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-852203d8-31fd-400e-9c1d-6e4a71d5ffaf None None] MFA Rules not processed for user `4f58b07d6a1449c88ba0ac0e1ea95ce3`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:35:06.965734 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-852203d8-31fd-400e-9c1d-6e4a71d5ffaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:35:06.980953 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:35:07.014141 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714622f8-fdd9-408f-bf4a-a930d10fcf4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:35:07.014883 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714622f8-fdd9-408f-bf4a-a930d10fcf4a admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:07.015199 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714622f8-fdd9-408f-bf4a-a930d10fcf4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:07.015481 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714622f8-fdd9-408f-bf4a-a930d10fcf4a admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:07.016122 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714622f8-fdd9-408f-bf4a-a930d10fcf4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:35:07.017776 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714622f8-fdd9-408f-bf4a-a930d10fcf4a admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:35:07.028402 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1299/2559] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:35:06 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 10:35:07.032373 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714622f8-fdd9-408f-bf4a-a930d10fcf4a admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:35:07.037093 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1261/2560] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:35:06 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:35:07.043204 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714622f8-fdd9-408f-bf4a-a930d10fcf4a admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:35:07.047980 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d3e8e2-90e3-4bef-877f-ed97aa995117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:35:07.048380 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852203d8-31fd-400e-9c1d-6e4a71d5ffaf None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:35:07.048625 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d3e8e2-90e3-4bef-877f-ed97aa995117 admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:07.048909 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d3e8e2-90e3-4bef-877f-ed97aa995117 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:07.049993 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d3e8e2-90e3-4bef-877f-ed97aa995117 admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:07.050370 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-852203d8-31fd-400e-9c1d-6e4a71d5ffaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:35:07.050664 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d3e8e2-90e3-4bef-877f-ed97aa995117 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:35:07.052273 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d3e8e2-90e3-4bef-877f-ed97aa995117 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:35:07.063308 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1300/2561] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:35:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 10:35:07.067469 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d3e8e2-90e3-4bef-877f-ed97aa995117 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:35:07.077238 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d3e8e2-90e3-4bef-877f-ed97aa995117 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:35:07.082533 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29776e4-334f-4635-91ff-109e124f5d8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:35:07.083180 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29776e4-334f-4635-91ff-109e124f5d8d admin admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:07.083462 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29776e4-334f-4635-91ff-109e124f5d8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:07.083746 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29776e4-334f-4635-91ff-109e124f5d8d admin admin] PATH_INFO: `/v3/projects/8cc2235f5c554f15a369e7bfaaa229e3/users/a498ad140aa943c9b3cea54a880d2973/roles/cd5b42ed3b754b58817a62bbe74651b4` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:07.100692 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29776e4-334f-4635-91ff-109e124f5d8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8cc2235f5c554f15a369e7bfaaa229e3, user_id=a498ad140aa943c9b3cea54a880d2973, role_id=cd5b42ed3b754b58817a62bbe74651b4)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:35:07.104435 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29776e4-334f-4635-91ff-109e124f5d8d admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:35:07.112879 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852203d8-31fd-400e-9c1d-6e4a71d5ffaf None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:35:07.119170 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1301/2562] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 19 10:35:07 2022] PUT /identity/v3/projects/8cc2235f5c554f15a369e7bfaaa229e3/users/a498ad140aa943c9b3cea54a880d2973/roles/cd5b42ed3b754b58817a62bbe74651b4 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 10:35:07.120911 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:35:07.129841 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14094723-9134-473a-9a39-f2512d029213 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:07.130634 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14094723-9134-473a-9a39-f2512d029213 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:07.131021 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14094723-9134-473a-9a39-f2512d029213 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:07.164486 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-14094723-9134-473a-9a39-f2512d029213 None None] MFA Rules not processed for user `a498ad140aa943c9b3cea54a880d2973`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:35:07.165773 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-14094723-9134-473a-9a39-f2512d029213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:35:07.169570 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efd1e9c-84f5-4701-be63-ac057532196a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa4d004fd44482cae761c4b3bdfab31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:35:07.170197 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efd1e9c-84f5-4701-be63-ac057532196a service cinder] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:07.170479 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efd1e9c-84f5-4701-be63-ac057532196a service cinder] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:07.170751 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efd1e9c-84f5-4701-be63-ac057532196a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:07.172589 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-8efd1e9c-84f5-4701-be63-ac057532196a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:35:07.232988 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1302/2563] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:35:07 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:35:07.236987 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efd1e9c-84f5-4701-be63-ac057532196a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:35:07.237290 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14094723-9134-473a-9a39-f2512d029213 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:35:07.238496 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efd1e9c-84f5-4701-be63-ac057532196a service cinder] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:35:07.248313 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1262/2564] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:35:07 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 10:35:07.308903 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14094723-9134-473a-9a39-f2512d029213 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:35:07.313646 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130c204f-30d4-40b3-880e-d3fb710989ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:35:07.314260 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130c204f-30d4-40b3-880e-d3fb710989ee admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:07.314541 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130c204f-30d4-40b3-880e-d3fb710989ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:07.314846 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130c204f-30d4-40b3-880e-d3fb710989ee admin admin] PATH_INFO: `/v3/projects` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:07.315480 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130c204f-30d4-40b3-880e-d3fb710989ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:35:07.317440 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130c204f-30d4-40b3-880e-d3fb710989ee admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:35:07.353210 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1303/2565] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 19 10:35:07 2022] POST /identity/v3/projects => generated 357 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 10:35:07.357198 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efd1e9c-84f5-4701-be63-ac057532196a service cinder] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:35:07.369583 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efd1e9c-84f5-4701-be63-ac057532196a service cinder] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:35:07.431493 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6585dc-0dae-4fae-995a-d1c0e9cf3350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:35:07.432318 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6585dc-0dae-4fae-995a-d1c0e9cf3350 admin admin] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:07.432591 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6585dc-0dae-4fae-995a-d1c0e9cf3350 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:07.432862 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6585dc-0dae-4fae-995a-d1c0e9cf3350 admin admin] PATH_INFO: `/v3/users` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:07.433531 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6585dc-0dae-4fae-995a-d1c0e9cf3350 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:35:07.435579 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6585dc-0dae-4fae-995a-d1c0e9cf3350 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:35:07.463087 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1263/2566] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 19 10:35:07 2022] POST /identity/v3/users => generated 285 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 10:35:07.464126 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130c204f-30d4-40b3-880e-d3fb710989ee admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:35:07.470914 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:35:07.477733 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130c204f-30d4-40b3-880e-d3fb710989ee admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:35:07.483511 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0155638d-7337-4465-9832-8b32b5fb8a7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:35:07.484066 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0155638d-7337-4465-9832-8b32b5fb8a7f admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:07.484413 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0155638d-7337-4465-9832-8b32b5fb8a7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:07.484739 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0155638d-7337-4465-9832-8b32b5fb8a7f admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:07.485473 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0155638d-7337-4465-9832-8b32b5fb8a7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:35:07.487185 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0155638d-7337-4465-9832-8b32b5fb8a7f admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:35:07.497591 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1304/2567] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:35:07 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 10:35:07.503214 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6585dc-0dae-4fae-995a-d1c0e9cf3350 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:35:07.513783 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6585dc-0dae-4fae-995a-d1c0e9cf3350 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:35:07.519401 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1311713b-34dd-403c-9d88-bef4633cc892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:35:07.520380 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1311713b-34dd-403c-9d88-bef4633cc892 admin admin] REQUEST_METHOD: `PUT` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:07.520502 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1311713b-34dd-403c-9d88-bef4633cc892 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:07.520777 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1311713b-34dd-403c-9d88-bef4633cc892 admin admin] PATH_INFO: `/v3/projects/cf0c49a29f8f4a86ae81217445315e35/users/3a6c800927a54e529c216c5561f0c697/roles/5c8b89fae4fa45bd944cbeaf442136e1` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:07.541264 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1311713b-34dd-403c-9d88-bef4633cc892 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf0c49a29f8f4a86ae81217445315e35, user_id=3a6c800927a54e529c216c5561f0c697, role_id=5c8b89fae4fa45bd944cbeaf442136e1)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:35:07.544206 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1311713b-34dd-403c-9d88-bef4633cc892 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:35:07.558699 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1264/2568] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 19 10:35:07 2022] PUT /identity/v3/projects/cf0c49a29f8f4a86ae81217445315e35/users/3a6c800927a54e529c216c5561f0c697/roles/5c8b89fae4fa45bd944cbeaf442136e1 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:35:07.563017 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0155638d-7337-4465-9832-8b32b5fb8a7f admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:35:07.576732 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0155638d-7337-4465-9832-8b32b5fb8a7f admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:35:07.640304 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eda5a80-4147-4ee7-8058-85d9af3cec5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:35:07.640920 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eda5a80-4147-4ee7-8058-85d9af3cec5f admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:07.641176 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eda5a80-4147-4ee7-8058-85d9af3cec5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:07.641509 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eda5a80-4147-4ee7-8058-85d9af3cec5f admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:07.642148 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eda5a80-4147-4ee7-8058-85d9af3cec5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:35:07.644551 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eda5a80-4147-4ee7-8058-85d9af3cec5f admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:35:07.654360 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1305/2569] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:35:07 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 10:35:07.658747 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1311713b-34dd-403c-9d88-bef4633cc892 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:35:07.672454 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1311713b-34dd-403c-9d88-bef4633cc892 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:35:07.677267 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e2d56c-f8f6-438f-b678-6a7ab4cca4b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:35:07.677943 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e2d56c-f8f6-438f-b678-6a7ab4cca4b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:07.678200 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e2d56c-f8f6-438f-b678-6a7ab4cca4b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:07.678470 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e2d56c-f8f6-438f-b678-6a7ab4cca4b6 admin admin] PATH_INFO: `/v3/projects/cf0c49a29f8f4a86ae81217445315e35/users/3a6c800927a54e529c216c5561f0c697/roles/5c8b89fae4fa45bd944cbeaf442136e1` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:07.680389 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e2d56c-f8f6-438f-b678-6a7ab4cca4b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf0c49a29f8f4a86ae81217445315e35, user_id=3a6c800927a54e529c216c5561f0c697, role_id=5c8b89fae4fa45bd944cbeaf442136e1)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:35:07.683014 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e2d56c-f8f6-438f-b678-6a7ab4cca4b6 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:35:07.694350 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1265/2570] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 19 10:35:07 2022] PUT /identity/v3/projects/cf0c49a29f8f4a86ae81217445315e35/users/3a6c800927a54e529c216c5561f0c697/roles/5c8b89fae4fa45bd944cbeaf442136e1 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:35:07.706616 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200fabe2-d9e0-44c0-9865-4eaa979910b6 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:07.706902 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200fabe2-d9e0-44c0-9865-4eaa979910b6 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:07.707174 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200fabe2-d9e0-44c0-9865-4eaa979910b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:07.734724 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-200fabe2-d9e0-44c0-9865-4eaa979910b6 None None] MFA Rules not processed for user `3a6c800927a54e529c216c5561f0c697`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:35:07.735854 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-200fabe2-d9e0-44c0-9865-4eaa979910b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:35:07.803996 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1306/2571] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:35:07 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:35:07.816190 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e2d56c-f8f6-438f-b678-6a7ab4cca4b6 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:35:07.836901 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:35:07.873417 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e2d56c-f8f6-438f-b678-6a7ab4cca4b6 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:35:07.877074 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c77a957-2372-4130-8ff3-e8f77ed12516 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa4d004fd44482cae761c4b3bdfab31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:35:07.878293 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c77a957-2372-4130-8ff3-e8f77ed12516 service cinder] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:07.878569 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c77a957-2372-4130-8ff3-e8f77ed12516 service cinder] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:07.878837 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c77a957-2372-4130-8ff3-e8f77ed12516 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:07.889977 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c77a957-2372-4130-8ff3-e8f77ed12516 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:35:07.891417 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c77a957-2372-4130-8ff3-e8f77ed12516 service cinder] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:35:07.901019 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1266/2572] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:35:07 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:35:07.977521 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200fabe2-d9e0-44c0-9865-4eaa979910b6 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:35:07.987651 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200fabe2-d9e0-44c0-9865-4eaa979910b6 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:35:07.991742 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37267eaa-b724-4dde-b632-31567ad6120b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa4d004fd44482cae761c4b3bdfab31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:35:07.992441 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37267eaa-b724-4dde-b632-31567ad6120b service cinder] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:07.992783 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37267eaa-b724-4dde-b632-31567ad6120b service cinder] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:07.993102 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37267eaa-b724-4dde-b632-31567ad6120b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:08.050564 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37267eaa-b724-4dde-b632-31567ad6120b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:35:08.052028 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37267eaa-b724-4dde-b632-31567ad6120b service cinder] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:35:08.061068 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1307/2573] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:35:07 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:35:08.650435 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c77a957-2372-4130-8ff3-e8f77ed12516 service cinder] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:35:08.652070 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-2c77a957-2372-4130-8ff3-e8f77ed12516 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:35:08.664000 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c77a957-2372-4130-8ff3-e8f77ed12516 service cinder] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:35:08.667569 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7194549f-ce64-4d05-b602-b5ea853ea354 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa4d004fd44482cae761c4b3bdfab31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:35:08.668196 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7194549f-ce64-4d05-b602-b5ea853ea354 service cinder] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:08.668714 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7194549f-ce64-4d05-b602-b5ea853ea354 service cinder] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:08.668983 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7194549f-ce64-4d05-b602-b5ea853ea354 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:08.729643 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7194549f-ce64-4d05-b602-b5ea853ea354 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:35:08.731083 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7194549f-ce64-4d05-b602-b5ea853ea354 service cinder] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:35:08.740538 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1267/2574] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:35:08 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:35:12.520951 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37267eaa-b724-4dde-b632-31567ad6120b service cinder] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:35:12.535368 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:35:12.594106 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37267eaa-b724-4dde-b632-31567ad6120b service cinder] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:35:12.599013 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d24ce6-c7ce-4fb7-949c-969c798a5da5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:35:12.599999 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d24ce6-c7ce-4fb7-949c-969c798a5da5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:12.600325 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d24ce6-c7ce-4fb7-949c-969c798a5da5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:12.601992 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d24ce6-c7ce-4fb7-949c-969c798a5da5 admin admin] PATH_INFO: `/v3/users/c7aa7ac72fbe40549de8dcf8da904eba` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:12.601992 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d24ce6-c7ce-4fb7-949c-969c798a5da5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7aa7ac72fbe40549de8dcf8da904eba)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:35:12.604410 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d24ce6-c7ce-4fb7-949c-969c798a5da5 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:35:12.660557 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-92d24ce6-c7ce-4fb7-949c-969c798a5da5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7aa7ac72fbe40549de8dcf8da904eba'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:12.668771 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-92d24ce6-c7ce-4fb7-949c-969c798a5da5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7aa7ac72fbe40549de8dcf8da904eba'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:12.669430 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-92d24ce6-c7ce-4fb7-949c-969c798a5da5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7aa7ac72fbe40549de8dcf8da904eba'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:12.670248 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-92d24ce6-c7ce-4fb7-949c-969c798a5da5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7aa7ac72fbe40549de8dcf8da904eba'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:12.681032 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-92d24ce6-c7ce-4fb7-949c-969c798a5da5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7aa7ac72fbe40549de8dcf8da904eba'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:12.701169 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1308/2575] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 19 10:35:12 2022] DELETE /identity/v3/users/c7aa7ac72fbe40549de8dcf8da904eba => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:35:12.705694 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde30344-48f3-46b1-ab40-9f0af2132390 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:12.706164 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde30344-48f3-46b1-ab40-9f0af2132390 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:12.706278 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde30344-48f3-46b1-ab40-9f0af2132390 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:12.726585 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-dde30344-48f3-46b1-ab40-9f0af2132390 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:35:12.727719 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-dde30344-48f3-46b1-ab40-9f0af2132390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:35:12.807013 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1268/2576] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:35:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:35:12.817165 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d24ce6-c7ce-4fb7-949c-969c798a5da5 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:35:12.818916 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-92d24ce6-c7ce-4fb7-949c-969c798a5da5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:35:12.890207 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d24ce6-c7ce-4fb7-949c-969c798a5da5 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:35:12.895667 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343bf562-e15a-43ce-be58-24fb19da68ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c1289b015854c6bb6aee8fed6b807db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:35:12.896768 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343bf562-e15a-43ce-be58-24fb19da68ad service neutron] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:12.897139 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343bf562-e15a-43ce-be58-24fb19da68ad service neutron] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:12.897499 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343bf562-e15a-43ce-be58-24fb19da68ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:12.908677 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343bf562-e15a-43ce-be58-24fb19da68ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:35:12.910308 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343bf562-e15a-43ce-be58-24fb19da68ad service neutron] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:35:12.921138 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1309/2577] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:35:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:35:13.493371 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde30344-48f3-46b1-ab40-9f0af2132390 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:35:13.495059 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-dde30344-48f3-46b1-ab40-9f0af2132390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:35:13.508519 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde30344-48f3-46b1-ab40-9f0af2132390 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:35:13.519887 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c57ccd9-9bb3-4ae3-acc6-eba992d08824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:35:13.520525 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c57ccd9-9bb3-4ae3-acc6-eba992d08824 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:13.520805 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c57ccd9-9bb3-4ae3-acc6-eba992d08824 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:13.521188 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c57ccd9-9bb3-4ae3-acc6-eba992d08824 admin admin] PATH_INFO: `/v3/projects/de88122d29de47188ac7faeacfd436a3` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:13.522726 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c57ccd9-9bb3-4ae3-acc6-eba992d08824 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de88122d29de47188ac7faeacfd436a3)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:35:13.524728 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c57ccd9-9bb3-4ae3-acc6-eba992d08824 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:35:13.579692 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-1c57ccd9-9bb3-4ae3-acc6-eba992d08824 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de88122d29de47188ac7faeacfd436a3', 'request_id': 'req-1c57ccd9-9bb3-4ae3-acc6-eba992d08824'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:13.581429 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:35:13.588609 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-1c57ccd9-9bb3-4ae3-acc6-eba992d08824 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de88122d29de47188ac7faeacfd436a3', 'request_id': 'req-1c57ccd9-9bb3-4ae3-acc6-eba992d08824'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:13.596260 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-1c57ccd9-9bb3-4ae3-acc6-eba992d08824 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de88122d29de47188ac7faeacfd436a3', 'request_id': 'req-1c57ccd9-9bb3-4ae3-acc6-eba992d08824'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:13.607152 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-1c57ccd9-9bb3-4ae3-acc6-eba992d08824 admin admin] The token cache is being invalidate because project de88122d29de47188ac7faeacfd436a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 10:35:13.607467 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-1c57ccd9-9bb3-4ae3-acc6-eba992d08824 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:13.608228 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-1c57ccd9-9bb3-4ae3-acc6-eba992d08824 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:13.609944 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1269/2578] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 19 10:35:13 2022] DELETE /identity/v3/projects/de88122d29de47188ac7faeacfd436a3 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:35:13.614307 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343bf562-e15a-43ce-be58-24fb19da68ad service neutron] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:35:13.624380 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343bf562-e15a-43ce-be58-24fb19da68ad service neutron] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:35:13.656235 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:35:13.692839 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc78d99-6d0d-4609-bea4-fd6a411eb7ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:35:13.693319 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc78d99-6d0d-4609-bea4-fd6a411eb7ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:13.693598 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc78d99-6d0d-4609-bea4-fd6a411eb7ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:13.693948 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc78d99-6d0d-4609-bea4-fd6a411eb7ed admin admin] PATH_INFO: `/v3/users/4f58b07d6a1449c88ba0ac0e1ea95ce3` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:13.695034 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc78d99-6d0d-4609-bea4-fd6a411eb7ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f58b07d6a1449c88ba0ac0e1ea95ce3)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:35:13.697023 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc78d99-6d0d-4609-bea4-fd6a411eb7ed admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:35:13.749197 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-ddc78d99-6d0d-4609-bea4-fd6a411eb7ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f58b07d6a1449c88ba0ac0e1ea95ce3'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:13.757306 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-ddc78d99-6d0d-4609-bea4-fd6a411eb7ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f58b07d6a1449c88ba0ac0e1ea95ce3'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:13.757916 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-ddc78d99-6d0d-4609-bea4-fd6a411eb7ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f58b07d6a1449c88ba0ac0e1ea95ce3'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:13.758509 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-ddc78d99-6d0d-4609-bea4-fd6a411eb7ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f58b07d6a1449c88ba0ac0e1ea95ce3'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:13.765657 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-ddc78d99-6d0d-4609-bea4-fd6a411eb7ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f58b07d6a1449c88ba0ac0e1ea95ce3'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:13.783497 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1310/2579] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 19 10:35:13 2022] DELETE /identity/v3/users/4f58b07d6a1449c88ba0ac0e1ea95ce3 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:35:14.066376 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c57ccd9-9bb3-4ae3-acc6-eba992d08824 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:35:14.067859 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-1c57ccd9-9bb3-4ae3-acc6-eba992d08824 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:35:14.081883 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c57ccd9-9bb3-4ae3-acc6-eba992d08824 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:35:14.139097 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c760a5-73ee-415b-b575-71b3a64e5dc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:35:14.139752 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c760a5-73ee-415b-b575-71b3a64e5dc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:14.140035 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c760a5-73ee-415b-b575-71b3a64e5dc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:14.140346 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c760a5-73ee-415b-b575-71b3a64e5dc6 admin admin] PATH_INFO: `/v3/projects/43b3eae92a8b4cd29a85da4f0f6c091b` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:14.141458 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c760a5-73ee-415b-b575-71b3a64e5dc6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=43b3eae92a8b4cd29a85da4f0f6c091b)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:35:14.143386 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c760a5-73ee-415b-b575-71b3a64e5dc6 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:35:14.189288 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-e4c760a5-73ee-415b-b575-71b3a64e5dc6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43b3eae92a8b4cd29a85da4f0f6c091b', 'request_id': 'req-e4c760a5-73ee-415b-b575-71b3a64e5dc6'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:14.196144 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-e4c760a5-73ee-415b-b575-71b3a64e5dc6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43b3eae92a8b4cd29a85da4f0f6c091b', 'request_id': 'req-e4c760a5-73ee-415b-b575-71b3a64e5dc6'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:14.203098 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-e4c760a5-73ee-415b-b575-71b3a64e5dc6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43b3eae92a8b4cd29a85da4f0f6c091b', 'request_id': 'req-e4c760a5-73ee-415b-b575-71b3a64e5dc6'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:14.213619 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-e4c760a5-73ee-415b-b575-71b3a64e5dc6 admin admin] The token cache is being invalidate because project 43b3eae92a8b4cd29a85da4f0f6c091b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 10:35:14.213904 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-e4c760a5-73ee-415b-b575-71b3a64e5dc6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:14.214550 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-e4c760a5-73ee-415b-b575-71b3a64e5dc6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:14.216026 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1270/2580] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 19 10:35:14 2022] DELETE /identity/v3/projects/43b3eae92a8b4cd29a85da4f0f6c091b => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:35:14.221456 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa15b3b-6fd8-4009-8273-d6753c8bd271 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:14.221738 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa15b3b-6fd8-4009-8273-d6753c8bd271 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:14.222038 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa15b3b-6fd8-4009-8273-d6753c8bd271 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:14.243592 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-afa15b3b-6fd8-4009-8273-d6753c8bd271 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:35:14.244869 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-afa15b3b-6fd8-4009-8273-d6753c8bd271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:35:14.431253 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1311/2581] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:35:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:35:14.439015 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5eefb7-5940-49e0-9c83-af839c2ae74f None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:14.439318 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5eefb7-5940-49e0-9c83-af839c2ae74f None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:14.439592 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5eefb7-5940-49e0-9c83-af839c2ae74f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:14.460066 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-9f5eefb7-5940-49e0-9c83-af839c2ae74f None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:35:14.463648 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-9f5eefb7-5940-49e0-9c83-af839c2ae74f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:35:14.468762 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1271/2582] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:35:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:35:14.473682 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa15b3b-6fd8-4009-8273-d6753c8bd271 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:35:14.483646 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa15b3b-6fd8-4009-8273-d6753c8bd271 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:35:14.490112 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37822cc-9bdc-476c-ba7e-1de9c055e8f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:35:14.490737 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37822cc-9bdc-476c-ba7e-1de9c055e8f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:14.491011 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37822cc-9bdc-476c-ba7e-1de9c055e8f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:14.491301 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37822cc-9bdc-476c-ba7e-1de9c055e8f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:14.491941 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37822cc-9bdc-476c-ba7e-1de9c055e8f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:35:14.492264 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37822cc-9bdc-476c-ba7e-1de9c055e8f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:35:14.493834 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37822cc-9bdc-476c-ba7e-1de9c055e8f8 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:35:14.505732 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1312/2583] 10.222.0.66 () {58 vars in 1153 bytes} [Mon Sep 19 10:35:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 10:35:14.510067 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5eefb7-5940-49e0-9c83-af839c2ae74f None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:35:14.519311 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5eefb7-5940-49e0-9c83-af839c2ae74f None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:35:14.524051 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8db41b4-66ac-4c21-903b-9b59cfb59c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:35:14.524682 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8db41b4-66ac-4c21-903b-9b59cfb59c5f admin admin] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:14.524969 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8db41b4-66ac-4c21-903b-9b59cfb59c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:14.525243 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8db41b4-66ac-4c21-903b-9b59cfb59c5f admin admin] PATH_INFO: `/v3/projects` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:14.525904 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8db41b4-66ac-4c21-903b-9b59cfb59c5f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:35:14.527850 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8db41b4-66ac-4c21-903b-9b59cfb59c5f admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:35:14.557281 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1272/2584] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 19 10:35:14 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 10:35:14.563345 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37822cc-9bdc-476c-ba7e-1de9c055e8f8 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:35:14.573708 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37822cc-9bdc-476c-ba7e-1de9c055e8f8 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:35:14.614954 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:35:14.636844 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f0a3f5-ff9e-4288-9747-49cdf57e25a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:35:14.637343 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f0a3f5-ff9e-4288-9747-49cdf57e25a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:14.637767 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f0a3f5-ff9e-4288-9747-49cdf57e25a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:14.638040 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f0a3f5-ff9e-4288-9747-49cdf57e25a6 admin admin] PATH_INFO: `/v3/users` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:14.639136 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f0a3f5-ff9e-4288-9747-49cdf57e25a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:35:14.640596 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f0a3f5-ff9e-4288-9747-49cdf57e25a6 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:35:14.663302 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1313/2585] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 19 10:35:14 2022] POST /identity/v3/users => generated 293 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:35:14.667469 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8db41b4-66ac-4c21-903b-9b59cfb59c5f admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:35:14.678717 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8db41b4-66ac-4c21-903b-9b59cfb59c5f admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:35:14.683602 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac78158-961d-48a1-9c87-57ad24ca4051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:35:14.684242 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac78158-961d-48a1-9c87-57ad24ca4051 admin admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:14.684600 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac78158-961d-48a1-9c87-57ad24ca4051 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:14.684929 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac78158-961d-48a1-9c87-57ad24ca4051 admin admin] PATH_INFO: `/v3/roles` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:14.685571 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac78158-961d-48a1-9c87-57ad24ca4051 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:35:14.687184 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac78158-961d-48a1-9c87-57ad24ca4051 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:35:14.701581 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1273/2586] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:35:14 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 10:35:14.702724 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f0a3f5-ff9e-4288-9747-49cdf57e25a6 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:35:14.713980 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f0a3f5-ff9e-4288-9747-49cdf57e25a6 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:35:14.718614 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e94b16-1d17-492f-85e6-d28b4964094b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:35:14.719205 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e94b16-1d17-492f-85e6-d28b4964094b admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:14.719486 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e94b16-1d17-492f-85e6-d28b4964094b admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:14.719758 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e94b16-1d17-492f-85e6-d28b4964094b admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:14.720417 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e94b16-1d17-492f-85e6-d28b4964094b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:35:14.722582 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e94b16-1d17-492f-85e6-d28b4964094b admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:35:14.733442 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1314/2587] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:35:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 10:35:14.739635 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac78158-961d-48a1-9c87-57ad24ca4051 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:35:14.750287 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac78158-961d-48a1-9c87-57ad24ca4051 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:35:14.755847 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adee63b-8e03-47d6-9280-62a0478a566f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:35:14.756534 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adee63b-8e03-47d6-9280-62a0478a566f admin admin] REQUEST_METHOD: `PUT` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:14.756828 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adee63b-8e03-47d6-9280-62a0478a566f admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:14.757104 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adee63b-8e03-47d6-9280-62a0478a566f admin admin] PATH_INFO: `/v3/projects/34c36c9ab87a4d40b2e9b42e0976c1b4/users/822884dac43149e4bbb375ded123e350/roles/cd5b42ed3b754b58817a62bbe74651b4` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:14.772922 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adee63b-8e03-47d6-9280-62a0478a566f admin admin] RBAC: Authorizing `identity:create_grant(project_id=34c36c9ab87a4d40b2e9b42e0976c1b4, user_id=822884dac43149e4bbb375ded123e350, role_id=cd5b42ed3b754b58817a62bbe74651b4)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:35:14.775876 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adee63b-8e03-47d6-9280-62a0478a566f admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:35:14.795470 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1274/2588] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 19 10:35:14 2022] PUT /identity/v3/projects/34c36c9ab87a4d40b2e9b42e0976c1b4/users/822884dac43149e4bbb375ded123e350/roles/cd5b42ed3b754b58817a62bbe74651b4 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:35:14.805972 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee5a2cb-1edd-494f-8bb0-b81db7864b97 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:14.806281 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee5a2cb-1edd-494f-8bb0-b81db7864b97 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:14.806552 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee5a2cb-1edd-494f-8bb0-b81db7864b97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:14.838478 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-6ee5a2cb-1edd-494f-8bb0-b81db7864b97 None None] MFA Rules not processed for user `822884dac43149e4bbb375ded123e350`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:35:14.839774 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-6ee5a2cb-1edd-494f-8bb0-b81db7864b97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:35:14.909350 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1315/2589] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:35:14 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:35:14.913888 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adee63b-8e03-47d6-9280-62a0478a566f admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:35:14.919731 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:35:14.982999 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adee63b-8e03-47d6-9280-62a0478a566f admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:35:14.987968 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef43796-3d8f-44d4-8fc2-ad091b768989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:35:14.988611 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef43796-3d8f-44d4-8fc2-ad091b768989 admin admin] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:14.988893 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef43796-3d8f-44d4-8fc2-ad091b768989 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:14.989164 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef43796-3d8f-44d4-8fc2-ad091b768989 admin admin] PATH_INFO: `/v3/projects` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:14.989798 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef43796-3d8f-44d4-8fc2-ad091b768989 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:35:14.991729 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef43796-3d8f-44d4-8fc2-ad091b768989 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:35:15.030773 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1275/2590] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 19 10:35:14 2022] POST /identity/v3/projects => generated 387 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:35:15.040397 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee5a2cb-1edd-494f-8bb0-b81db7864b97 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:35:15.048862 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee5a2cb-1edd-494f-8bb0-b81db7864b97 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:35:15.106817 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7186fad-4b5c-476c-92df-ff58f4100b5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:35:15.107419 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7186fad-4b5c-476c-92df-ff58f4100b5a admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:15.107700 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7186fad-4b5c-476c-92df-ff58f4100b5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:15.107974 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7186fad-4b5c-476c-92df-ff58f4100b5a admin admin] PATH_INFO: `/v3/users` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:15.109225 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7186fad-4b5c-476c-92df-ff58f4100b5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:35:15.110547 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7186fad-4b5c-476c-92df-ff58f4100b5a admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:35:15.131848 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1316/2591] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 19 10:35:15 2022] POST /identity/v3/users => generated 300 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:35:15.135884 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef43796-3d8f-44d4-8fc2-ad091b768989 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:35:15.146932 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef43796-3d8f-44d4-8fc2-ad091b768989 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:35:15.151570 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea6974e-db34-4ec7-9658-f963ee59a7b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:35:15.152242 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea6974e-db34-4ec7-9658-f963ee59a7b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:15.152545 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea6974e-db34-4ec7-9658-f963ee59a7b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:15.152804 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea6974e-db34-4ec7-9658-f963ee59a7b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:15.153552 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea6974e-db34-4ec7-9658-f963ee59a7b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:35:15.155946 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea6974e-db34-4ec7-9658-f963ee59a7b5 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:35:15.167792 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1276/2592] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:35:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 10:35:15.172490 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7186fad-4b5c-476c-92df-ff58f4100b5a admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:35:15.182280 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7186fad-4b5c-476c-92df-ff58f4100b5a admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:35:15.186840 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa4e42e-6c64-4123-8b30-b28f2601feca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:35:15.187481 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa4e42e-6c64-4123-8b30-b28f2601feca admin admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:15.187759 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa4e42e-6c64-4123-8b30-b28f2601feca admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:15.188029 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa4e42e-6c64-4123-8b30-b28f2601feca admin admin] PATH_INFO: `/v3/projects/1d8d293ccdb3421981361dfb4e27a781/users/25ed17fe4d4f4d8d85f81d7c14240bf0/roles/5c8b89fae4fa45bd944cbeaf442136e1` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:15.202740 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa4e42e-6c64-4123-8b30-b28f2601feca admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d8d293ccdb3421981361dfb4e27a781, user_id=25ed17fe4d4f4d8d85f81d7c14240bf0, role_id=5c8b89fae4fa45bd944cbeaf442136e1)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:35:15.206035 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa4e42e-6c64-4123-8b30-b28f2601feca admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:35:15.218286 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1317/2593] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 19 10:35:15 2022] PUT /identity/v3/projects/1d8d293ccdb3421981361dfb4e27a781/users/25ed17fe4d4f4d8d85f81d7c14240bf0/roles/5c8b89fae4fa45bd944cbeaf442136e1 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:35:15.222652 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea6974e-db34-4ec7-9658-f963ee59a7b5 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:35:15.232843 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea6974e-db34-4ec7-9658-f963ee59a7b5 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:35:15.290147 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19bfd57-e14d-424f-8d7d-e572a361a196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:35:15.290752 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19bfd57-e14d-424f-8d7d-e572a361a196 admin admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:15.291030 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19bfd57-e14d-424f-8d7d-e572a361a196 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:15.291299 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19bfd57-e14d-424f-8d7d-e572a361a196 admin admin] PATH_INFO: `/v3/roles` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:15.291926 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19bfd57-e14d-424f-8d7d-e572a361a196 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:35:15.293823 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19bfd57-e14d-424f-8d7d-e572a361a196 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:35:15.303790 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1277/2594] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:35:15 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 10:35:15.308006 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa4e42e-6c64-4123-8b30-b28f2601feca admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:35:15.318735 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa4e42e-6c64-4123-8b30-b28f2601feca admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:35:15.323309 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ced99a7-2bb6-4f9a-a1a3-c473a856a194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:35:15.323935 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ced99a7-2bb6-4f9a-a1a3-c473a856a194 admin admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:15.324250 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ced99a7-2bb6-4f9a-a1a3-c473a856a194 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:15.324523 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ced99a7-2bb6-4f9a-a1a3-c473a856a194 admin admin] PATH_INFO: `/v3/projects/1d8d293ccdb3421981361dfb4e27a781/users/25ed17fe4d4f4d8d85f81d7c14240bf0/roles/5c8b89fae4fa45bd944cbeaf442136e1` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:15.326429 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ced99a7-2bb6-4f9a-a1a3-c473a856a194 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d8d293ccdb3421981361dfb4e27a781, user_id=25ed17fe4d4f4d8d85f81d7c14240bf0, role_id=5c8b89fae4fa45bd944cbeaf442136e1)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:35:15.329081 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ced99a7-2bb6-4f9a-a1a3-c473a856a194 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:35:15.335350 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:35:15.340366 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1318/2595] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 19 10:35:15 2022] PUT /identity/v3/projects/1d8d293ccdb3421981361dfb4e27a781/users/25ed17fe4d4f4d8d85f81d7c14240bf0/roles/5c8b89fae4fa45bd944cbeaf442136e1 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:35:15.351721 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0080a81-6c25-4a59-8975-ef4663656ce6 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:15.352006 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0080a81-6c25-4a59-8975-ef4663656ce6 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:15.352823 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0080a81-6c25-4a59-8975-ef4663656ce6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:15.383732 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-a0080a81-6c25-4a59-8975-ef4663656ce6 None None] MFA Rules not processed for user `25ed17fe4d4f4d8d85f81d7c14240bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:35:15.384983 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-a0080a81-6c25-4a59-8975-ef4663656ce6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:35:15.448868 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:35:15.452944 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1278/2596] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:35:15 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:35:15.463833 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ced99a7-2bb6-4f9a-a1a3-c473a856a194 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:35:15.465606 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-8ced99a7-2bb6-4f9a-a1a3-c473a856a194 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:35:15.523512 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ced99a7-2bb6-4f9a-a1a3-c473a856a194 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:35:15.527125 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c831d66f-0ed4-432c-ba27-a35c36db39c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa4d004fd44482cae761c4b3bdfab31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:35:15.527813 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c831d66f-0ed4-432c-ba27-a35c36db39c5 service cinder] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:15.528021 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c831d66f-0ed4-432c-ba27-a35c36db39c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:15.528331 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c831d66f-0ed4-432c-ba27-a35c36db39c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:15.537746 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c831d66f-0ed4-432c-ba27-a35c36db39c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:35:15.539367 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c831d66f-0ed4-432c-ba27-a35c36db39c5 service cinder] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:35:15.550481 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1319/2597] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:35:15 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:35:15.629638 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0080a81-6c25-4a59-8975-ef4663656ce6 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:35:15.716925 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0080a81-6c25-4a59-8975-ef4663656ce6 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:35:15.722086 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef611e57-2b28-40e4-b363-b0d21f19fec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:35:15.722877 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef611e57-2b28-40e4-b363-b0d21f19fec3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:15.723163 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef611e57-2b28-40e4-b363-b0d21f19fec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:15.723438 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef611e57-2b28-40e4-b363-b0d21f19fec3 admin admin] PATH_INFO: `/v3/users/822884dac43149e4bbb375ded123e350` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:15.724609 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef611e57-2b28-40e4-b363-b0d21f19fec3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=822884dac43149e4bbb375ded123e350)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:35:15.726558 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef611e57-2b28-40e4-b363-b0d21f19fec3 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:35:15.773704 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-ef611e57-2b28-40e4-b363-b0d21f19fec3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '822884dac43149e4bbb375ded123e350'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:15.781123 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-ef611e57-2b28-40e4-b363-b0d21f19fec3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '822884dac43149e4bbb375ded123e350'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:15.781829 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-ef611e57-2b28-40e4-b363-b0d21f19fec3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '822884dac43149e4bbb375ded123e350'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:15.782460 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-ef611e57-2b28-40e4-b363-b0d21f19fec3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '822884dac43149e4bbb375ded123e350'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:15.790010 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-ef611e57-2b28-40e4-b363-b0d21f19fec3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '822884dac43149e4bbb375ded123e350'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:15.807589 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1279/2598] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 19 10:35:15 2022] DELETE /identity/v3/users/822884dac43149e4bbb375ded123e350 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:35:15.812396 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0984f2-d9a0-4dd1-8d71-9a8b4af694f3 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:15.812857 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0984f2-d9a0-4dd1-8d71-9a8b4af694f3 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:15.812975 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0984f2-d9a0-4dd1-8d71-9a8b4af694f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:15.832106 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-df0984f2-d9a0-4dd1-8d71-9a8b4af694f3 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:35:15.833356 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-df0984f2-d9a0-4dd1-8d71-9a8b4af694f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:35:15.896191 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1320/2599] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:35:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:35:15.905930 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef611e57-2b28-40e4-b363-b0d21f19fec3 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:35:15.907325 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-ef611e57-2b28-40e4-b363-b0d21f19fec3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:35:15.966721 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef611e57-2b28-40e4-b363-b0d21f19fec3 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:35:15.971993 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5d2c82-bf9e-435c-a6b3-bf3651dec84e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c1289b015854c6bb6aee8fed6b807db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:35:15.972638 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5d2c82-bf9e-435c-a6b3-bf3651dec84e service neutron] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:15.972921 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5d2c82-bf9e-435c-a6b3-bf3651dec84e service neutron] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:15.973806 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5d2c82-bf9e-435c-a6b3-bf3651dec84e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:15.982693 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5d2c82-bf9e-435c-a6b3-bf3651dec84e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:35:15.984142 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5d2c82-bf9e-435c-a6b3-bf3651dec84e service neutron] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:35:15.994374 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1280/2600] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:35:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:35:16.275981 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0984f2-d9a0-4dd1-8d71-9a8b4af694f3 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:35:16.277615 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-df0984f2-d9a0-4dd1-8d71-9a8b4af694f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:35:16.290799 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0984f2-d9a0-4dd1-8d71-9a8b4af694f3 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:35:16.296991 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c40d68-1729-494d-b28e-73f8272e51de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:35:16.297725 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c40d68-1729-494d-b28e-73f8272e51de admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:16.298161 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c40d68-1729-494d-b28e-73f8272e51de admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:16.298550 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c40d68-1729-494d-b28e-73f8272e51de admin admin] PATH_INFO: `/v3/projects/34c36c9ab87a4d40b2e9b42e0976c1b4` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:16.300506 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c40d68-1729-494d-b28e-73f8272e51de admin admin] RBAC: Authorizing `identity:delete_project(project_id=34c36c9ab87a4d40b2e9b42e0976c1b4)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:35:16.302527 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c40d68-1729-494d-b28e-73f8272e51de admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:35:16.364054 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-30c40d68-1729-494d-b28e-73f8272e51de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34c36c9ab87a4d40b2e9b42e0976c1b4', 'request_id': 'req-30c40d68-1729-494d-b28e-73f8272e51de'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:16.373887 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-30c40d68-1729-494d-b28e-73f8272e51de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34c36c9ab87a4d40b2e9b42e0976c1b4', 'request_id': 'req-30c40d68-1729-494d-b28e-73f8272e51de'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:16.387455 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-30c40d68-1729-494d-b28e-73f8272e51de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34c36c9ab87a4d40b2e9b42e0976c1b4', 'request_id': 'req-30c40d68-1729-494d-b28e-73f8272e51de'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:16.402537 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-30c40d68-1729-494d-b28e-73f8272e51de admin admin] The token cache is being invalidate because project 34c36c9ab87a4d40b2e9b42e0976c1b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 10:35:16.402835 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-30c40d68-1729-494d-b28e-73f8272e51de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:16.403512 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-30c40d68-1729-494d-b28e-73f8272e51de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:16.405142 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1321/2601] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 19 10:35:16 2022] DELETE /identity/v3/projects/34c36c9ab87a4d40b2e9b42e0976c1b4 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:35:16.409588 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5d2c82-bf9e-435c-a6b3-bf3651dec84e service neutron] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:35:16.421123 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5d2c82-bf9e-435c-a6b3-bf3651dec84e service neutron] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:35:16.445010 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:35:16.488261 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f671e96b-f3fa-42b7-ae57-a16af82d6d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:35:16.488896 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f671e96b-f3fa-42b7-ae57-a16af82d6d6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:16.489177 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f671e96b-f3fa-42b7-ae57-a16af82d6d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:16.489449 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f671e96b-f3fa-42b7-ae57-a16af82d6d6b admin admin] PATH_INFO: `/v3/users/25ed17fe4d4f4d8d85f81d7c14240bf0` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:16.490558 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f671e96b-f3fa-42b7-ae57-a16af82d6d6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=25ed17fe4d4f4d8d85f81d7c14240bf0)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:35:16.492513 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f671e96b-f3fa-42b7-ae57-a16af82d6d6b admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:35:16.537710 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-f671e96b-f3fa-42b7-ae57-a16af82d6d6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25ed17fe4d4f4d8d85f81d7c14240bf0'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:16.545994 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-f671e96b-f3fa-42b7-ae57-a16af82d6d6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25ed17fe4d4f4d8d85f81d7c14240bf0'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:16.546638 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-f671e96b-f3fa-42b7-ae57-a16af82d6d6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25ed17fe4d4f4d8d85f81d7c14240bf0'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:16.547263 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-f671e96b-f3fa-42b7-ae57-a16af82d6d6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25ed17fe4d4f4d8d85f81d7c14240bf0'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:16.554997 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-f671e96b-f3fa-42b7-ae57-a16af82d6d6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25ed17fe4d4f4d8d85f81d7c14240bf0'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:16.572814 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1281/2602] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 19 10:35:16 2022] DELETE /identity/v3/users/25ed17fe4d4f4d8d85f81d7c14240bf0 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:35:16.935276 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c40d68-1729-494d-b28e-73f8272e51de admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:35:16.936939 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-30c40d68-1729-494d-b28e-73f8272e51de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:35:16.950723 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c40d68-1729-494d-b28e-73f8272e51de admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:35:16.975387 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:35:17.010269 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e83762-ae88-41ee-81ac-0a04700badaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:35:17.010930 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e83762-ae88-41ee-81ac-0a04700badaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:17.011211 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e83762-ae88-41ee-81ac-0a04700badaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:17.011487 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e83762-ae88-41ee-81ac-0a04700badaf admin admin] PATH_INFO: `/v3/projects/1d8d293ccdb3421981361dfb4e27a781` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:17.012647 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e83762-ae88-41ee-81ac-0a04700badaf admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d8d293ccdb3421981361dfb4e27a781)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:35:17.014560 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e83762-ae88-41ee-81ac-0a04700badaf admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:35:17.060181 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-e9e83762-ae88-41ee-81ac-0a04700badaf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d8d293ccdb3421981361dfb4e27a781', 'request_id': 'req-e9e83762-ae88-41ee-81ac-0a04700badaf'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:17.066934 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-e9e83762-ae88-41ee-81ac-0a04700badaf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d8d293ccdb3421981361dfb4e27a781', 'request_id': 'req-e9e83762-ae88-41ee-81ac-0a04700badaf'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:17.075519 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-e9e83762-ae88-41ee-81ac-0a04700badaf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d8d293ccdb3421981361dfb4e27a781', 'request_id': 'req-e9e83762-ae88-41ee-81ac-0a04700badaf'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:17.085960 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-e9e83762-ae88-41ee-81ac-0a04700badaf admin admin] The token cache is being invalidate because project 1d8d293ccdb3421981361dfb4e27a781 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 10:35:17.086248 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-e9e83762-ae88-41ee-81ac-0a04700badaf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:17.086875 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-e9e83762-ae88-41ee-81ac-0a04700badaf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:17.088402 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1322/2603] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 19 10:35:16 2022] DELETE /identity/v3/projects/1d8d293ccdb3421981361dfb4e27a781 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:35:17.093333 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecec1a7b-52ed-4138-ab8d-5e848d8937d5 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:17.093625 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecec1a7b-52ed-4138-ab8d-5e848d8937d5 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:17.093904 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecec1a7b-52ed-4138-ab8d-5e848d8937d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:17.113972 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-ecec1a7b-52ed-4138-ab8d-5e848d8937d5 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:35:17.115184 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-ecec1a7b-52ed-4138-ab8d-5e848d8937d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:35:17.179616 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1282/2604] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:35:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:35:17.190135 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b545d9-13d9-412a-84f4-646ea90fbed4 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:17.190415 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b545d9-13d9-412a-84f4-646ea90fbed4 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:17.190685 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b545d9-13d9-412a-84f4-646ea90fbed4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:17.210301 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-a2b545d9-13d9-412a-84f4-646ea90fbed4 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:35:17.211532 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-a2b545d9-13d9-412a-84f4-646ea90fbed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:35:17.219476 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1323/2605] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:35:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:35:17.224218 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecec1a7b-52ed-4138-ab8d-5e848d8937d5 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:35:17.233827 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecec1a7b-52ed-4138-ab8d-5e848d8937d5 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:35:17.239051 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf45bbe-2558-4f4d-be7c-29c652ab4832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:35:17.239651 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf45bbe-2558-4f4d-be7c-29c652ab4832 admin admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:17.239936 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf45bbe-2558-4f4d-be7c-29c652ab4832 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:17.240248 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf45bbe-2558-4f4d-be7c-29c652ab4832 admin admin] PATH_INFO: `/v3/domains` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:17.240898 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf45bbe-2558-4f4d-be7c-29c652ab4832 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:35:17.241201 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf45bbe-2558-4f4d-be7c-29c652ab4832 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:35:17.242796 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf45bbe-2558-4f4d-be7c-29c652ab4832 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:35:17.254449 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1283/2606] 10.222.0.66 () {58 vars in 1153 bytes} [Mon Sep 19 10:35:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:35:17.259154 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b545d9-13d9-412a-84f4-646ea90fbed4 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:35:17.268436 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b545d9-13d9-412a-84f4-646ea90fbed4 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:35:17.273154 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56dbf2b-431a-4a0d-9b38-f23b821d6496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:35:17.273711 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56dbf2b-431a-4a0d-9b38-f23b821d6496 admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:17.274048 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56dbf2b-431a-4a0d-9b38-f23b821d6496 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:17.274244 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56dbf2b-431a-4a0d-9b38-f23b821d6496 admin admin] PATH_INFO: `/v3/projects` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:17.274857 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56dbf2b-431a-4a0d-9b38-f23b821d6496 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:35:17.276790 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56dbf2b-431a-4a0d-9b38-f23b821d6496 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:35:17.305794 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1324/2607] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 19 10:35:17 2022] POST /identity/v3/projects => generated 367 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:35:17.310026 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf45bbe-2558-4f4d-be7c-29c652ab4832 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:35:17.320076 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf45bbe-2558-4f4d-be7c-29c652ab4832 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:35:17.345258 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:35:17.378404 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955383c0-81c5-41b3-b244-58ac4ec22d76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:35:17.379005 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955383c0-81c5-41b3-b244-58ac4ec22d76 admin admin] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:17.379284 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955383c0-81c5-41b3-b244-58ac4ec22d76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:17.379556 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955383c0-81c5-41b3-b244-58ac4ec22d76 admin admin] PATH_INFO: `/v3/users` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:17.380249 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955383c0-81c5-41b3-b244-58ac4ec22d76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:35:17.382161 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955383c0-81c5-41b3-b244-58ac4ec22d76 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:35:17.402608 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1284/2608] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 19 10:35:17 2022] POST /identity/v3/users => generated 284 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:35:17.406809 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56dbf2b-431a-4a0d-9b38-f23b821d6496 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:35:17.422441 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56dbf2b-431a-4a0d-9b38-f23b821d6496 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:35:17.429763 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236c1e22-0b05-444e-8b89-77019c516349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:35:17.430368 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236c1e22-0b05-444e-8b89-77019c516349 admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:17.430642 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236c1e22-0b05-444e-8b89-77019c516349 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:17.430915 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236c1e22-0b05-444e-8b89-77019c516349 admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:17.431549 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236c1e22-0b05-444e-8b89-77019c516349 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:35:17.433173 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236c1e22-0b05-444e-8b89-77019c516349 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:35:17.443431 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1325/2609] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:35:17 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 10:35:17.448280 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955383c0-81c5-41b3-b244-58ac4ec22d76 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:35:17.460205 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955383c0-81c5-41b3-b244-58ac4ec22d76 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:35:17.464873 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f2f5fd-a3c2-4bf2-a560-b993e44c392d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:35:17.465644 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f2f5fd-a3c2-4bf2-a560-b993e44c392d admin admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:17.465928 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f2f5fd-a3c2-4bf2-a560-b993e44c392d admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:17.466203 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f2f5fd-a3c2-4bf2-a560-b993e44c392d admin admin] PATH_INFO: `/v3/roles` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:17.466977 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f2f5fd-a3c2-4bf2-a560-b993e44c392d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:35:17.468625 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f2f5fd-a3c2-4bf2-a560-b993e44c392d admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:35:17.480007 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1285/2610] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:35:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 10:35:17.484871 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236c1e22-0b05-444e-8b89-77019c516349 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:35:17.495764 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236c1e22-0b05-444e-8b89-77019c516349 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:35:17.500644 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8254165-0f50-4f76-9fdb-28a1c84b2063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:35:17.501341 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8254165-0f50-4f76-9fdb-28a1c84b2063 admin admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:17.501617 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8254165-0f50-4f76-9fdb-28a1c84b2063 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:17.501916 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8254165-0f50-4f76-9fdb-28a1c84b2063 admin admin] PATH_INFO: `/v3/projects/e85a0482fd6449f4af0d7178033ac350/users/315ef67e581f41fd9be4b514de898656/roles/cd5b42ed3b754b58817a62bbe74651b4` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:17.517014 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8254165-0f50-4f76-9fdb-28a1c84b2063 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e85a0482fd6449f4af0d7178033ac350, user_id=315ef67e581f41fd9be4b514de898656, role_id=cd5b42ed3b754b58817a62bbe74651b4)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:35:17.519718 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8254165-0f50-4f76-9fdb-28a1c84b2063 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:35:17.533886 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1326/2611] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 19 10:35:17 2022] PUT /identity/v3/projects/e85a0482fd6449f4af0d7178033ac350/users/315ef67e581f41fd9be4b514de898656/roles/cd5b42ed3b754b58817a62bbe74651b4 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:35:17.546128 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b9261d-26e3-48bf-a372-b43cbbcf2e99 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:17.546629 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b9261d-26e3-48bf-a372-b43cbbcf2e99 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:17.547347 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b9261d-26e3-48bf-a372-b43cbbcf2e99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:17.580730 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-b4b9261d-26e3-48bf-a372-b43cbbcf2e99 None None] MFA Rules not processed for user `315ef67e581f41fd9be4b514de898656`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:35:17.581935 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-b4b9261d-26e3-48bf-a372-b43cbbcf2e99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:35:17.649751 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1286/2612] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:35:17 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:35:17.662780 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8254165-0f50-4f76-9fdb-28a1c84b2063 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:35:17.664886 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-f8254165-0f50-4f76-9fdb-28a1c84b2063 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:35:17.729220 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8254165-0f50-4f76-9fdb-28a1c84b2063 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:35:17.733822 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392551bc-e9b8-4a9c-b336-a1a3546ee1c2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f95c0d9f2414f3ca2fa2d1546d47f1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:35:17.734440 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392551bc-e9b8-4a9c-b336-a1a3546ee1c2 service glance] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:17.734724 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392551bc-e9b8-4a9c-b336-a1a3546ee1c2 service glance] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:17.734999 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392551bc-e9b8-4a9c-b336-a1a3546ee1c2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:17.742379 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:35:17.746959 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392551bc-e9b8-4a9c-b336-a1a3546ee1c2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:35:17.749848 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392551bc-e9b8-4a9c-b336-a1a3546ee1c2 service glance] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:35:17.762907 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1327/2613] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:35:17 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:35:23.153933 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b9261d-26e3-48bf-a372-b43cbbcf2e99 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:35:23.155345 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-b4b9261d-26e3-48bf-a372-b43cbbcf2e99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:35:23.226592 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b9261d-26e3-48bf-a372-b43cbbcf2e99 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:35:23.231179 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962365f7-35d9-4846-a715-25d7990b1f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:35:23.231839 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962365f7-35d9-4846-a715-25d7990b1f63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:23.232148 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962365f7-35d9-4846-a715-25d7990b1f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:23.232452 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962365f7-35d9-4846-a715-25d7990b1f63 admin admin] PATH_INFO: `/v3/users/a498ad140aa943c9b3cea54a880d2973` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:23.233668 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962365f7-35d9-4846-a715-25d7990b1f63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a498ad140aa943c9b3cea54a880d2973)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:35:23.235625 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962365f7-35d9-4846-a715-25d7990b1f63 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:35:23.278072 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:35:23.285052 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-962365f7-35d9-4846-a715-25d7990b1f63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a498ad140aa943c9b3cea54a880d2973'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:23.292868 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-962365f7-35d9-4846-a715-25d7990b1f63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a498ad140aa943c9b3cea54a880d2973'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:23.293736 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-962365f7-35d9-4846-a715-25d7990b1f63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a498ad140aa943c9b3cea54a880d2973'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:23.294369 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-962365f7-35d9-4846-a715-25d7990b1f63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a498ad140aa943c9b3cea54a880d2973'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:23.301259 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-962365f7-35d9-4846-a715-25d7990b1f63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a498ad140aa943c9b3cea54a880d2973'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:23.318770 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1287/2614] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 19 10:35:23 2022] DELETE /identity/v3/users/a498ad140aa943c9b3cea54a880d2973 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:35:23.323246 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e352f311-f277-4039-8848-ba861d74c60d None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:23.323706 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e352f311-f277-4039-8848-ba861d74c60d None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:23.323825 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e352f311-f277-4039-8848-ba861d74c60d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:23.343170 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-e352f311-f277-4039-8848-ba861d74c60d None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:35:23.344411 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-e352f311-f277-4039-8848-ba861d74c60d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:35:23.410530 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1328/2615] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:35:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:35:23.421009 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962365f7-35d9-4846-a715-25d7990b1f63 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:35:23.422757 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-962365f7-35d9-4846-a715-25d7990b1f63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:35:23.505234 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962365f7-35d9-4846-a715-25d7990b1f63 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:35:23.508990 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3d9f15-67de-453b-8e51-737f8fe93c91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c1289b015854c6bb6aee8fed6b807db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:35:23.509633 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3d9f15-67de-453b-8e51-737f8fe93c91 service neutron] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:23.509865 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3d9f15-67de-453b-8e51-737f8fe93c91 service neutron] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:23.510138 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3d9f15-67de-453b-8e51-737f8fe93c91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:23.519895 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3d9f15-67de-453b-8e51-737f8fe93c91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:35:23.521762 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3d9f15-67de-453b-8e51-737f8fe93c91 service neutron] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:35:23.531773 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1288/2616] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:35:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:35:23.802913 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e352f311-f277-4039-8848-ba861d74c60d None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:35:23.804382 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-e352f311-f277-4039-8848-ba861d74c60d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:35:23.818809 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e352f311-f277-4039-8848-ba861d74c60d None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:35:23.824024 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1be38d-f553-41af-af42-7127802e6cbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:35:23.824827 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1be38d-f553-41af-af42-7127802e6cbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:23.825116 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1be38d-f553-41af-af42-7127802e6cbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:23.825398 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1be38d-f553-41af-af42-7127802e6cbe admin admin] PATH_INFO: `/v3/projects/8cc2235f5c554f15a369e7bfaaa229e3` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:23.827215 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1be38d-f553-41af-af42-7127802e6cbe admin admin] RBAC: Authorizing `identity:delete_project(project_id=8cc2235f5c554f15a369e7bfaaa229e3)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:35:23.829445 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1be38d-f553-41af-af42-7127802e6cbe admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:35:23.877141 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-3c1be38d-f553-41af-af42-7127802e6cbe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8cc2235f5c554f15a369e7bfaaa229e3', 'request_id': 'req-3c1be38d-f553-41af-af42-7127802e6cbe'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:23.883506 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-3c1be38d-f553-41af-af42-7127802e6cbe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8cc2235f5c554f15a369e7bfaaa229e3', 'request_id': 'req-3c1be38d-f553-41af-af42-7127802e6cbe'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:23.892077 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-3c1be38d-f553-41af-af42-7127802e6cbe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8cc2235f5c554f15a369e7bfaaa229e3', 'request_id': 'req-3c1be38d-f553-41af-af42-7127802e6cbe'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:23.903406 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-3c1be38d-f553-41af-af42-7127802e6cbe admin admin] The token cache is being invalidate because project 8cc2235f5c554f15a369e7bfaaa229e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 10:35:23.903800 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-3c1be38d-f553-41af-af42-7127802e6cbe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:23.904367 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-3c1be38d-f553-41af-af42-7127802e6cbe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:23.905885 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1329/2617] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 19 10:35:23 2022] DELETE /identity/v3/projects/8cc2235f5c554f15a369e7bfaaa229e3 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:35:23.910175 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3d9f15-67de-453b-8e51-737f8fe93c91 service neutron] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:35:23.925202 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3d9f15-67de-453b-8e51-737f8fe93c91 service neutron] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:35:23.984497 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8cf240-b214-488d-8d87-b25e7fe0786e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:35:23.985132 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8cf240-b214-488d-8d87-b25e7fe0786e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:23.985412 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8cf240-b214-488d-8d87-b25e7fe0786e admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:23.985758 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8cf240-b214-488d-8d87-b25e7fe0786e admin admin] PATH_INFO: `/v3/users/3a6c800927a54e529c216c5561f0c697` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:23.987433 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8cf240-b214-488d-8d87-b25e7fe0786e admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a6c800927a54e529c216c5561f0c697)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:35:23.989407 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8cf240-b214-488d-8d87-b25e7fe0786e admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:35:24.031366 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:35:24.040894 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-1b8cf240-b214-488d-8d87-b25e7fe0786e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a6c800927a54e529c216c5561f0c697'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:24.057657 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-1b8cf240-b214-488d-8d87-b25e7fe0786e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a6c800927a54e529c216c5561f0c697'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:24.058310 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-1b8cf240-b214-488d-8d87-b25e7fe0786e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a6c800927a54e529c216c5561f0c697'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:24.058910 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-1b8cf240-b214-488d-8d87-b25e7fe0786e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a6c800927a54e529c216c5561f0c697'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:24.067741 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-1b8cf240-b214-488d-8d87-b25e7fe0786e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a6c800927a54e529c216c5561f0c697'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:24.085688 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1289/2618] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 19 10:35:23 2022] DELETE /identity/v3/users/3a6c800927a54e529c216c5561f0c697 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:35:24.377048 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1be38d-f553-41af-af42-7127802e6cbe admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:35:24.378554 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-3c1be38d-f553-41af-af42-7127802e6cbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:35:24.394352 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1be38d-f553-41af-af42-7127802e6cbe admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:35:24.459590 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16180d7-991a-47d0-8409-30fc5dcf69ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:35:24.460266 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16180d7-991a-47d0-8409-30fc5dcf69ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:24.460551 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16180d7-991a-47d0-8409-30fc5dcf69ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:24.460826 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16180d7-991a-47d0-8409-30fc5dcf69ae admin admin] PATH_INFO: `/v3/projects/cf0c49a29f8f4a86ae81217445315e35` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:24.461972 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16180d7-991a-47d0-8409-30fc5dcf69ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf0c49a29f8f4a86ae81217445315e35)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:35:24.463886 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16180d7-991a-47d0-8409-30fc5dcf69ae admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:35:24.487719 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:35:24.514645 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-a16180d7-991a-47d0-8409-30fc5dcf69ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf0c49a29f8f4a86ae81217445315e35', 'request_id': 'req-a16180d7-991a-47d0-8409-30fc5dcf69ae'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:24.521892 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-a16180d7-991a-47d0-8409-30fc5dcf69ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf0c49a29f8f4a86ae81217445315e35', 'request_id': 'req-a16180d7-991a-47d0-8409-30fc5dcf69ae'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:24.529308 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-a16180d7-991a-47d0-8409-30fc5dcf69ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf0c49a29f8f4a86ae81217445315e35', 'request_id': 'req-a16180d7-991a-47d0-8409-30fc5dcf69ae'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:24.540727 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-a16180d7-991a-47d0-8409-30fc5dcf69ae admin admin] The token cache is being invalidate because project cf0c49a29f8f4a86ae81217445315e35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 10:35:24.541018 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-a16180d7-991a-47d0-8409-30fc5dcf69ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:24.541650 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-a16180d7-991a-47d0-8409-30fc5dcf69ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:24.543122 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1330/2619] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 19 10:35:24 2022] DELETE /identity/v3/projects/cf0c49a29f8f4a86ae81217445315e35 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:35:24.548357 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e769a3-e0df-4aa1-b7e0-b5bc47606464 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:24.548846 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e769a3-e0df-4aa1-b7e0-b5bc47606464 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:24.548963 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e769a3-e0df-4aa1-b7e0-b5bc47606464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:24.568852 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-d8e769a3-e0df-4aa1-b7e0-b5bc47606464 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:35:24.570166 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-d8e769a3-e0df-4aa1-b7e0-b5bc47606464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:35:24.636562 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1290/2620] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:35:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:35:24.644958 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef00c1d1-6cbf-4c64-9920-430110364c1e None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:24.645250 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef00c1d1-6cbf-4c64-9920-430110364c1e None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:24.645531 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef00c1d1-6cbf-4c64-9920-430110364c1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:24.666921 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-ef00c1d1-6cbf-4c64-9920-430110364c1e None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:35:24.668140 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-ef00c1d1-6cbf-4c64-9920-430110364c1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:35:24.677363 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1331/2621] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:35:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:35:24.682089 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e769a3-e0df-4aa1-b7e0-b5bc47606464 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:35:24.695168 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e769a3-e0df-4aa1-b7e0-b5bc47606464 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:35:24.699744 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4848cc65-1caa-4266-bd8a-6e10c56f5b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:35:24.700396 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4848cc65-1caa-4266-bd8a-6e10c56f5b61 admin admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:24.700677 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4848cc65-1caa-4266-bd8a-6e10c56f5b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:24.700948 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4848cc65-1caa-4266-bd8a-6e10c56f5b61 admin admin] PATH_INFO: `/v3/domains` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:24.701584 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4848cc65-1caa-4266-bd8a-6e10c56f5b61 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:35:24.701882 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4848cc65-1caa-4266-bd8a-6e10c56f5b61 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:35:24.703466 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4848cc65-1caa-4266-bd8a-6e10c56f5b61 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:35:24.715531 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1291/2622] 10.222.0.66 () {58 vars in 1153 bytes} [Mon Sep 19 10:35:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:35:24.719860 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef00c1d1-6cbf-4c64-9920-430110364c1e None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:35:24.729216 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef00c1d1-6cbf-4c64-9920-430110364c1e None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:35:24.733983 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6899626e-375b-404a-b980-f47cc58fa2a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:35:24.734589 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6899626e-375b-404a-b980-f47cc58fa2a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:24.734871 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6899626e-375b-404a-b980-f47cc58fa2a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:24.735145 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6899626e-375b-404a-b980-f47cc58fa2a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:24.735789 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6899626e-375b-404a-b980-f47cc58fa2a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:35:24.737733 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6899626e-375b-404a-b980-f47cc58fa2a4 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:35:24.765068 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1332/2623] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 19 10:35:24 2022] POST /identity/v3/projects => generated 387 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:35:24.770437 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4848cc65-1caa-4266-bd8a-6e10c56f5b61 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:35:24.782020 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4848cc65-1caa-4266-bd8a-6e10c56f5b61 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:35:24.839595 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a0b587-6298-4c9b-b7f4-22a581943110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:35:24.840120 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a0b587-6298-4c9b-b7f4-22a581943110 admin admin] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:24.840431 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a0b587-6298-4c9b-b7f4-22a581943110 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:24.840712 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a0b587-6298-4c9b-b7f4-22a581943110 admin admin] PATH_INFO: `/v3/users` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:24.841349 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a0b587-6298-4c9b-b7f4-22a581943110 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:35:24.843279 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a0b587-6298-4c9b-b7f4-22a581943110 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:35:24.864676 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1292/2624] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 19 10:35:24 2022] POST /identity/v3/users => generated 294 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 10:35:24.869978 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6899626e-375b-404a-b980-f47cc58fa2a4 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:35:24.882963 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6899626e-375b-404a-b980-f47cc58fa2a4 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:35:24.888101 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06c8c34-9ec3-430a-9875-009a428cadc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:35:24.888743 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06c8c34-9ec3-430a-9875-009a428cadc6 admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:24.889028 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06c8c34-9ec3-430a-9875-009a428cadc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:24.889306 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06c8c34-9ec3-430a-9875-009a428cadc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:24.889953 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06c8c34-9ec3-430a-9875-009a428cadc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:35:24.891581 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06c8c34-9ec3-430a-9875-009a428cadc6 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:35:24.903001 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1333/2625] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:35:24 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 10:35:24.907146 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a0b587-6298-4c9b-b7f4-22a581943110 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:35:24.917177 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a0b587-6298-4c9b-b7f4-22a581943110 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:35:24.922048 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572495e3-85fe-43bf-a044-41568205e15e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:35:24.922643 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572495e3-85fe-43bf-a044-41568205e15e admin admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:24.922935 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572495e3-85fe-43bf-a044-41568205e15e admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:24.923234 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572495e3-85fe-43bf-a044-41568205e15e admin admin] PATH_INFO: `/v3/roles` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:24.923878 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572495e3-85fe-43bf-a044-41568205e15e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:35:24.925559 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572495e3-85fe-43bf-a044-41568205e15e admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:35:24.936088 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1293/2626] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:35:24 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 10:35:24.940762 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06c8c34-9ec3-430a-9875-009a428cadc6 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:35:24.950563 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06c8c34-9ec3-430a-9875-009a428cadc6 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:35:24.955696 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced6419b-3a2e-4de0-a698-6df65823bd74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:35:24.956366 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced6419b-3a2e-4de0-a698-6df65823bd74 admin admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:24.956639 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced6419b-3a2e-4de0-a698-6df65823bd74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:24.956910 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced6419b-3a2e-4de0-a698-6df65823bd74 admin admin] PATH_INFO: `/v3/projects/a91f83b76ada473ba1a2245eead4814f/users/5548d57a09894fdaa93524615a091ce2/roles/cd5b42ed3b754b58817a62bbe74651b4` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:24.971112 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced6419b-3a2e-4de0-a698-6df65823bd74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a91f83b76ada473ba1a2245eead4814f, user_id=5548d57a09894fdaa93524615a091ce2, role_id=cd5b42ed3b754b58817a62bbe74651b4)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:35:24.974355 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced6419b-3a2e-4de0-a698-6df65823bd74 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:35:24.989850 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1334/2627] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 19 10:35:24 2022] PUT /identity/v3/projects/a91f83b76ada473ba1a2245eead4814f/users/5548d57a09894fdaa93524615a091ce2/roles/cd5b42ed3b754b58817a62bbe74651b4 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:35:25.002597 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4733c602-654b-4afb-915f-917a84f0b11d None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:25.002894 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4733c602-654b-4afb-915f-917a84f0b11d None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:25.003200 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4733c602-654b-4afb-915f-917a84f0b11d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:25.032492 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-4733c602-654b-4afb-915f-917a84f0b11d None None] MFA Rules not processed for user `5548d57a09894fdaa93524615a091ce2`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:35:25.033707 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-4733c602-654b-4afb-915f-917a84f0b11d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:35:25.045759 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:35:25.106229 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1294/2628] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:35:25 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:35:25.108985 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced6419b-3a2e-4de0-a698-6df65823bd74 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:35:25.175111 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced6419b-3a2e-4de0-a698-6df65823bd74 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:35:25.180141 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240122d9-0c86-4344-bc12-dcb4eb50a374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:35:25.180873 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240122d9-0c86-4344-bc12-dcb4eb50a374 admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:25.181226 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240122d9-0c86-4344-bc12-dcb4eb50a374 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:25.181572 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240122d9-0c86-4344-bc12-dcb4eb50a374 admin admin] PATH_INFO: `/v3/projects` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:25.182339 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240122d9-0c86-4344-bc12-dcb4eb50a374 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:35:25.184409 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240122d9-0c86-4344-bc12-dcb4eb50a374 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:35:25.224502 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1335/2629] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 19 10:35:25 2022] POST /identity/v3/projects => generated 387 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 10:35:25.226445 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4733c602-654b-4afb-915f-917a84f0b11d None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:35:25.239329 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4733c602-654b-4afb-915f-917a84f0b11d None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:35:25.296387 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6385388f-f9ab-4180-b60e-235131b0cd9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:35:25.296997 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6385388f-f9ab-4180-b60e-235131b0cd9f admin admin] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:25.297278 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6385388f-f9ab-4180-b60e-235131b0cd9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:25.297555 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6385388f-f9ab-4180-b60e-235131b0cd9f admin admin] PATH_INFO: `/v3/users` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:25.298694 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6385388f-f9ab-4180-b60e-235131b0cd9f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:35:25.300802 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6385388f-f9ab-4180-b60e-235131b0cd9f admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:35:25.321897 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1295/2630] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 19 10:35:25 2022] POST /identity/v3/users => generated 300 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 10:35:25.325933 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240122d9-0c86-4344-bc12-dcb4eb50a374 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:35:25.336232 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240122d9-0c86-4344-bc12-dcb4eb50a374 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:35:25.340881 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee8c1cb-8cb3-447c-974c-4fa4fb9db0e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:35:25.341515 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee8c1cb-8cb3-447c-974c-4fa4fb9db0e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:25.341791 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee8c1cb-8cb3-447c-974c-4fa4fb9db0e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:25.342060 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee8c1cb-8cb3-447c-974c-4fa4fb9db0e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:25.342735 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee8c1cb-8cb3-447c-974c-4fa4fb9db0e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:35:25.344465 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee8c1cb-8cb3-447c-974c-4fa4fb9db0e9 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:35:25.355934 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1336/2631] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:35:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 10:35:25.360366 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6385388f-f9ab-4180-b60e-235131b0cd9f admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:35:25.371154 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6385388f-f9ab-4180-b60e-235131b0cd9f admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:35:25.375771 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0416d4-0940-4ee0-a1b1-23e5ba4b0bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:35:25.377055 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0416d4-0940-4ee0-a1b1-23e5ba4b0bdd admin admin] REQUEST_METHOD: `PUT` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:25.377343 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0416d4-0940-4ee0-a1b1-23e5ba4b0bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:25.377769 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0416d4-0940-4ee0-a1b1-23e5ba4b0bdd admin admin] PATH_INFO: `/v3/projects/a91936ce1460442e972cc64271daae01/users/34a11911f4da4005951af6d1c5d4f03d/roles/5c8b89fae4fa45bd944cbeaf442136e1` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:25.392798 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0416d4-0940-4ee0-a1b1-23e5ba4b0bdd admin admin] RBAC: Authorizing `identity:create_grant(project_id=a91936ce1460442e972cc64271daae01, user_id=34a11911f4da4005951af6d1c5d4f03d, role_id=5c8b89fae4fa45bd944cbeaf442136e1)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:35:25.395470 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0416d4-0940-4ee0-a1b1-23e5ba4b0bdd admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:35:25.408036 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1296/2632] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 19 10:35:25 2022] PUT /identity/v3/projects/a91936ce1460442e972cc64271daae01/users/34a11911f4da4005951af6d1c5d4f03d/roles/5c8b89fae4fa45bd944cbeaf442136e1 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:35:25.411942 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee8c1cb-8cb3-447c-974c-4fa4fb9db0e9 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:35:25.422603 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee8c1cb-8cb3-447c-974c-4fa4fb9db0e9 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:35:25.439672 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:35:25.483717 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e45ec7-47d5-4c04-a820-6f2c070c934f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:35:25.484357 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e45ec7-47d5-4c04-a820-6f2c070c934f admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:25.484638 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e45ec7-47d5-4c04-a820-6f2c070c934f admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:25.484905 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e45ec7-47d5-4c04-a820-6f2c070c934f admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:25.485525 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e45ec7-47d5-4c04-a820-6f2c070c934f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:35:25.487715 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e45ec7-47d5-4c04-a820-6f2c070c934f admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:35:25.497316 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1337/2633] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:35:25 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 10:35:25.501673 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0416d4-0940-4ee0-a1b1-23e5ba4b0bdd admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:35:25.512334 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0416d4-0940-4ee0-a1b1-23e5ba4b0bdd admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:35:25.517021 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557f4293-2026-4e44-9e17-09836bc000f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:35:25.517671 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557f4293-2026-4e44-9e17-09836bc000f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:25.517954 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557f4293-2026-4e44-9e17-09836bc000f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:25.518230 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557f4293-2026-4e44-9e17-09836bc000f8 admin admin] PATH_INFO: `/v3/projects/a91936ce1460442e972cc64271daae01/users/34a11911f4da4005951af6d1c5d4f03d/roles/5c8b89fae4fa45bd944cbeaf442136e1` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:25.520172 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557f4293-2026-4e44-9e17-09836bc000f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a91936ce1460442e972cc64271daae01, user_id=34a11911f4da4005951af6d1c5d4f03d, role_id=5c8b89fae4fa45bd944cbeaf442136e1)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:35:25.522826 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557f4293-2026-4e44-9e17-09836bc000f8 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:35:25.533453 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1297/2634] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 19 10:35:25 2022] PUT /identity/v3/projects/a91936ce1460442e972cc64271daae01/users/34a11911f4da4005951af6d1c5d4f03d/roles/5c8b89fae4fa45bd944cbeaf442136e1 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:35:25.543983 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44ece15-b32a-459d-9c16-111455e3f26c None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:25.544309 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44ece15-b32a-459d-9c16-111455e3f26c None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:25.544617 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44ece15-b32a-459d-9c16-111455e3f26c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:25.574738 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-c44ece15-b32a-459d-9c16-111455e3f26c None None] MFA Rules not processed for user `34a11911f4da4005951af6d1c5d4f03d`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:35:25.576015 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-c44ece15-b32a-459d-9c16-111455e3f26c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:35:25.653275 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1338/2635] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:35:25 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:35:25.665217 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557f4293-2026-4e44-9e17-09836bc000f8 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:35:25.675493 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-557f4293-2026-4e44-9e17-09836bc000f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:35:25.734679 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557f4293-2026-4e44-9e17-09836bc000f8 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:35:25.739184 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79114b1-910f-4c8e-8cb7-24e453f71a01 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa4d004fd44482cae761c4b3bdfab31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:35:25.740070 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79114b1-910f-4c8e-8cb7-24e453f71a01 service cinder] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:25.740389 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79114b1-910f-4c8e-8cb7-24e453f71a01 service cinder] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:25.740665 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79114b1-910f-4c8e-8cb7-24e453f71a01 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:25.751943 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79114b1-910f-4c8e-8cb7-24e453f71a01 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:35:25.753567 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79114b1-910f-4c8e-8cb7-24e453f71a01 service cinder] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:35:25.764049 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1298/2636] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:35:25 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:35:25.792891 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44ece15-b32a-459d-9c16-111455e3f26c None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:35:25.857531 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44ece15-b32a-459d-9c16-111455e3f26c None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:35:25.862435 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35645cd4-e9f8-45e2-8f3e-c7cf3347a65d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:35:25.863089 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35645cd4-e9f8-45e2-8f3e-c7cf3347a65d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:25.863371 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35645cd4-e9f8-45e2-8f3e-c7cf3347a65d admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:25.863649 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35645cd4-e9f8-45e2-8f3e-c7cf3347a65d admin admin] PATH_INFO: `/v3/users/5548d57a09894fdaa93524615a091ce2` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:25.864918 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35645cd4-e9f8-45e2-8f3e-c7cf3347a65d admin admin] RBAC: Authorizing `identity:delete_user(user_id=5548d57a09894fdaa93524615a091ce2)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:35:25.866889 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35645cd4-e9f8-45e2-8f3e-c7cf3347a65d admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:35:25.913346 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:35:25.916040 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-35645cd4-e9f8-45e2-8f3e-c7cf3347a65d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5548d57a09894fdaa93524615a091ce2'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:25.924460 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-35645cd4-e9f8-45e2-8f3e-c7cf3347a65d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5548d57a09894fdaa93524615a091ce2'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:25.925106 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-35645cd4-e9f8-45e2-8f3e-c7cf3347a65d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5548d57a09894fdaa93524615a091ce2'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:25.925724 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-35645cd4-e9f8-45e2-8f3e-c7cf3347a65d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5548d57a09894fdaa93524615a091ce2'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:25.932841 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-35645cd4-e9f8-45e2-8f3e-c7cf3347a65d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5548d57a09894fdaa93524615a091ce2'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:25.950032 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1339/2637] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 19 10:35:25 2022] DELETE /identity/v3/users/5548d57a09894fdaa93524615a091ce2 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:35:25.955744 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c9f980-712b-4085-b811-4b2cd0b97abc None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:25.956035 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c9f980-712b-4085-b811-4b2cd0b97abc None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:25.956408 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c9f980-712b-4085-b811-4b2cd0b97abc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:25.976620 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-a7c9f980-712b-4085-b811-4b2cd0b97abc None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:35:25.977834 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-a7c9f980-712b-4085-b811-4b2cd0b97abc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:35:25.981771 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:35:26.036995 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1299/2638] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:35:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:35:26.047782 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35645cd4-e9f8-45e2-8f3e-c7cf3347a65d admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:35:26.049465 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-35645cd4-e9f8-45e2-8f3e-c7cf3347a65d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:35:26.110313 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35645cd4-e9f8-45e2-8f3e-c7cf3347a65d admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:35:26.113983 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4546419b-0e96-47f1-8624-3142ee877601 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c1289b015854c6bb6aee8fed6b807db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:35:26.114586 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4546419b-0e96-47f1-8624-3142ee877601 service neutron] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:26.114866 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4546419b-0e96-47f1-8624-3142ee877601 service neutron] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:26.115137 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4546419b-0e96-47f1-8624-3142ee877601 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:26.123949 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4546419b-0e96-47f1-8624-3142ee877601 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:35:26.125395 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4546419b-0e96-47f1-8624-3142ee877601 service neutron] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:35:26.134730 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1340/2639] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:35:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 10:35:26.420420 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c9f980-712b-4085-b811-4b2cd0b97abc None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:35:26.422200 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-a7c9f980-712b-4085-b811-4b2cd0b97abc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:35:26.445299 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c9f980-712b-4085-b811-4b2cd0b97abc None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:35:26.452122 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca75f86b-1b8e-4da6-9a8a-3d488165aa98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:35:26.453691 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca75f86b-1b8e-4da6-9a8a-3d488165aa98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:26.454015 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca75f86b-1b8e-4da6-9a8a-3d488165aa98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:26.454420 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca75f86b-1b8e-4da6-9a8a-3d488165aa98 admin admin] PATH_INFO: `/v3/projects/a91f83b76ada473ba1a2245eead4814f` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:26.456223 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca75f86b-1b8e-4da6-9a8a-3d488165aa98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a91f83b76ada473ba1a2245eead4814f)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:35:26.458181 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca75f86b-1b8e-4da6-9a8a-3d488165aa98 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:35:26.505842 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-ca75f86b-1b8e-4da6-9a8a-3d488165aa98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a91f83b76ada473ba1a2245eead4814f', 'request_id': 'req-ca75f86b-1b8e-4da6-9a8a-3d488165aa98'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:26.512055 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-ca75f86b-1b8e-4da6-9a8a-3d488165aa98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a91f83b76ada473ba1a2245eead4814f', 'request_id': 'req-ca75f86b-1b8e-4da6-9a8a-3d488165aa98'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:26.520124 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-ca75f86b-1b8e-4da6-9a8a-3d488165aa98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a91f83b76ada473ba1a2245eead4814f', 'request_id': 'req-ca75f86b-1b8e-4da6-9a8a-3d488165aa98'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:26.530431 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-ca75f86b-1b8e-4da6-9a8a-3d488165aa98 admin admin] The token cache is being invalidate because project a91f83b76ada473ba1a2245eead4814f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 10:35:26.530716 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-ca75f86b-1b8e-4da6-9a8a-3d488165aa98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:26.531337 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-ca75f86b-1b8e-4da6-9a8a-3d488165aa98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:26.532848 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1300/2640] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 19 10:35:26 2022] DELETE /identity/v3/projects/a91f83b76ada473ba1a2245eead4814f => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:35:26.537129 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4546419b-0e96-47f1-8624-3142ee877601 service neutron] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:35:26.547944 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4546419b-0e96-47f1-8624-3142ee877601 service neutron] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:35:26.605076 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6eb812-e361-4be5-875b-76f4a9f19650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:35:26.605709 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6eb812-e361-4be5-875b-76f4a9f19650 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:26.605994 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6eb812-e361-4be5-875b-76f4a9f19650 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:26.606270 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6eb812-e361-4be5-875b-76f4a9f19650 admin admin] PATH_INFO: `/v3/users/34a11911f4da4005951af6d1c5d4f03d` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:26.607389 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6eb812-e361-4be5-875b-76f4a9f19650 admin admin] RBAC: Authorizing `identity:delete_user(user_id=34a11911f4da4005951af6d1c5d4f03d)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:35:26.609368 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6eb812-e361-4be5-875b-76f4a9f19650 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:35:26.659525 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-0f6eb812-e361-4be5-875b-76f4a9f19650 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34a11911f4da4005951af6d1c5d4f03d'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:26.668662 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-0f6eb812-e361-4be5-875b-76f4a9f19650 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34a11911f4da4005951af6d1c5d4f03d'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:26.669525 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-0f6eb812-e361-4be5-875b-76f4a9f19650 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34a11911f4da4005951af6d1c5d4f03d'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:26.670333 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-0f6eb812-e361-4be5-875b-76f4a9f19650 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34a11911f4da4005951af6d1c5d4f03d'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:26.679303 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-0f6eb812-e361-4be5-875b-76f4a9f19650 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34a11911f4da4005951af6d1c5d4f03d'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:26.683579 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:35:26.704539 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1341/2641] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 19 10:35:26 2022] DELETE /identity/v3/users/34a11911f4da4005951af6d1c5d4f03d => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:35:26.986575 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca75f86b-1b8e-4da6-9a8a-3d488165aa98 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:35:26.988020 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-ca75f86b-1b8e-4da6-9a8a-3d488165aa98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:35:27.001883 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca75f86b-1b8e-4da6-9a8a-3d488165aa98 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:35:27.058428 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a10a81-8143-44b3-8e47-aee190f67973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:35:27.058983 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a10a81-8143-44b3-8e47-aee190f67973 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:27.059264 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a10a81-8143-44b3-8e47-aee190f67973 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:27.059539 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a10a81-8143-44b3-8e47-aee190f67973 admin admin] PATH_INFO: `/v3/projects/a91936ce1460442e972cc64271daae01` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:27.060672 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a10a81-8143-44b3-8e47-aee190f67973 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a91936ce1460442e972cc64271daae01)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:35:27.062596 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a10a81-8143-44b3-8e47-aee190f67973 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:35:27.103022 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:35:27.116076 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-97a10a81-8143-44b3-8e47-aee190f67973 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a91936ce1460442e972cc64271daae01', 'request_id': 'req-97a10a81-8143-44b3-8e47-aee190f67973'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:27.122437 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-97a10a81-8143-44b3-8e47-aee190f67973 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a91936ce1460442e972cc64271daae01', 'request_id': 'req-97a10a81-8143-44b3-8e47-aee190f67973'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:27.130321 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-97a10a81-8143-44b3-8e47-aee190f67973 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a91936ce1460442e972cc64271daae01', 'request_id': 'req-97a10a81-8143-44b3-8e47-aee190f67973'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:27.140567 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-97a10a81-8143-44b3-8e47-aee190f67973 admin admin] The token cache is being invalidate because project a91936ce1460442e972cc64271daae01 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 10:35:27.140883 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-97a10a81-8143-44b3-8e47-aee190f67973 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:27.141490 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-97a10a81-8143-44b3-8e47-aee190f67973 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:27.143563 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1301/2642] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 19 10:35:26 2022] DELETE /identity/v3/projects/a91936ce1460442e972cc64271daae01 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:35:27.148642 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3cde58-030a-417f-a0c9-14b245c60d5e None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:27.149088 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3cde58-030a-417f-a0c9-14b245c60d5e None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:27.149456 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3cde58-030a-417f-a0c9-14b245c60d5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:27.171843 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-4b3cde58-030a-417f-a0c9-14b245c60d5e None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:35:27.173112 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-4b3cde58-030a-417f-a0c9-14b245c60d5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:35:27.238010 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1342/2643] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:35:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:35:27.245769 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb1eaf9-a3f2-40fb-82a7-f2a4128f1fa4 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:27.246059 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb1eaf9-a3f2-40fb-82a7-f2a4128f1fa4 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:27.246341 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb1eaf9-a3f2-40fb-82a7-f2a4128f1fa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:27.266454 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-ebb1eaf9-a3f2-40fb-82a7-f2a4128f1fa4 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:35:27.268426 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-ebb1eaf9-a3f2-40fb-82a7-f2a4128f1fa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:35:27.276416 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1302/2644] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:35:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:35:27.280647 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3cde58-030a-417f-a0c9-14b245c60d5e None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:35:27.290458 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3cde58-030a-417f-a0c9-14b245c60d5e None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:35:27.295278 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d2a10c-1fed-4940-bcd7-3b79cdaa09f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:35:27.295875 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d2a10c-1fed-4940-bcd7-3b79cdaa09f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:27.296157 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d2a10c-1fed-4940-bcd7-3b79cdaa09f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:27.296468 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d2a10c-1fed-4940-bcd7-3b79cdaa09f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:27.297106 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d2a10c-1fed-4940-bcd7-3b79cdaa09f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:35:27.297409 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d2a10c-1fed-4940-bcd7-3b79cdaa09f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:35:27.299512 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d2a10c-1fed-4940-bcd7-3b79cdaa09f0 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:35:27.311093 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1343/2645] 10.222.0.66 () {58 vars in 1153 bytes} [Mon Sep 19 10:35:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 10:35:27.316438 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb1eaf9-a3f2-40fb-82a7-f2a4128f1fa4 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:35:27.326602 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb1eaf9-a3f2-40fb-82a7-f2a4128f1fa4 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:35:27.331542 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e5462f-57f0-4be9-9d9d-6a9d0d0c6605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:35:27.332199 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e5462f-57f0-4be9-9d9d-6a9d0d0c6605 admin admin] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:27.332486 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e5462f-57f0-4be9-9d9d-6a9d0d0c6605 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:27.332766 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e5462f-57f0-4be9-9d9d-6a9d0d0c6605 admin admin] PATH_INFO: `/v3/projects` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:27.333428 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e5462f-57f0-4be9-9d9d-6a9d0d0c6605 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:35:27.335368 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e5462f-57f0-4be9-9d9d-6a9d0d0c6605 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:35:27.364154 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1303/2646] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 19 10:35:27 2022] POST /identity/v3/projects => generated 399 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:35:27.368326 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d2a10c-1fed-4940-bcd7-3b79cdaa09f0 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:35:27.379065 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d2a10c-1fed-4940-bcd7-3b79cdaa09f0 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:35:27.436510 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde8bcf1-32f0-4cb4-80d2-e6569ea816c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:35:27.437099 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde8bcf1-32f0-4cb4-80d2-e6569ea816c4 admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:27.437380 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde8bcf1-32f0-4cb4-80d2-e6569ea816c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:27.437655 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde8bcf1-32f0-4cb4-80d2-e6569ea816c4 admin admin] PATH_INFO: `/v3/users` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:27.438293 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde8bcf1-32f0-4cb4-80d2-e6569ea816c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:35:27.440959 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde8bcf1-32f0-4cb4-80d2-e6569ea816c4 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:35:27.464731 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1344/2647] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 19 10:35:27 2022] POST /identity/v3/users => generated 300 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 10:35:27.468705 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e5462f-57f0-4be9-9d9d-6a9d0d0c6605 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:35:27.479598 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e5462f-57f0-4be9-9d9d-6a9d0d0c6605 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:35:27.486922 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e595fada-f655-46ee-8b67-5f7052da6e55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:35:27.489898 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e595fada-f655-46ee-8b67-5f7052da6e55 admin admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:27.490186 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e595fada-f655-46ee-8b67-5f7052da6e55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:27.490464 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e595fada-f655-46ee-8b67-5f7052da6e55 admin admin] PATH_INFO: `/v3/roles` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:27.491120 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e595fada-f655-46ee-8b67-5f7052da6e55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:35:27.492763 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e595fada-f655-46ee-8b67-5f7052da6e55 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:35:27.504236 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1304/2648] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:35:27 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 10:35:27.508266 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde8bcf1-32f0-4cb4-80d2-e6569ea816c4 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:35:27.518812 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde8bcf1-32f0-4cb4-80d2-e6569ea816c4 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:35:27.523762 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addab1ef-c52f-4d8d-82f8-7e3611cd2a3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:35:27.524477 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addab1ef-c52f-4d8d-82f8-7e3611cd2a3a admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:27.524704 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addab1ef-c52f-4d8d-82f8-7e3611cd2a3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:27.524983 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addab1ef-c52f-4d8d-82f8-7e3611cd2a3a admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:27.525656 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addab1ef-c52f-4d8d-82f8-7e3611cd2a3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:35:27.527247 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addab1ef-c52f-4d8d-82f8-7e3611cd2a3a admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:35:27.538807 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1345/2649] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:35:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 10:35:27.542942 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e595fada-f655-46ee-8b67-5f7052da6e55 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:35:27.553982 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e595fada-f655-46ee-8b67-5f7052da6e55 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:35:27.558759 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8578db-0243-41c2-9bcc-a92a28d3b40a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:35:27.559421 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8578db-0243-41c2-9bcc-a92a28d3b40a admin admin] REQUEST_METHOD: `PUT` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:27.559705 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8578db-0243-41c2-9bcc-a92a28d3b40a admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:27.559980 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8578db-0243-41c2-9bcc-a92a28d3b40a admin admin] PATH_INFO: `/v3/projects/da23703bd6bc4b0d95bfc8f5fb0c1484/users/80ee1632fdb04436a0c94fec7e584eaa/roles/cd5b42ed3b754b58817a62bbe74651b4` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:27.575759 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8578db-0243-41c2-9bcc-a92a28d3b40a admin admin] RBAC: Authorizing `identity:create_grant(project_id=da23703bd6bc4b0d95bfc8f5fb0c1484, user_id=80ee1632fdb04436a0c94fec7e584eaa, role_id=cd5b42ed3b754b58817a62bbe74651b4)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:35:27.578473 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8578db-0243-41c2-9bcc-a92a28d3b40a admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:35:27.594182 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1305/2650] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 19 10:35:27 2022] PUT /identity/v3/projects/da23703bd6bc4b0d95bfc8f5fb0c1484/users/80ee1632fdb04436a0c94fec7e584eaa/roles/cd5b42ed3b754b58817a62bbe74651b4 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:35:27.605539 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fc41db-ef2c-4919-be68-461bda25db69 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:27.605951 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fc41db-ef2c-4919-be68-461bda25db69 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:27.606303 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fc41db-ef2c-4919-be68-461bda25db69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:27.636213 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-d1fc41db-ef2c-4919-be68-461bda25db69 None None] MFA Rules not processed for user `80ee1632fdb04436a0c94fec7e584eaa`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:35:27.637422 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-d1fc41db-ef2c-4919-be68-461bda25db69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:35:27.677066 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:35:27.705665 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1346/2651] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:35:27 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:35:27.710557 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8578db-0243-41c2-9bcc-a92a28d3b40a admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:35:27.773656 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8578db-0243-41c2-9bcc-a92a28d3b40a admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:35:27.781231 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293321b2-e6b5-483d-a0ef-91670c41bf18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:35:27.781834 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293321b2-e6b5-483d-a0ef-91670c41bf18 admin admin] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:27.782111 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293321b2-e6b5-483d-a0ef-91670c41bf18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:27.782404 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293321b2-e6b5-483d-a0ef-91670c41bf18 admin admin] PATH_INFO: `/v3/projects` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:27.783510 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293321b2-e6b5-483d-a0ef-91670c41bf18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:35:27.785434 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293321b2-e6b5-483d-a0ef-91670c41bf18 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:35:27.814402 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1306/2652] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 19 10:35:27 2022] POST /identity/v3/projects => generated 399 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 10:35:27.825057 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fc41db-ef2c-4919-be68-461bda25db69 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:35:27.829794 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fc41db-ef2c-4919-be68-461bda25db69 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:35:27.886539 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0771fd-c8f8-47a9-a6cb-efb9bfdd568a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:35:27.887162 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0771fd-c8f8-47a9-a6cb-efb9bfdd568a admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:27.887444 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0771fd-c8f8-47a9-a6cb-efb9bfdd568a admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:27.887719 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0771fd-c8f8-47a9-a6cb-efb9bfdd568a admin admin] PATH_INFO: `/v3/users` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:27.888378 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0771fd-c8f8-47a9-a6cb-efb9bfdd568a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:35:27.890325 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0771fd-c8f8-47a9-a6cb-efb9bfdd568a admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:35:27.912255 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1347/2653] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 19 10:35:27 2022] POST /identity/v3/users => generated 306 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:35:27.916691 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293321b2-e6b5-483d-a0ef-91670c41bf18 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:35:27.928706 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293321b2-e6b5-483d-a0ef-91670c41bf18 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:35:27.933702 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20c3403-2531-4c85-9470-1d36bbef0e6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:35:27.934317 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20c3403-2531-4c85-9470-1d36bbef0e6f admin admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:27.934626 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20c3403-2531-4c85-9470-1d36bbef0e6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:27.934907 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20c3403-2531-4c85-9470-1d36bbef0e6f admin admin] PATH_INFO: `/v3/roles` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:27.935549 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20c3403-2531-4c85-9470-1d36bbef0e6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:35:27.937196 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20c3403-2531-4c85-9470-1d36bbef0e6f admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:35:27.948089 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1307/2654] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:35:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 10:35:27.952373 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0771fd-c8f8-47a9-a6cb-efb9bfdd568a admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:35:27.962458 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0771fd-c8f8-47a9-a6cb-efb9bfdd568a admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:35:27.967259 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da696680-ca68-44dd-9551-351139cbef4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:35:27.967912 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da696680-ca68-44dd-9551-351139cbef4f admin admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:27.968220 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da696680-ca68-44dd-9551-351139cbef4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:27.968485 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da696680-ca68-44dd-9551-351139cbef4f admin admin] PATH_INFO: `/v3/projects/e10d6034a30346a2950c8e39b1a87686/users/5de5bd4fbc164f7cb7a05b53b8876835/roles/5c8b89fae4fa45bd944cbeaf442136e1` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:27.983716 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da696680-ca68-44dd-9551-351139cbef4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e10d6034a30346a2950c8e39b1a87686, user_id=5de5bd4fbc164f7cb7a05b53b8876835, role_id=5c8b89fae4fa45bd944cbeaf442136e1)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:35:27.987129 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da696680-ca68-44dd-9551-351139cbef4f admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:35:28.000116 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1348/2655] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 19 10:35:27 2022] PUT /identity/v3/projects/e10d6034a30346a2950c8e39b1a87686/users/5de5bd4fbc164f7cb7a05b53b8876835/roles/5c8b89fae4fa45bd944cbeaf442136e1 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:35:28.004043 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20c3403-2531-4c85-9470-1d36bbef0e6f admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:35:28.014185 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20c3403-2531-4c85-9470-1d36bbef0e6f admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:35:28.047305 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:35:28.076832 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2905f9-e81f-4167-a1fa-c675863f5603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:35:28.077424 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2905f9-e81f-4167-a1fa-c675863f5603 admin admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:28.077707 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2905f9-e81f-4167-a1fa-c675863f5603 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:28.078161 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2905f9-e81f-4167-a1fa-c675863f5603 admin admin] PATH_INFO: `/v3/roles` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:28.078884 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2905f9-e81f-4167-a1fa-c675863f5603 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:35:28.081058 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2905f9-e81f-4167-a1fa-c675863f5603 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:35:28.090879 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1308/2656] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:35:28 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 10:35:28.095885 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da696680-ca68-44dd-9551-351139cbef4f admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:35:28.106107 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da696680-ca68-44dd-9551-351139cbef4f admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:35:28.111694 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9990ac65-c117-4b82-add4-99f1a5e3157f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:35:28.112371 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9990ac65-c117-4b82-add4-99f1a5e3157f admin admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:28.112650 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9990ac65-c117-4b82-add4-99f1a5e3157f admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:28.112922 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9990ac65-c117-4b82-add4-99f1a5e3157f admin admin] PATH_INFO: `/v3/projects/e10d6034a30346a2950c8e39b1a87686/users/5de5bd4fbc164f7cb7a05b53b8876835/roles/5c8b89fae4fa45bd944cbeaf442136e1` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:28.114819 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9990ac65-c117-4b82-add4-99f1a5e3157f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e10d6034a30346a2950c8e39b1a87686, user_id=5de5bd4fbc164f7cb7a05b53b8876835, role_id=5c8b89fae4fa45bd944cbeaf442136e1)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:35:28.117545 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9990ac65-c117-4b82-add4-99f1a5e3157f admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:35:28.127631 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1349/2657] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 19 10:35:28 2022] PUT /identity/v3/projects/e10d6034a30346a2950c8e39b1a87686/users/5de5bd4fbc164f7cb7a05b53b8876835/roles/5c8b89fae4fa45bd944cbeaf442136e1 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:35:28.138751 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a7d960-111f-4ca2-8829-17109cf9b051 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:28.139031 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a7d960-111f-4ca2-8829-17109cf9b051 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:28.139303 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a7d960-111f-4ca2-8829-17109cf9b051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:28.170693 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-33a7d960-111f-4ca2-8829-17109cf9b051 None None] MFA Rules not processed for user `5de5bd4fbc164f7cb7a05b53b8876835`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:35:28.171907 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-33a7d960-111f-4ca2-8829-17109cf9b051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:35:28.240140 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1309/2658] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:35:28 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:35:28.251043 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9990ac65-c117-4b82-add4-99f1a5e3157f admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:35:28.252911 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-9990ac65-c117-4b82-add4-99f1a5e3157f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:35:28.312456 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9990ac65-c117-4b82-add4-99f1a5e3157f admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:35:28.316121 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4df0f7-7d09-4be1-96f0-d506c1112967 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa4d004fd44482cae761c4b3bdfab31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:35:28.316765 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4df0f7-7d09-4be1-96f0-d506c1112967 service cinder] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:28.317072 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4df0f7-7d09-4be1-96f0-d506c1112967 service cinder] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:28.317368 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4df0f7-7d09-4be1-96f0-d506c1112967 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:28.326358 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4df0f7-7d09-4be1-96f0-d506c1112967 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:35:28.327842 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4df0f7-7d09-4be1-96f0-d506c1112967 service cinder] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:35:28.338034 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1350/2659] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:35:28 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:35:28.420137 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a7d960-111f-4ca2-8829-17109cf9b051 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:35:28.430535 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a7d960-111f-4ca2-8829-17109cf9b051 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:35:28.434192 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d91213-775d-45c4-a96d-53e612a350ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa4d004fd44482cae761c4b3bdfab31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:35:28.434796 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d91213-775d-45c4-a96d-53e612a350ab service cinder] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:28.435106 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d91213-775d-45c4-a96d-53e612a350ab service cinder] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:28.435380 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d91213-775d-45c4-a96d-53e612a350ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:28.495803 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d91213-775d-45c4-a96d-53e612a350ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:35:28.497277 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d91213-775d-45c4-a96d-53e612a350ab service cinder] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:35:28.506581 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1310/2660] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:35:28 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:35:32.650500 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4df0f7-7d09-4be1-96f0-d506c1112967 service cinder] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:35:32.685766 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:35:32.715379 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4df0f7-7d09-4be1-96f0-d506c1112967 service cinder] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:35:32.719907 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbaf137-4b1d-4195-9a0f-ee235b3c92b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:35:32.720557 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbaf137-4b1d-4195-9a0f-ee235b3c92b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:32.720838 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbaf137-4b1d-4195-9a0f-ee235b3c92b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:32.721108 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbaf137-4b1d-4195-9a0f-ee235b3c92b9 admin admin] PATH_INFO: `/v3/users/80ee1632fdb04436a0c94fec7e584eaa` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:32.722260 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbaf137-4b1d-4195-9a0f-ee235b3c92b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=80ee1632fdb04436a0c94fec7e584eaa)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:35:32.724190 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbaf137-4b1d-4195-9a0f-ee235b3c92b9 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:35:32.771723 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-0fbaf137-4b1d-4195-9a0f-ee235b3c92b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80ee1632fdb04436a0c94fec7e584eaa'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:32.780531 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-0fbaf137-4b1d-4195-9a0f-ee235b3c92b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80ee1632fdb04436a0c94fec7e584eaa'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:32.781298 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-0fbaf137-4b1d-4195-9a0f-ee235b3c92b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80ee1632fdb04436a0c94fec7e584eaa'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:32.781802 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-0fbaf137-4b1d-4195-9a0f-ee235b3c92b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80ee1632fdb04436a0c94fec7e584eaa'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:32.789855 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-0fbaf137-4b1d-4195-9a0f-ee235b3c92b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80ee1632fdb04436a0c94fec7e584eaa'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:32.807937 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1351/2661] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 19 10:35:32 2022] DELETE /identity/v3/users/80ee1632fdb04436a0c94fec7e584eaa => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:35:32.812423 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be3bdbb-0afe-4c5d-a001-045e65c2d0dc None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:32.812904 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be3bdbb-0afe-4c5d-a001-045e65c2d0dc None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:32.813001 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be3bdbb-0afe-4c5d-a001-045e65c2d0dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:32.832106 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-3be3bdbb-0afe-4c5d-a001-045e65c2d0dc None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:35:32.833343 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-3be3bdbb-0afe-4c5d-a001-045e65c2d0dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:35:32.897655 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:35:32.910766 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1311/2662] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:35:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:35:32.921743 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbaf137-4b1d-4195-9a0f-ee235b3c92b9 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:35:32.923295 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-0fbaf137-4b1d-4195-9a0f-ee235b3c92b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:35:32.981021 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbaf137-4b1d-4195-9a0f-ee235b3c92b9 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:35:32.984843 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099e9d27-c299-4b06-9225-25552811fd30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c1289b015854c6bb6aee8fed6b807db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:35:32.985449 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099e9d27-c299-4b06-9225-25552811fd30 service neutron] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:32.985732 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099e9d27-c299-4b06-9225-25552811fd30 service neutron] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:32.986029 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099e9d27-c299-4b06-9225-25552811fd30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:32.996155 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099e9d27-c299-4b06-9225-25552811fd30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:35:32.997607 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099e9d27-c299-4b06-9225-25552811fd30 service neutron] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:35:33.007104 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1352/2663] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:35:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 10:35:33.291125 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be3bdbb-0afe-4c5d-a001-045e65c2d0dc None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:35:33.292289 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-3be3bdbb-0afe-4c5d-a001-045e65c2d0dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:35:33.304753 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be3bdbb-0afe-4c5d-a001-045e65c2d0dc None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:35:33.309370 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad20473-ad29-4516-8145-b9e6410b8785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:35:33.310012 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad20473-ad29-4516-8145-b9e6410b8785 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:33.310296 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad20473-ad29-4516-8145-b9e6410b8785 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:33.310574 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad20473-ad29-4516-8145-b9e6410b8785 admin admin] PATH_INFO: `/v3/projects/da23703bd6bc4b0d95bfc8f5fb0c1484` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:33.311717 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad20473-ad29-4516-8145-b9e6410b8785 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da23703bd6bc4b0d95bfc8f5fb0c1484)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:35:33.313684 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad20473-ad29-4516-8145-b9e6410b8785 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:35:33.361973 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-4ad20473-ad29-4516-8145-b9e6410b8785 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da23703bd6bc4b0d95bfc8f5fb0c1484', 'request_id': 'req-4ad20473-ad29-4516-8145-b9e6410b8785'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:33.369093 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-4ad20473-ad29-4516-8145-b9e6410b8785 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da23703bd6bc4b0d95bfc8f5fb0c1484', 'request_id': 'req-4ad20473-ad29-4516-8145-b9e6410b8785'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:33.376634 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-4ad20473-ad29-4516-8145-b9e6410b8785 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da23703bd6bc4b0d95bfc8f5fb0c1484', 'request_id': 'req-4ad20473-ad29-4516-8145-b9e6410b8785'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:33.387301 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-4ad20473-ad29-4516-8145-b9e6410b8785 admin admin] The token cache is being invalidate because project da23703bd6bc4b0d95bfc8f5fb0c1484 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 10:35:33.387585 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-4ad20473-ad29-4516-8145-b9e6410b8785 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:33.388244 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-4ad20473-ad29-4516-8145-b9e6410b8785 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:33.389720 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1312/2664] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 19 10:35:33 2022] DELETE /identity/v3/projects/da23703bd6bc4b0d95bfc8f5fb0c1484 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 10:35:33.393763 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099e9d27-c299-4b06-9225-25552811fd30 service neutron] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:35:33.403825 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099e9d27-c299-4b06-9225-25552811fd30 service neutron] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:35:33.454287 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:35:33.462675 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39db5e63-1140-4dce-b79f-02a9c865b274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:35:33.463313 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39db5e63-1140-4dce-b79f-02a9c865b274 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:33.464275 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39db5e63-1140-4dce-b79f-02a9c865b274 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:33.464275 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39db5e63-1140-4dce-b79f-02a9c865b274 admin admin] PATH_INFO: `/v3/users/5de5bd4fbc164f7cb7a05b53b8876835` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:33.465382 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39db5e63-1140-4dce-b79f-02a9c865b274 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5de5bd4fbc164f7cb7a05b53b8876835)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:35:33.467526 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39db5e63-1140-4dce-b79f-02a9c865b274 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:35:33.525520 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-39db5e63-1140-4dce-b79f-02a9c865b274 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5de5bd4fbc164f7cb7a05b53b8876835'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:33.533938 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-39db5e63-1140-4dce-b79f-02a9c865b274 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5de5bd4fbc164f7cb7a05b53b8876835'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:33.534570 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-39db5e63-1140-4dce-b79f-02a9c865b274 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5de5bd4fbc164f7cb7a05b53b8876835'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:33.535896 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-39db5e63-1140-4dce-b79f-02a9c865b274 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5de5bd4fbc164f7cb7a05b53b8876835'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:33.546141 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-39db5e63-1140-4dce-b79f-02a9c865b274 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5de5bd4fbc164f7cb7a05b53b8876835'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:33.569761 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1353/2665] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 19 10:35:33 2022] DELETE /identity/v3/users/5de5bd4fbc164f7cb7a05b53b8876835 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:35:33.858562 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad20473-ad29-4516-8145-b9e6410b8785 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:35:33.860952 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-4ad20473-ad29-4516-8145-b9e6410b8785 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:35:33.875534 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad20473-ad29-4516-8145-b9e6410b8785 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:35:33.935392 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d534b3b-e3e1-485a-aaf2-d25599bd5973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:35:33.936028 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d534b3b-e3e1-485a-aaf2-d25599bd5973 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:33.936341 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d534b3b-e3e1-485a-aaf2-d25599bd5973 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:33.936617 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d534b3b-e3e1-485a-aaf2-d25599bd5973 admin admin] PATH_INFO: `/v3/projects/e10d6034a30346a2950c8e39b1a87686` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:33.937752 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d534b3b-e3e1-485a-aaf2-d25599bd5973 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e10d6034a30346a2950c8e39b1a87686)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:35:33.939649 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d534b3b-e3e1-485a-aaf2-d25599bd5973 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:35:33.987529 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-2d534b3b-e3e1-485a-aaf2-d25599bd5973 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e10d6034a30346a2950c8e39b1a87686', 'request_id': 'req-2d534b3b-e3e1-485a-aaf2-d25599bd5973'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:33.994771 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-2d534b3b-e3e1-485a-aaf2-d25599bd5973 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e10d6034a30346a2950c8e39b1a87686', 'request_id': 'req-2d534b3b-e3e1-485a-aaf2-d25599bd5973'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:34.001741 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-2d534b3b-e3e1-485a-aaf2-d25599bd5973 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e10d6034a30346a2950c8e39b1a87686', 'request_id': 'req-2d534b3b-e3e1-485a-aaf2-d25599bd5973'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:34.012370 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-2d534b3b-e3e1-485a-aaf2-d25599bd5973 admin admin] The token cache is being invalidate because project e10d6034a30346a2950c8e39b1a87686 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 10:35:34.012655 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-2d534b3b-e3e1-485a-aaf2-d25599bd5973 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:34.013294 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-2d534b3b-e3e1-485a-aaf2-d25599bd5973 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:34.014773 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1313/2666] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 19 10:35:33 2022] DELETE /identity/v3/projects/e10d6034a30346a2950c8e39b1a87686 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:35:34.020259 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc2410e-c880-4a5f-be48-9975af3a0e7f None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:34.020772 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc2410e-c880-4a5f-be48-9975af3a0e7f None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:34.020872 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc2410e-c880-4a5f-be48-9975af3a0e7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:34.040488 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-adc2410e-c880-4a5f-be48-9975af3a0e7f None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:35:34.041735 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-adc2410e-c880-4a5f-be48-9975af3a0e7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:35:34.099658 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1354/2667] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:35:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:35:34.108422 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdb211f-b1df-48fe-a735-436f45959e36 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:34.108713 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdb211f-b1df-48fe-a735-436f45959e36 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:34.108991 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdb211f-b1df-48fe-a735-436f45959e36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:34.124857 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:35:34.130960 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-8cdb211f-b1df-48fe-a735-436f45959e36 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:35:34.132930 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-8cdb211f-b1df-48fe-a735-436f45959e36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:35:34.141654 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1314/2668] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:35:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:35:34.146324 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc2410e-c880-4a5f-be48-9975af3a0e7f None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:35:34.156345 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc2410e-c880-4a5f-be48-9975af3a0e7f None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:35:34.162020 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81169f8c-bfca-4b2e-a35a-98ea0da00a10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:35:34.162623 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81169f8c-bfca-4b2e-a35a-98ea0da00a10 admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:34.162899 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81169f8c-bfca-4b2e-a35a-98ea0da00a10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:34.163183 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81169f8c-bfca-4b2e-a35a-98ea0da00a10 admin admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:34.163815 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81169f8c-bfca-4b2e-a35a-98ea0da00a10 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:35:34.164112 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81169f8c-bfca-4b2e-a35a-98ea0da00a10 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:35:34.165729 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81169f8c-bfca-4b2e-a35a-98ea0da00a10 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:35:34.177949 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1355/2669] 10.222.0.66 () {58 vars in 1153 bytes} [Mon Sep 19 10:35:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:35:34.182504 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdb211f-b1df-48fe-a735-436f45959e36 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:35:34.192244 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdb211f-b1df-48fe-a735-436f45959e36 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:35:34.196980 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930745c3-1f65-40db-b6d3-a2d1626191c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:35:34.197585 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930745c3-1f65-40db-b6d3-a2d1626191c3 admin admin] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:34.197866 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930745c3-1f65-40db-b6d3-a2d1626191c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:34.198143 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930745c3-1f65-40db-b6d3-a2d1626191c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:34.198772 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930745c3-1f65-40db-b6d3-a2d1626191c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:35:34.200696 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930745c3-1f65-40db-b6d3-a2d1626191c3 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:35:34.230992 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1315/2670] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 19 10:35:34 2022] POST /identity/v3/projects => generated 383 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:35:34.235275 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81169f8c-bfca-4b2e-a35a-98ea0da00a10 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:35:34.246457 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81169f8c-bfca-4b2e-a35a-98ea0da00a10 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:35:34.310368 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37b3610-2165-46b5-a28f-bd135ea5278d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:35:34.310986 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37b3610-2165-46b5-a28f-bd135ea5278d admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:34.311269 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37b3610-2165-46b5-a28f-bd135ea5278d admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:34.311546 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37b3610-2165-46b5-a28f-bd135ea5278d admin admin] PATH_INFO: `/v3/users` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:34.312202 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37b3610-2165-46b5-a28f-bd135ea5278d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:35:34.314130 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37b3610-2165-46b5-a28f-bd135ea5278d admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:35:34.323930 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:35:34.341888 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1356/2671] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 19 10:35:34 2022] POST /identity/v3/users => generated 292 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:35:34.343209 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930745c3-1f65-40db-b6d3-a2d1626191c3 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:35:34.354228 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930745c3-1f65-40db-b6d3-a2d1626191c3 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:35:34.359101 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74dacbc-eb6f-463a-8eff-9111155dae2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:35:34.359700 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74dacbc-eb6f-463a-8eff-9111155dae2f admin admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:34.359997 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74dacbc-eb6f-463a-8eff-9111155dae2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:34.360294 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74dacbc-eb6f-463a-8eff-9111155dae2f admin admin] PATH_INFO: `/v3/roles` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:34.361033 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74dacbc-eb6f-463a-8eff-9111155dae2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:35:34.362554 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74dacbc-eb6f-463a-8eff-9111155dae2f admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:35:34.373356 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1316/2672] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:35:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 10:35:34.377580 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37b3610-2165-46b5-a28f-bd135ea5278d admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:35:34.388433 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37b3610-2165-46b5-a28f-bd135ea5278d admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:35:34.393557 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a8ce32-8f61-4339-ab10-9439993c6ddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:35:34.394238 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a8ce32-8f61-4339-ab10-9439993c6ddd admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:34.394599 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a8ce32-8f61-4339-ab10-9439993c6ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:34.394934 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a8ce32-8f61-4339-ab10-9439993c6ddd admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:34.395733 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a8ce32-8f61-4339-ab10-9439993c6ddd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:35:34.397943 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a8ce32-8f61-4339-ab10-9439993c6ddd admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:35:34.410058 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1357/2673] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:35:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 10:35:34.415851 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74dacbc-eb6f-463a-8eff-9111155dae2f admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:35:34.427865 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74dacbc-eb6f-463a-8eff-9111155dae2f admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:35:34.432645 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36248ce3-869b-4819-bd3a-04c70970b93d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:35:34.433305 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36248ce3-869b-4819-bd3a-04c70970b93d admin admin] REQUEST_METHOD: `PUT` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:34.433582 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36248ce3-869b-4819-bd3a-04c70970b93d admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:34.433856 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36248ce3-869b-4819-bd3a-04c70970b93d admin admin] PATH_INFO: `/v3/projects/986226435c3a43d2a73a63001d947da8/users/d8dbfb67cdd14921a31419afe79d15ca/roles/cd5b42ed3b754b58817a62bbe74651b4` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:34.449023 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36248ce3-869b-4819-bd3a-04c70970b93d admin admin] RBAC: Authorizing `identity:create_grant(project_id=986226435c3a43d2a73a63001d947da8, user_id=d8dbfb67cdd14921a31419afe79d15ca, role_id=cd5b42ed3b754b58817a62bbe74651b4)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:35:34.451802 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36248ce3-869b-4819-bd3a-04c70970b93d admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:35:34.468421 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1317/2674] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 19 10:35:34 2022] PUT /identity/v3/projects/986226435c3a43d2a73a63001d947da8/users/d8dbfb67cdd14921a31419afe79d15ca/roles/cd5b42ed3b754b58817a62bbe74651b4 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:35:34.480230 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f21c14a-bd48-48a6-8ac9-154a1f639704 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:34.480533 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f21c14a-bd48-48a6-8ac9-154a1f639704 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:34.480853 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f21c14a-bd48-48a6-8ac9-154a1f639704 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:34.513581 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-3f21c14a-bd48-48a6-8ac9-154a1f639704 None None] MFA Rules not processed for user `d8dbfb67cdd14921a31419afe79d15ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:35:34.514952 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-3f21c14a-bd48-48a6-8ac9-154a1f639704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:35:34.601226 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1358/2675] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:35:34 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:35:34.605667 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36248ce3-869b-4819-bd3a-04c70970b93d admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:35:34.676660 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36248ce3-869b-4819-bd3a-04c70970b93d admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:35:34.682173 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029a0d46-3f21-4293-ac30-5d2a024c2594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:35:34.682947 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029a0d46-3f21-4293-ac30-5d2a024c2594 admin admin] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:34.683290 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029a0d46-3f21-4293-ac30-5d2a024c2594 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:34.683679 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029a0d46-3f21-4293-ac30-5d2a024c2594 admin admin] PATH_INFO: `/v3/projects` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:34.684507 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029a0d46-3f21-4293-ac30-5d2a024c2594 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:35:34.689549 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029a0d46-3f21-4293-ac30-5d2a024c2594 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:35:34.722738 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1318/2676] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 19 10:35:34 2022] POST /identity/v3/projects => generated 383 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:35:34.725257 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f21c14a-bd48-48a6-8ac9-154a1f639704 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:35:34.736845 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f21c14a-bd48-48a6-8ac9-154a1f639704 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:35:34.795284 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f602888c-9fb5-4af6-9e01-e545ed40433d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:35:34.795900 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f602888c-9fb5-4af6-9e01-e545ed40433d admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:34.796186 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f602888c-9fb5-4af6-9e01-e545ed40433d admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:34.796481 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f602888c-9fb5-4af6-9e01-e545ed40433d admin admin] PATH_INFO: `/v3/users` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:34.797116 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f602888c-9fb5-4af6-9e01-e545ed40433d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:35:34.799068 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f602888c-9fb5-4af6-9e01-e545ed40433d admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:35:34.823364 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1359/2677] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 19 10:35:34 2022] POST /identity/v3/users => generated 298 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:35:34.827478 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029a0d46-3f21-4293-ac30-5d2a024c2594 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:35:34.838136 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029a0d46-3f21-4293-ac30-5d2a024c2594 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:35:34.842711 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8f862a-fd18-4707-a3e2-03a6a9c8f9d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:35:34.843297 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8f862a-fd18-4707-a3e2-03a6a9c8f9d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:34.843577 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8f862a-fd18-4707-a3e2-03a6a9c8f9d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:34.843851 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8f862a-fd18-4707-a3e2-03a6a9c8f9d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:34.844523 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8f862a-fd18-4707-a3e2-03a6a9c8f9d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:35:34.846125 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8f862a-fd18-4707-a3e2-03a6a9c8f9d7 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:35:34.856804 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1319/2678] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:35:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 10:35:34.860936 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f602888c-9fb5-4af6-9e01-e545ed40433d admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:35:34.871338 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f602888c-9fb5-4af6-9e01-e545ed40433d admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:35:34.875921 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc325c7-4d21-484a-a317-cdde5add519d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:35:34.876621 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc325c7-4d21-484a-a317-cdde5add519d admin admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:34.876886 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc325c7-4d21-484a-a317-cdde5add519d admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:34.877159 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc325c7-4d21-484a-a317-cdde5add519d admin admin] PATH_INFO: `/v3/projects/d90b9ed93db743de983e3f69c76a019e/users/a27f0f328267466c8cace0a278cc694b/roles/5c8b89fae4fa45bd944cbeaf442136e1` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:34.895582 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc325c7-4d21-484a-a317-cdde5add519d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d90b9ed93db743de983e3f69c76a019e, user_id=a27f0f328267466c8cace0a278cc694b, role_id=5c8b89fae4fa45bd944cbeaf442136e1)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:35:34.898570 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc325c7-4d21-484a-a317-cdde5add519d admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:35:34.911974 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1360/2679] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 19 10:35:34 2022] PUT /identity/v3/projects/d90b9ed93db743de983e3f69c76a019e/users/a27f0f328267466c8cace0a278cc694b/roles/5c8b89fae4fa45bd944cbeaf442136e1 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:35:34.916460 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8f862a-fd18-4707-a3e2-03a6a9c8f9d7 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:35:34.927110 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8f862a-fd18-4707-a3e2-03a6a9c8f9d7 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:35:34.984159 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b90f4d4-4e44-422f-b29f-14142549fc0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:35:34.984791 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b90f4d4-4e44-422f-b29f-14142549fc0d admin admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:34.985068 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b90f4d4-4e44-422f-b29f-14142549fc0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:34.985339 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b90f4d4-4e44-422f-b29f-14142549fc0d admin admin] PATH_INFO: `/v3/roles` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:34.985968 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b90f4d4-4e44-422f-b29f-14142549fc0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:35:34.987622 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b90f4d4-4e44-422f-b29f-14142549fc0d admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:35:34.997492 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1320/2680] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:35:34 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 10:35:35.001718 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc325c7-4d21-484a-a317-cdde5add519d admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:35:35.012012 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc325c7-4d21-484a-a317-cdde5add519d admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:35:35.016633 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96158850-8dab-4494-9764-387bce9e43c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:35:35.017280 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96158850-8dab-4494-9764-387bce9e43c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:35.017558 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96158850-8dab-4494-9764-387bce9e43c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:35.017832 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96158850-8dab-4494-9764-387bce9e43c5 admin admin] PATH_INFO: `/v3/projects/d90b9ed93db743de983e3f69c76a019e/users/a27f0f328267466c8cace0a278cc694b/roles/5c8b89fae4fa45bd944cbeaf442136e1` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:35.020266 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96158850-8dab-4494-9764-387bce9e43c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d90b9ed93db743de983e3f69c76a019e, user_id=a27f0f328267466c8cace0a278cc694b, role_id=5c8b89fae4fa45bd944cbeaf442136e1)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:35:35.022879 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96158850-8dab-4494-9764-387bce9e43c5 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:35:35.032864 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1361/2681] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 19 10:35:35 2022] PUT /identity/v3/projects/d90b9ed93db743de983e3f69c76a019e/users/a27f0f328267466c8cace0a278cc694b/roles/5c8b89fae4fa45bd944cbeaf442136e1 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:35:35.043948 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcacad6-7f9e-4323-b7b0-f91bd8d52709 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:35.044274 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcacad6-7f9e-4323-b7b0-f91bd8d52709 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:35.044558 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcacad6-7f9e-4323-b7b0-f91bd8d52709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:35.069251 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:35:35.072780 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-ffcacad6-7f9e-4323-b7b0-f91bd8d52709 None None] MFA Rules not processed for user `a27f0f328267466c8cace0a278cc694b`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:35:35.074673 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-ffcacad6-7f9e-4323-b7b0-f91bd8d52709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:35:35.143026 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1321/2682] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:35:35 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:35:35.154479 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96158850-8dab-4494-9764-387bce9e43c5 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:35:35.156159 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-96158850-8dab-4494-9764-387bce9e43c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:35:35.183330 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:INSERT=7,keystone:SELECT=93 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:35:35.243587 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96158850-8dab-4494-9764-387bce9e43c5 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:35:35.247233 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4f4ba5-b014-4451-bc2a-792a284d2338 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa4d004fd44482cae761c4b3bdfab31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:35:35.247842 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4f4ba5-b014-4451-bc2a-792a284d2338 service cinder] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:35.248123 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4f4ba5-b014-4451-bc2a-792a284d2338 service cinder] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:35.248427 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4f4ba5-b014-4451-bc2a-792a284d2338 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:35.258218 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4f4ba5-b014-4451-bc2a-792a284d2338 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:35:35.259655 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4f4ba5-b014-4451-bc2a-792a284d2338 service cinder] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:35:35.269918 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1362/2683] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:35:35 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:35:35.374631 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcacad6-7f9e-4323-b7b0-f91bd8d52709 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:35:35.384654 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcacad6-7f9e-4323-b7b0-f91bd8d52709 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:35:35.388104 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7385f936-6f9a-455f-a752-1fc181dc381f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa4d004fd44482cae761c4b3bdfab31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:35:35.388741 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7385f936-6f9a-455f-a752-1fc181dc381f service cinder] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:35.389022 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7385f936-6f9a-455f-a752-1fc181dc381f service cinder] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:35.389296 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7385f936-6f9a-455f-a752-1fc181dc381f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:35.447214 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7385f936-6f9a-455f-a752-1fc181dc381f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:35:35.448627 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7385f936-6f9a-455f-a752-1fc181dc381f service cinder] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:35:35.458713 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1322/2684] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:35:35 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:35:36.850936 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0f712b-d275-4090-b7ed-d4e71801da8d None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:36.851456 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0f712b-d275-4090-b7ed-d4e71801da8d None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:36.852121 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0f712b-d275-4090-b7ed-d4e71801da8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:36.911431 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-4a0f712b-d275-4090-b7ed-d4e71801da8d None None] MFA Rules not processed for user `e4d1160b71a84e2fa44a8ca6edf1846e`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:35:36.913292 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-4a0f712b-d275-4090-b7ed-d4e71801da8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:35:37.006104 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1363/2685] 10.222.0.66 () {58 vars in 1009 bytes} [Mon Sep 19 10:35:36 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:35:37.067175 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7385f936-6f9a-455f-a752-1fc181dc381f service cinder] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:35:37.068649 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-7385f936-6f9a-455f-a752-1fc181dc381f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:35:37.142515 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7385f936-6f9a-455f-a752-1fc181dc381f service cinder] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:35:37.148220 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59391931-5064-4995-9e44-8e79569d7d7d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6677354e36614c9fb3d03413749be5ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:35:37.148844 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59391931-5064-4995-9e44-8e79569d7d7d service swift] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:37.149161 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59391931-5064-4995-9e44-8e79569d7d7d service swift] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:37.149406 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59391931-5064-4995-9e44-8e79569d7d7d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:37.159329 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59391931-5064-4995-9e44-8e79569d7d7d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:35:37.165766 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59391931-5064-4995-9e44-8e79569d7d7d service swift] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:35:37.175920 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1323/2686] 10.222.0.66 () {60 vars in 1384 bytes} [Mon Sep 19 10:35:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 19 10:35:37.314960 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0f712b-d275-4090-b7ed-d4e71801da8d None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:35:37.314960 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-4a0f712b-d275-4090-b7ed-d4e71801da8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:35:37.390844 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0f712b-d275-4090-b7ed-d4e71801da8d None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:35:37.395005 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8975b403-1304-4877-bf46-53142de2ea8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c1289b015854c6bb6aee8fed6b807db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:35:37.395697 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8975b403-1304-4877-bf46-53142de2ea8f service neutron] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:37.396049 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8975b403-1304-4877-bf46-53142de2ea8f service neutron] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:37.396417 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8975b403-1304-4877-bf46-53142de2ea8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:37.398405 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-8975b403-1304-4877-bf46-53142de2ea8f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:35:37.475748 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:35:37.478103 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8975b403-1304-4877-bf46-53142de2ea8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:35:37.479611 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8975b403-1304-4877-bf46-53142de2ea8f service neutron] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:35:37.492891 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1364/2687] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:35:37 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:35:38.103548 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59391931-5064-4995-9e44-8e79569d7d7d service swift] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:35:38.166516 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:35:38.236025 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59391931-5064-4995-9e44-8e79569d7d7d service swift] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:35:38.248236 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7635e9d-8708-42be-9792-a2c00b695841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:35:38.248903 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7635e9d-8708-42be-9792-a2c00b695841 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:38.251081 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7635e9d-8708-42be-9792-a2c00b695841 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:38.251374 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7635e9d-8708-42be-9792-a2c00b695841 admin admin] PATH_INFO: `/v3/users/d8dbfb67cdd14921a31419afe79d15ca` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:38.254025 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7635e9d-8708-42be-9792-a2c00b695841 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8dbfb67cdd14921a31419afe79d15ca)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:35:38.259351 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7635e9d-8708-42be-9792-a2c00b695841 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:35:38.373944 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-e7635e9d-8708-42be-9792-a2c00b695841 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8dbfb67cdd14921a31419afe79d15ca'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:38.387687 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-e7635e9d-8708-42be-9792-a2c00b695841 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8dbfb67cdd14921a31419afe79d15ca'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:38.388611 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-e7635e9d-8708-42be-9792-a2c00b695841 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8dbfb67cdd14921a31419afe79d15ca'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:38.389484 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-e7635e9d-8708-42be-9792-a2c00b695841 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8dbfb67cdd14921a31419afe79d15ca'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:38.407343 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-e7635e9d-8708-42be-9792-a2c00b695841 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8dbfb67cdd14921a31419afe79d15ca'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:38.442791 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1324/2688] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 19 10:35:38 2022] DELETE /identity/v3/users/d8dbfb67cdd14921a31419afe79d15ca => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:35:38.446961 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020da9ff-a337-4400-a52a-698b3f6da2b6 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:38.447623 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020da9ff-a337-4400-a52a-698b3f6da2b6 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:38.447849 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020da9ff-a337-4400-a52a-698b3f6da2b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:38.499757 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-020da9ff-a337-4400-a52a-698b3f6da2b6 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:35:38.501044 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-020da9ff-a337-4400-a52a-698b3f6da2b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:35:38.612368 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1365/2689] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:35:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:35:38.623804 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7635e9d-8708-42be-9792-a2c00b695841 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:35:38.626373 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-e7635e9d-8708-42be-9792-a2c00b695841 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:35:38.725377 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7635e9d-8708-42be-9792-a2c00b695841 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:35:38.730400 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d70672-b87a-4631-8a54-0c5a6a11162c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c1289b015854c6bb6aee8fed6b807db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:35:38.731543 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d70672-b87a-4631-8a54-0c5a6a11162c service neutron] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:38.732074 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d70672-b87a-4631-8a54-0c5a6a11162c service neutron] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:38.732578 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d70672-b87a-4631-8a54-0c5a6a11162c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:38.743995 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d70672-b87a-4631-8a54-0c5a6a11162c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:35:38.745730 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d70672-b87a-4631-8a54-0c5a6a11162c service neutron] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:35:38.758309 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1325/2690] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:35:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:35:39.247359 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020da9ff-a337-4400-a52a-698b3f6da2b6 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:35:39.249297 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-020da9ff-a337-4400-a52a-698b3f6da2b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:35:39.273120 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020da9ff-a337-4400-a52a-698b3f6da2b6 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:35:39.278817 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c492b7ab-570d-463d-b712-facf0b446c44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:35:39.280015 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c492b7ab-570d-463d-b712-facf0b446c44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:39.280015 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c492b7ab-570d-463d-b712-facf0b446c44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:39.280361 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c492b7ab-570d-463d-b712-facf0b446c44 admin admin] PATH_INFO: `/v3/projects/986226435c3a43d2a73a63001d947da8` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:39.292823 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c492b7ab-570d-463d-b712-facf0b446c44 admin admin] RBAC: Authorizing `identity:delete_project(project_id=986226435c3a43d2a73a63001d947da8)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:35:39.302139 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c492b7ab-570d-463d-b712-facf0b446c44 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:35:39.374987 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-c492b7ab-570d-463d-b712-facf0b446c44 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '986226435c3a43d2a73a63001d947da8', 'request_id': 'req-c492b7ab-570d-463d-b712-facf0b446c44'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:39.382506 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-c492b7ab-570d-463d-b712-facf0b446c44 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '986226435c3a43d2a73a63001d947da8', 'request_id': 'req-c492b7ab-570d-463d-b712-facf0b446c44'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:39.394041 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-c492b7ab-570d-463d-b712-facf0b446c44 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '986226435c3a43d2a73a63001d947da8', 'request_id': 'req-c492b7ab-570d-463d-b712-facf0b446c44'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:39.407213 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-c492b7ab-570d-463d-b712-facf0b446c44 admin admin] The token cache is being invalidate because project 986226435c3a43d2a73a63001d947da8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 10:35:39.407507 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-c492b7ab-570d-463d-b712-facf0b446c44 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:39.408648 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-c492b7ab-570d-463d-b712-facf0b446c44 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:39.410355 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1366/2691] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 19 10:35:39 2022] DELETE /identity/v3/projects/986226435c3a43d2a73a63001d947da8 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:35:39.414332 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d70672-b87a-4631-8a54-0c5a6a11162c service neutron] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:35:39.430404 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d70672-b87a-4631-8a54-0c5a6a11162c service neutron] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:35:39.486649 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:35:39.502225 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1a6c0f-673d-4f31-badb-f50cf593c8e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:35:39.502840 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1a6c0f-673d-4f31-badb-f50cf593c8e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:39.503107 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1a6c0f-673d-4f31-badb-f50cf593c8e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:39.504015 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1a6c0f-673d-4f31-badb-f50cf593c8e6 admin admin] PATH_INFO: `/v3/users/a27f0f328267466c8cace0a278cc694b` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:39.505329 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1a6c0f-673d-4f31-badb-f50cf593c8e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a27f0f328267466c8cace0a278cc694b)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:35:39.507557 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1a6c0f-673d-4f31-badb-f50cf593c8e6 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:35:39.577556 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-bc1a6c0f-673d-4f31-badb-f50cf593c8e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a27f0f328267466c8cace0a278cc694b'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:39.592012 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-bc1a6c0f-673d-4f31-badb-f50cf593c8e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a27f0f328267466c8cace0a278cc694b'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:39.592723 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-bc1a6c0f-673d-4f31-badb-f50cf593c8e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a27f0f328267466c8cace0a278cc694b'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:39.593389 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-bc1a6c0f-673d-4f31-badb-f50cf593c8e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a27f0f328267466c8cace0a278cc694b'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:39.606682 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-bc1a6c0f-673d-4f31-badb-f50cf593c8e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a27f0f328267466c8cace0a278cc694b'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:39.638833 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1326/2692] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 19 10:35:39 2022] DELETE /identity/v3/users/a27f0f328267466c8cace0a278cc694b => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:35:40.086272 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c492b7ab-570d-463d-b712-facf0b446c44 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:35:40.089098 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-c492b7ab-570d-463d-b712-facf0b446c44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:35:40.117558 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c492b7ab-570d-463d-b712-facf0b446c44 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:35:40.214663 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab52b4a2-1553-4cff-a3da-3efcb7b822ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:35:40.215358 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab52b4a2-1553-4cff-a3da-3efcb7b822ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:40.216237 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab52b4a2-1553-4cff-a3da-3efcb7b822ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:40.216535 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab52b4a2-1553-4cff-a3da-3efcb7b822ad admin admin] PATH_INFO: `/v3/projects/d90b9ed93db743de983e3f69c76a019e` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:40.217935 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab52b4a2-1553-4cff-a3da-3efcb7b822ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=d90b9ed93db743de983e3f69c76a019e)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:35:40.220590 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab52b4a2-1553-4cff-a3da-3efcb7b822ad admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:35:40.252756 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:35:40.304082 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-ab52b4a2-1553-4cff-a3da-3efcb7b822ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd90b9ed93db743de983e3f69c76a019e', 'request_id': 'req-ab52b4a2-1553-4cff-a3da-3efcb7b822ad'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:40.311117 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-ab52b4a2-1553-4cff-a3da-3efcb7b822ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd90b9ed93db743de983e3f69c76a019e', 'request_id': 'req-ab52b4a2-1553-4cff-a3da-3efcb7b822ad'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:40.323519 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-ab52b4a2-1553-4cff-a3da-3efcb7b822ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd90b9ed93db743de983e3f69c76a019e', 'request_id': 'req-ab52b4a2-1553-4cff-a3da-3efcb7b822ad'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:40.348692 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-ab52b4a2-1553-4cff-a3da-3efcb7b822ad admin admin] The token cache is being invalidate because project d90b9ed93db743de983e3f69c76a019e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 10:35:40.349014 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-ab52b4a2-1553-4cff-a3da-3efcb7b822ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:40.349801 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-ab52b4a2-1553-4cff-a3da-3efcb7b822ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:40.351787 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1367/2693] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 19 10:35:40 2022] DELETE /identity/v3/projects/d90b9ed93db743de983e3f69c76a019e => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:35:40.356787 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65028235-3aa9-458e-be97-e2ac6880b8e1 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:40.357361 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65028235-3aa9-458e-be97-e2ac6880b8e1 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:40.358407 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65028235-3aa9-458e-be97-e2ac6880b8e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:40.384397 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-65028235-3aa9-458e-be97-e2ac6880b8e1 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:35:40.386356 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-65028235-3aa9-458e-be97-e2ac6880b8e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:35:40.472254 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1327/2694] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:35:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:35:40.476481 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c13286b-2281-4785-8b41-53776f61c19a None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:40.476971 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c13286b-2281-4785-8b41-53776f61c19a None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:40.477393 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c13286b-2281-4785-8b41-53776f61c19a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:40.507195 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-0c13286b-2281-4785-8b41-53776f61c19a None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:35:40.508768 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-0c13286b-2281-4785-8b41-53776f61c19a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:35:40.517952 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1368/2695] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:35:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:35:40.522497 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65028235-3aa9-458e-be97-e2ac6880b8e1 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:35:40.536228 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65028235-3aa9-458e-be97-e2ac6880b8e1 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:35:40.541708 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1910723-c784-41bd-a857-75951e248efd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:35:40.542104 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1910723-c784-41bd-a857-75951e248efd admin admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:40.542445 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1910723-c784-41bd-a857-75951e248efd admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:40.542779 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1910723-c784-41bd-a857-75951e248efd admin admin] PATH_INFO: `/v3/domains` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:40.543748 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1910723-c784-41bd-a857-75951e248efd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:35:40.544110 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1910723-c784-41bd-a857-75951e248efd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:35:40.546147 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1910723-c784-41bd-a857-75951e248efd admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:35:40.565358 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1328/2696] 10.222.0.66 () {58 vars in 1153 bytes} [Mon Sep 19 10:35:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:35:40.566689 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c13286b-2281-4785-8b41-53776f61c19a None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:35:40.576248 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c13286b-2281-4785-8b41-53776f61c19a None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:35:40.583390 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a96a82-8197-484b-949c-329419b01a27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:35:40.584124 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a96a82-8197-484b-949c-329419b01a27 admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:40.584507 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a96a82-8197-484b-949c-329419b01a27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:40.584676 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a96a82-8197-484b-949c-329419b01a27 admin admin] PATH_INFO: `/v3/projects` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:40.585280 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a96a82-8197-484b-949c-329419b01a27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:35:40.587201 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a96a82-8197-484b-949c-329419b01a27 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:35:40.621924 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1369/2697] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 19 10:35:40 2022] POST /identity/v3/projects => generated 383 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:35:40.625919 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1910723-c784-41bd-a857-75951e248efd admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:35:40.637497 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1910723-c784-41bd-a857-75951e248efd admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:35:40.707669 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:35:40.734111 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8354dfc1-88bc-4cad-b210-e98a98cf68fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:35:40.735171 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8354dfc1-88bc-4cad-b210-e98a98cf68fb admin admin] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:40.735517 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8354dfc1-88bc-4cad-b210-e98a98cf68fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:40.736231 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8354dfc1-88bc-4cad-b210-e98a98cf68fb admin admin] PATH_INFO: `/v3/users` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:40.736677 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8354dfc1-88bc-4cad-b210-e98a98cf68fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:35:40.738852 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8354dfc1-88bc-4cad-b210-e98a98cf68fb admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:35:40.767443 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1329/2698] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 19 10:35:40 2022] POST /identity/v3/users => generated 292 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:35:40.769296 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a96a82-8197-484b-949c-329419b01a27 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:35:40.782983 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a96a82-8197-484b-949c-329419b01a27 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:35:40.789005 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d2db70-d9b2-45de-b2e4-b7b140665be3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:35:40.790180 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d2db70-d9b2-45de-b2e4-b7b140665be3 admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:40.790180 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d2db70-d9b2-45de-b2e4-b7b140665be3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:40.790551 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d2db70-d9b2-45de-b2e4-b7b140665be3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:40.790950 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d2db70-d9b2-45de-b2e4-b7b140665be3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:35:40.792621 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d2db70-d9b2-45de-b2e4-b7b140665be3 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:35:40.806041 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1370/2699] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:35:40 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 10:35:40.809774 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8354dfc1-88bc-4cad-b210-e98a98cf68fb admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:35:40.821632 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8354dfc1-88bc-4cad-b210-e98a98cf68fb admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:35:40.826873 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3ea447-f7ba-43ac-8aeb-8951d7f34feb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:35:40.827478 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3ea447-f7ba-43ac-8aeb-8951d7f34feb admin admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:40.827752 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3ea447-f7ba-43ac-8aeb-8951d7f34feb admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:40.828024 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3ea447-f7ba-43ac-8aeb-8951d7f34feb admin admin] PATH_INFO: `/v3/roles` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:40.828696 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3ea447-f7ba-43ac-8aeb-8951d7f34feb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:35:40.830366 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3ea447-f7ba-43ac-8aeb-8951d7f34feb admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:35:40.844412 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1330/2700] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:35:40 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 10:35:40.847175 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d2db70-d9b2-45de-b2e4-b7b140665be3 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:35:40.859724 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d2db70-d9b2-45de-b2e4-b7b140665be3 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:35:40.866237 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e3115c-79d5-425b-a1b9-52cd0bad836f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:35:40.867025 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e3115c-79d5-425b-a1b9-52cd0bad836f admin admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:40.867382 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e3115c-79d5-425b-a1b9-52cd0bad836f admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:40.867755 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e3115c-79d5-425b-a1b9-52cd0bad836f admin admin] PATH_INFO: `/v3/projects/90a637cca95641d5b6150a60bec79bd2/users/6b750f504653412e809dbfd863e625f6/roles/cd5b42ed3b754b58817a62bbe74651b4` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:40.892331 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e3115c-79d5-425b-a1b9-52cd0bad836f admin admin] RBAC: Authorizing `identity:create_grant(project_id=90a637cca95641d5b6150a60bec79bd2, user_id=6b750f504653412e809dbfd863e625f6, role_id=cd5b42ed3b754b58817a62bbe74651b4)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:35:40.896013 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e3115c-79d5-425b-a1b9-52cd0bad836f admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:35:40.914174 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1371/2701] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 19 10:35:40 2022] PUT /identity/v3/projects/90a637cca95641d5b6150a60bec79bd2/users/6b750f504653412e809dbfd863e625f6/roles/cd5b42ed3b754b58817a62bbe74651b4 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:35:40.924831 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b306bad6-654f-4c79-bba2-fc5cee0bacbd None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:40.925764 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b306bad6-654f-4c79-bba2-fc5cee0bacbd None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:40.926167 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b306bad6-654f-4c79-bba2-fc5cee0bacbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:40.963724 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-b306bad6-654f-4c79-bba2-fc5cee0bacbd None None] MFA Rules not processed for user `6b750f504653412e809dbfd863e625f6`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:35:40.965004 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-b306bad6-654f-4c79-bba2-fc5cee0bacbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:35:41.184231 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1331/2702] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:35:40 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:35:41.185383 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e3115c-79d5-425b-a1b9-52cd0bad836f admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:35:41.299259 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e3115c-79d5-425b-a1b9-52cd0bad836f admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:35:41.304856 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1529cb12-04a8-4ad6-a7c6-b39359c87bfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:35:41.305686 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1529cb12-04a8-4ad6-a7c6-b39359c87bfd admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:41.306117 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1529cb12-04a8-4ad6-a7c6-b39359c87bfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:41.306400 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1529cb12-04a8-4ad6-a7c6-b39359c87bfd admin admin] PATH_INFO: `/v3/projects` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:41.307058 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1529cb12-04a8-4ad6-a7c6-b39359c87bfd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:35:41.309031 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1529cb12-04a8-4ad6-a7c6-b39359c87bfd admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:35:41.353876 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b306bad6-654f-4c79-bba2-fc5cee0bacbd None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:35:41.364932 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1372/2703] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 19 10:35:41 2022] POST /identity/v3/projects => generated 381 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:35:41.366006 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b306bad6-654f-4c79-bba2-fc5cee0bacbd None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:35:41.465146 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee1b6f2-042b-4d99-b633-959aaecbec78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:35:41.465942 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee1b6f2-042b-4d99-b633-959aaecbec78 admin admin] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:41.466284 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee1b6f2-042b-4d99-b633-959aaecbec78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:41.466636 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee1b6f2-042b-4d99-b633-959aaecbec78 admin admin] PATH_INFO: `/v3/users` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:41.467417 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee1b6f2-042b-4d99-b633-959aaecbec78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:35:41.469508 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee1b6f2-042b-4d99-b633-959aaecbec78 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:35:41.505413 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1332/2704] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 19 10:35:41 2022] POST /identity/v3/users => generated 297 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 10:35:41.509308 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1529cb12-04a8-4ad6-a7c6-b39359c87bfd admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:35:41.523959 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1529cb12-04a8-4ad6-a7c6-b39359c87bfd admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:35:41.530211 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b471e230-5a3f-46e2-94c2-ea3dfa0a8f45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:35:41.531005 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b471e230-5a3f-46e2-94c2-ea3dfa0a8f45 admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:41.531385 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b471e230-5a3f-46e2-94c2-ea3dfa0a8f45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:41.531879 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b471e230-5a3f-46e2-94c2-ea3dfa0a8f45 admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:41.532667 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b471e230-5a3f-46e2-94c2-ea3dfa0a8f45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:35:41.535711 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b471e230-5a3f-46e2-94c2-ea3dfa0a8f45 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:35:41.556219 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1373/2705] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:35:41 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 10:35:41.559015 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee1b6f2-042b-4d99-b633-959aaecbec78 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:35:41.570847 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee1b6f2-042b-4d99-b633-959aaecbec78 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:35:41.577014 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22add4e5-5864-4024-8249-7f3b6c2b9cd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:35:41.577676 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22add4e5-5864-4024-8249-7f3b6c2b9cd2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:41.577955 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22add4e5-5864-4024-8249-7f3b6c2b9cd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:41.578231 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22add4e5-5864-4024-8249-7f3b6c2b9cd2 admin admin] PATH_INFO: `/v3/projects/8ee633a94ba7438db2666306b8cae36f/users/5ddbb62315d24db687e7452049425d45/roles/5c8b89fae4fa45bd944cbeaf442136e1` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:41.596905 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22add4e5-5864-4024-8249-7f3b6c2b9cd2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ee633a94ba7438db2666306b8cae36f, user_id=5ddbb62315d24db687e7452049425d45, role_id=5c8b89fae4fa45bd944cbeaf442136e1)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:35:41.599565 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22add4e5-5864-4024-8249-7f3b6c2b9cd2 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:35:41.622620 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1333/2706] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 19 10:35:41 2022] PUT /identity/v3/projects/8ee633a94ba7438db2666306b8cae36f/users/5ddbb62315d24db687e7452049425d45/roles/5c8b89fae4fa45bd944cbeaf442136e1 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:35:41.624514 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b471e230-5a3f-46e2-94c2-ea3dfa0a8f45 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:35:41.636968 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b471e230-5a3f-46e2-94c2-ea3dfa0a8f45 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:35:41.661111 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:35:41.712839 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c0bbd8-121f-463d-af3d-d1532e915704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:35:41.713462 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c0bbd8-121f-463d-af3d-d1532e915704 admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:41.713769 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c0bbd8-121f-463d-af3d-d1532e915704 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:41.714027 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c0bbd8-121f-463d-af3d-d1532e915704 admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:41.714703 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c0bbd8-121f-463d-af3d-d1532e915704 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:35:41.716502 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c0bbd8-121f-463d-af3d-d1532e915704 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:35:41.729016 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1374/2707] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:35:41 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 10:35:41.732813 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22add4e5-5864-4024-8249-7f3b6c2b9cd2 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:35:41.757206 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22add4e5-5864-4024-8249-7f3b6c2b9cd2 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:35:41.762491 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652829cf-0584-4a74-81e9-451269e8212d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:35:41.763259 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652829cf-0584-4a74-81e9-451269e8212d admin admin] REQUEST_METHOD: `PUT` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:41.763768 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652829cf-0584-4a74-81e9-451269e8212d admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:41.764308 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652829cf-0584-4a74-81e9-451269e8212d admin admin] PATH_INFO: `/v3/projects/8ee633a94ba7438db2666306b8cae36f/users/5ddbb62315d24db687e7452049425d45/roles/5c8b89fae4fa45bd944cbeaf442136e1` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:41.766591 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652829cf-0584-4a74-81e9-451269e8212d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ee633a94ba7438db2666306b8cae36f, user_id=5ddbb62315d24db687e7452049425d45, role_id=5c8b89fae4fa45bd944cbeaf442136e1)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:35:41.770767 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652829cf-0584-4a74-81e9-451269e8212d admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:35:41.783692 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1334/2708] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 19 10:35:41 2022] PUT /identity/v3/projects/8ee633a94ba7438db2666306b8cae36f/users/5ddbb62315d24db687e7452049425d45/roles/5c8b89fae4fa45bd944cbeaf442136e1 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:35:41.796950 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634368d7-c927-471a-8caa-05340698a755 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:41.797782 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634368d7-c927-471a-8caa-05340698a755 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:41.798227 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634368d7-c927-471a-8caa-05340698a755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:41.856937 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-634368d7-c927-471a-8caa-05340698a755 None None] MFA Rules not processed for user `5ddbb62315d24db687e7452049425d45`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:35:41.861342 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-634368d7-c927-471a-8caa-05340698a755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:35:41.980310 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1375/2709] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:35:41 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:35:41.990571 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652829cf-0584-4a74-81e9-451269e8212d admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:35:41.993911 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-652829cf-0584-4a74-81e9-451269e8212d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:35:42.028087 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:35:42.077170 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652829cf-0584-4a74-81e9-451269e8212d admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:35:42.081307 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4ff526-a4a5-4004-b051-2f5e26bc5f9a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa4d004fd44482cae761c4b3bdfab31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:35:42.081939 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4ff526-a4a5-4004-b051-2f5e26bc5f9a service cinder] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:42.082224 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4ff526-a4a5-4004-b051-2f5e26bc5f9a service cinder] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:42.082507 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4ff526-a4a5-4004-b051-2f5e26bc5f9a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:42.098353 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4ff526-a4a5-4004-b051-2f5e26bc5f9a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:35:42.100001 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4ff526-a4a5-4004-b051-2f5e26bc5f9a service cinder] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:35:42.119059 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1335/2710] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:35:41 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:35:42.330033 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634368d7-c927-471a-8caa-05340698a755 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:35:42.332864 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-634368d7-c927-471a-8caa-05340698a755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:35:42.356075 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634368d7-c927-471a-8caa-05340698a755 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:35:42.361316 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c79b98f-9a74-4c66-9fea-de0f786b1ca5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa4d004fd44482cae761c4b3bdfab31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:35:42.362943 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c79b98f-9a74-4c66-9fea-de0f786b1ca5 service cinder] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:42.363423 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c79b98f-9a74-4c66-9fea-de0f786b1ca5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:42.364208 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c79b98f-9a74-4c66-9fea-de0f786b1ca5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:42.492325 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c79b98f-9a74-4c66-9fea-de0f786b1ca5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:35:42.493999 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c79b98f-9a74-4c66-9fea-de0f786b1ca5 service cinder] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:35:42.511273 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4ff526-a4a5-4004-b051-2f5e26bc5f9a service cinder] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:35:42.512704 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-fa4ff526-a4a5-4004-b051-2f5e26bc5f9a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:35:42.516404 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1376/2711] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:35:42 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:35:42.737039 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4ff526-a4a5-4004-b051-2f5e26bc5f9a service cinder] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:35:42.746919 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9daa99-fe10-4e01-b3c8-9858b9fd0091 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46b78120cac64f09bd0f4cdc42424163', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:35:42.747683 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9daa99-fe10-4e01-b3c8-9858b9fd0091 service placement] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:42.748220 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9daa99-fe10-4e01-b3c8-9858b9fd0091 service placement] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:42.749573 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9daa99-fe10-4e01-b3c8-9858b9fd0091 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:42.752361 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-1c9daa99-fe10-4e01-b3c8-9858b9fd0091 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:35:42.779896 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9daa99-fe10-4e01-b3c8-9858b9fd0091 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:35:42.784798 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9daa99-fe10-4e01-b3c8-9858b9fd0091 service placement] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:35:42.820883 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1336/2712] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:35:42 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 10:35:42.995988 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c79b98f-9a74-4c66-9fea-de0f786b1ca5 service cinder] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:35:43.064976 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:35:43.096342 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c79b98f-9a74-4c66-9fea-de0f786b1ca5 service cinder] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:35:43.103534 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e9552d-f818-44cb-b9d7-6e9f45b0ad94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:35:43.104497 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e9552d-f818-44cb-b9d7-6e9f45b0ad94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:43.104975 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e9552d-f818-44cb-b9d7-6e9f45b0ad94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:43.105254 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e9552d-f818-44cb-b9d7-6e9f45b0ad94 admin admin] PATH_INFO: `/v3/users/6b750f504653412e809dbfd863e625f6` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:43.106706 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e9552d-f818-44cb-b9d7-6e9f45b0ad94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b750f504653412e809dbfd863e625f6)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:35:43.108994 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e9552d-f818-44cb-b9d7-6e9f45b0ad94 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:35:43.172233 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-85e9552d-f818-44cb-b9d7-6e9f45b0ad94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b750f504653412e809dbfd863e625f6'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:43.182883 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-85e9552d-f818-44cb-b9d7-6e9f45b0ad94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b750f504653412e809dbfd863e625f6'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:43.183507 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-85e9552d-f818-44cb-b9d7-6e9f45b0ad94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b750f504653412e809dbfd863e625f6'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:43.184154 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-85e9552d-f818-44cb-b9d7-6e9f45b0ad94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b750f504653412e809dbfd863e625f6'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:43.192333 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-85e9552d-f818-44cb-b9d7-6e9f45b0ad94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b750f504653412e809dbfd863e625f6'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:43.212118 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1377/2713] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 19 10:35:42 2022] DELETE /identity/v3/users/6b750f504653412e809dbfd863e625f6 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:35:43.216928 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a28931b-bdee-407e-a368-9cc68d3b5d9d None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:43.217268 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a28931b-bdee-407e-a368-9cc68d3b5d9d None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:43.217394 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a28931b-bdee-407e-a368-9cc68d3b5d9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:43.237056 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-2a28931b-bdee-407e-a368-9cc68d3b5d9d None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:35:43.238964 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-2a28931b-bdee-407e-a368-9cc68d3b5d9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:35:43.310916 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1337/2714] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:35:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:35:43.323195 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e9552d-f818-44cb-b9d7-6e9f45b0ad94 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:35:43.325264 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-85e9552d-f818-44cb-b9d7-6e9f45b0ad94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:35:43.424041 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e9552d-f818-44cb-b9d7-6e9f45b0ad94 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:35:43.429576 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8742ba82-c687-4d4a-9c96-972b9c7fa629 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c1289b015854c6bb6aee8fed6b807db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:35:43.430146 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8742ba82-c687-4d4a-9c96-972b9c7fa629 service neutron] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:43.430442 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8742ba82-c687-4d4a-9c96-972b9c7fa629 service neutron] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:43.430711 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8742ba82-c687-4d4a-9c96-972b9c7fa629 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:43.444772 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8742ba82-c687-4d4a-9c96-972b9c7fa629 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:35:43.446533 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8742ba82-c687-4d4a-9c96-972b9c7fa629 service neutron] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:35:43.481219 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1378/2715] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:35:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:35:43.883433 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a28931b-bdee-407e-a368-9cc68d3b5d9d None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:35:43.890240 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-2a28931b-bdee-407e-a368-9cc68d3b5d9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:35:43.922848 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a28931b-bdee-407e-a368-9cc68d3b5d9d None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:35:43.945032 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1c462a-71d7-4820-ab26-fd8d4a6b9b47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:35:43.945760 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1c462a-71d7-4820-ab26-fd8d4a6b9b47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:43.946045 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1c462a-71d7-4820-ab26-fd8d4a6b9b47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:43.946327 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1c462a-71d7-4820-ab26-fd8d4a6b9b47 admin admin] PATH_INFO: `/v3/projects/90a637cca95641d5b6150a60bec79bd2` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:43.947612 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1c462a-71d7-4820-ab26-fd8d4a6b9b47 admin admin] RBAC: Authorizing `identity:delete_project(project_id=90a637cca95641d5b6150a60bec79bd2)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:35:43.949656 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1c462a-71d7-4820-ab26-fd8d4a6b9b47 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:35:43.999563 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:35:44.044687 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-ed1c462a-71d7-4820-ab26-fd8d4a6b9b47 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90a637cca95641d5b6150a60bec79bd2', 'request_id': 'req-ed1c462a-71d7-4820-ab26-fd8d4a6b9b47'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:44.058599 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-ed1c462a-71d7-4820-ab26-fd8d4a6b9b47 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90a637cca95641d5b6150a60bec79bd2', 'request_id': 'req-ed1c462a-71d7-4820-ab26-fd8d4a6b9b47'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:44.078651 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-ed1c462a-71d7-4820-ab26-fd8d4a6b9b47 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90a637cca95641d5b6150a60bec79bd2', 'request_id': 'req-ed1c462a-71d7-4820-ab26-fd8d4a6b9b47'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:44.098599 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-ed1c462a-71d7-4820-ab26-fd8d4a6b9b47 admin admin] The token cache is being invalidate because project 90a637cca95641d5b6150a60bec79bd2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 10:35:44.099064 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-ed1c462a-71d7-4820-ab26-fd8d4a6b9b47 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:44.099739 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-ed1c462a-71d7-4820-ab26-fd8d4a6b9b47 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:44.101521 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1338/2716] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 19 10:35:43 2022] DELETE /identity/v3/projects/90a637cca95641d5b6150a60bec79bd2 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:35:44.105916 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8742ba82-c687-4d4a-9c96-972b9c7fa629 service neutron] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:35:44.129594 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8742ba82-c687-4d4a-9c96-972b9c7fa629 service neutron] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:35:44.203507 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe23025-fbb9-4518-935c-dfb3da00c373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:35:44.204081 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe23025-fbb9-4518-935c-dfb3da00c373 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:44.204396 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe23025-fbb9-4518-935c-dfb3da00c373 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:44.204683 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe23025-fbb9-4518-935c-dfb3da00c373 admin admin] PATH_INFO: `/v3/users/5ddbb62315d24db687e7452049425d45` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:44.206554 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe23025-fbb9-4518-935c-dfb3da00c373 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ddbb62315d24db687e7452049425d45)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:35:44.208857 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe23025-fbb9-4518-935c-dfb3da00c373 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:35:44.211839 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:35:44.329164 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-3fe23025-fbb9-4518-935c-dfb3da00c373 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ddbb62315d24db687e7452049425d45'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:44.352554 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-3fe23025-fbb9-4518-935c-dfb3da00c373 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ddbb62315d24db687e7452049425d45'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:44.353396 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-3fe23025-fbb9-4518-935c-dfb3da00c373 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ddbb62315d24db687e7452049425d45'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:44.354340 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-3fe23025-fbb9-4518-935c-dfb3da00c373 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ddbb62315d24db687e7452049425d45'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:44.368201 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1c462a-71d7-4820-ab26-fd8d4a6b9b47 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:35:44.369994 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-ed1c462a-71d7-4820-ab26-fd8d4a6b9b47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:35:44.375657 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-3fe23025-fbb9-4518-935c-dfb3da00c373 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ddbb62315d24db687e7452049425d45'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:44.397744 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1379/2717] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 19 10:35:44 2022] DELETE /identity/v3/users/5ddbb62315d24db687e7452049425d45 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:35:44.458257 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1c462a-71d7-4820-ab26-fd8d4a6b9b47 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:35:44.528487 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d723abc-61fa-4fea-a226-e81e12626846 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c1289b015854c6bb6aee8fed6b807db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:35:44.529234 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d723abc-61fa-4fea-a226-e81e12626846 service neutron] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:44.529629 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d723abc-61fa-4fea-a226-e81e12626846 service neutron] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:44.530596 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d723abc-61fa-4fea-a226-e81e12626846 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:44.532845 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-8d723abc-61fa-4fea-a226-e81e12626846 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:35:44.585423 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe23025-fbb9-4518-935c-dfb3da00c373 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:35:44.587028 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-3fe23025-fbb9-4518-935c-dfb3da00c373 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:35:44.644358 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d723abc-61fa-4fea-a226-e81e12626846 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:35:44.645923 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d723abc-61fa-4fea-a226-e81e12626846 service neutron] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:35:44.673009 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1339/2718] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:35:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:35:44.699623 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe23025-fbb9-4518-935c-dfb3da00c373 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:35:44.705464 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77066465-bafd-413c-aa51-d1a257557c98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:35:44.706662 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77066465-bafd-413c-aa51-d1a257557c98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:44.706997 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77066465-bafd-413c-aa51-d1a257557c98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:44.707272 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77066465-bafd-413c-aa51-d1a257557c98 admin admin] PATH_INFO: `/v3/users/315ef67e581f41fd9be4b514de898656` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:44.708558 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77066465-bafd-413c-aa51-d1a257557c98 admin admin] RBAC: Authorizing `identity:delete_user(user_id=315ef67e581f41fd9be4b514de898656)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:35:44.710503 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77066465-bafd-413c-aa51-d1a257557c98 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:35:44.802842 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-77066465-bafd-413c-aa51-d1a257557c98 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '315ef67e581f41fd9be4b514de898656'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:44.818395 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-77066465-bafd-413c-aa51-d1a257557c98 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '315ef67e581f41fd9be4b514de898656'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:44.820782 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-77066465-bafd-413c-aa51-d1a257557c98 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '315ef67e581f41fd9be4b514de898656'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:44.821622 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-77066465-bafd-413c-aa51-d1a257557c98 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '315ef67e581f41fd9be4b514de898656'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:44.832786 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-77066465-bafd-413c-aa51-d1a257557c98 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '315ef67e581f41fd9be4b514de898656'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:44.853099 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:35:44.863277 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1380/2719] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 19 10:35:44 2022] DELETE /identity/v3/users/315ef67e581f41fd9be4b514de898656 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 10:35:44.868617 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d350339-99a6-43f9-ad2c-9975ec9c2cde None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:44.868909 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d350339-99a6-43f9-ad2c-9975ec9c2cde None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:44.869193 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d350339-99a6-43f9-ad2c-9975ec9c2cde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:44.900722 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-9d350339-99a6-43f9-ad2c-9975ec9c2cde None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:35:44.903545 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-9d350339-99a6-43f9-ad2c-9975ec9c2cde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:35:44.922972 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:35:44.973706 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77066465-bafd-413c-aa51-d1a257557c98 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:35:44.975282 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-77066465-bafd-413c-aa51-d1a257557c98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:35:45.032955 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1340/2720] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:35:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:35:45.046763 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d350339-99a6-43f9-ad2c-9975ec9c2cde None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:35:45.051149 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-9d350339-99a6-43f9-ad2c-9975ec9c2cde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:35:45.125014 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77066465-bafd-413c-aa51-d1a257557c98 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:35:45.133491 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f82f8d-9081-4632-8403-8205e95c4972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:35:45.134688 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f82f8d-9081-4632-8403-8205e95c4972 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:45.135249 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f82f8d-9081-4632-8403-8205e95c4972 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:45.135766 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f82f8d-9081-4632-8403-8205e95c4972 admin admin] PATH_INFO: `/v3/projects/8ee633a94ba7438db2666306b8cae36f` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:45.137662 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f82f8d-9081-4632-8403-8205e95c4972 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ee633a94ba7438db2666306b8cae36f)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:35:45.140989 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f82f8d-9081-4632-8403-8205e95c4972 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:35:45.175607 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d350339-99a6-43f9-ad2c-9975ec9c2cde None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:35:45.182492 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6549b478-a4b1-488c-906e-8799ab2e32d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c1289b015854c6bb6aee8fed6b807db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:35:45.183793 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6549b478-a4b1-488c-906e-8799ab2e32d0 service neutron] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:45.184427 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6549b478-a4b1-488c-906e-8799ab2e32d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:45.184934 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6549b478-a4b1-488c-906e-8799ab2e32d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:45.209021 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6549b478-a4b1-488c-906e-8799ab2e32d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:35:45.212006 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6549b478-a4b1-488c-906e-8799ab2e32d0 service neutron] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:35:45.221777 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-53f82f8d-9081-4632-8403-8205e95c4972 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ee633a94ba7438db2666306b8cae36f', 'request_id': 'req-53f82f8d-9081-4632-8403-8205e95c4972'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:45.235668 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-53f82f8d-9081-4632-8403-8205e95c4972 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ee633a94ba7438db2666306b8cae36f', 'request_id': 'req-53f82f8d-9081-4632-8403-8205e95c4972'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:45.265607 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1341/2721] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:35:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:35:45.268896 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-53f82f8d-9081-4632-8403-8205e95c4972 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ee633a94ba7438db2666306b8cae36f', 'request_id': 'req-53f82f8d-9081-4632-8403-8205e95c4972'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:45.283449 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-53f82f8d-9081-4632-8403-8205e95c4972 admin admin] The token cache is being invalidate because project 8ee633a94ba7438db2666306b8cae36f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 10:35:45.283749 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-53f82f8d-9081-4632-8403-8205e95c4972 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:45.284596 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-53f82f8d-9081-4632-8403-8205e95c4972 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:45.286213 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1381/2722] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 19 10:35:44 2022] DELETE /identity/v3/projects/8ee633a94ba7438db2666306b8cae36f => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:35:45.291300 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac3b166-1d47-47c5-9a88-9964663f409b None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:45.291954 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac3b166-1d47-47c5-9a88-9964663f409b None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:45.292539 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac3b166-1d47-47c5-9a88-9964663f409b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:45.318887 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-5ac3b166-1d47-47c5-9a88-9964663f409b None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:35:45.320570 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-5ac3b166-1d47-47c5-9a88-9964663f409b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:35:45.407525 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b7eb58-1c33-4b9e-a7c6-8059f824b569 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:45.408433 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b7eb58-1c33-4b9e-a7c6-8059f824b569 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:45.408924 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b7eb58-1c33-4b9e-a7c6-8059f824b569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:45.413342 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1342/2723] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:35:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:35:45.436899 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-64b7eb58-1c33-4b9e-a7c6-8059f824b569 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:35:45.438480 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-64b7eb58-1c33-4b9e-a7c6-8059f824b569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:35:45.462301 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1382/2724] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:35:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:35:45.462498 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac3b166-1d47-47c5-9a88-9964663f409b None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:35:45.477119 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac3b166-1d47-47c5-9a88-9964663f409b None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:35:45.488942 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fba1692-5b20-4627-a78a-9d75b5aeb67f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:35:45.489668 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fba1692-5b20-4627-a78a-9d75b5aeb67f admin admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:45.490139 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fba1692-5b20-4627-a78a-9d75b5aeb67f admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:45.491459 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fba1692-5b20-4627-a78a-9d75b5aeb67f admin admin] PATH_INFO: `/v3/domains` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:45.492911 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fba1692-5b20-4627-a78a-9d75b5aeb67f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:35:45.493354 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fba1692-5b20-4627-a78a-9d75b5aeb67f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:35:45.495670 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fba1692-5b20-4627-a78a-9d75b5aeb67f admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:35:45.513733 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1343/2725] 10.222.0.66 () {58 vars in 1153 bytes} [Mon Sep 19 10:35:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:35:45.519162 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b7eb58-1c33-4b9e-a7c6-8059f824b569 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:35:45.529288 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b7eb58-1c33-4b9e-a7c6-8059f824b569 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:35:45.544772 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7616eda7-8147-4b1b-80df-b20c1d7241be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:35:45.545423 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7616eda7-8147-4b1b-80df-b20c1d7241be admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:45.545704 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7616eda7-8147-4b1b-80df-b20c1d7241be admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:45.545983 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7616eda7-8147-4b1b-80df-b20c1d7241be admin admin] PATH_INFO: `/v3/projects` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:45.546628 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7616eda7-8147-4b1b-80df-b20c1d7241be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:35:45.549419 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7616eda7-8147-4b1b-80df-b20c1d7241be admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:35:45.602353 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fba1692-5b20-4627-a78a-9d75b5aeb67f admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:35:45.612912 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1383/2726] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 19 10:35:45 2022] POST /identity/v3/projects => generated 369 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:35:45.623003 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fba1692-5b20-4627-a78a-9d75b5aeb67f admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:35:45.714850 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:35:45.729230 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23790363-e7f4-4a19-b620-7ae44d1938a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:35:45.730560 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23790363-e7f4-4a19-b620-7ae44d1938a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:45.730560 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23790363-e7f4-4a19-b620-7ae44d1938a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:45.730560 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23790363-e7f4-4a19-b620-7ae44d1938a2 admin admin] PATH_INFO: `/v3/users` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:45.731357 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23790363-e7f4-4a19-b620-7ae44d1938a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:35:45.733421 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23790363-e7f4-4a19-b620-7ae44d1938a2 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:35:45.764108 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1344/2727] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 19 10:35:45 2022] POST /identity/v3/users => generated 285 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 10:35:45.768563 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7616eda7-8147-4b1b-80df-b20c1d7241be admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:35:45.779617 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7616eda7-8147-4b1b-80df-b20c1d7241be admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:35:45.786808 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c20a8a-3aa6-46d0-8458-345832b42756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:35:45.787731 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c20a8a-3aa6-46d0-8458-345832b42756 admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:45.788067 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c20a8a-3aa6-46d0-8458-345832b42756 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:45.788406 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c20a8a-3aa6-46d0-8458-345832b42756 admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:45.789088 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c20a8a-3aa6-46d0-8458-345832b42756 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:35:45.790715 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c20a8a-3aa6-46d0-8458-345832b42756 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:35:45.802956 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1384/2728] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:35:45 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 10:35:45.807236 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23790363-e7f4-4a19-b620-7ae44d1938a2 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:35:45.821909 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23790363-e7f4-4a19-b620-7ae44d1938a2 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:35:45.828466 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc6d140-98b8-4e3e-9f03-461af1f16131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:35:45.829980 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc6d140-98b8-4e3e-9f03-461af1f16131 admin admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:45.830260 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc6d140-98b8-4e3e-9f03-461af1f16131 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:45.831084 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc6d140-98b8-4e3e-9f03-461af1f16131 admin admin] PATH_INFO: `/v3/roles` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:45.831753 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc6d140-98b8-4e3e-9f03-461af1f16131 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:35:45.833974 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc6d140-98b8-4e3e-9f03-461af1f16131 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:35:45.850239 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c20a8a-3aa6-46d0-8458-345832b42756 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:35:45.852134 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-06c20a8a-3aa6-46d0-8458-345832b42756 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:35:45.875887 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c20a8a-3aa6-46d0-8458-345832b42756 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:35:45.884586 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1345/2729] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:35:45 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 10:35:45.888660 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc6d140-98b8-4e3e-9f03-461af1f16131 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:35:45.894552 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c061ca71-e158-45bc-a927-26cf881bfac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:35:45.895361 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c061ca71-e158-45bc-a927-26cf881bfac5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:45.895666 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c061ca71-e158-45bc-a927-26cf881bfac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:45.895939 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c061ca71-e158-45bc-a927-26cf881bfac5 admin admin] PATH_INFO: `/v3/projects/e85a0482fd6449f4af0d7178033ac350` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:45.897145 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c061ca71-e158-45bc-a927-26cf881bfac5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e85a0482fd6449f4af0d7178033ac350)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:35:45.899065 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c061ca71-e158-45bc-a927-26cf881bfac5 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:35:45.909313 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc6d140-98b8-4e3e-9f03-461af1f16131 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:35:45.916897 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1210f96c-fdfa-4f92-8ce5-d635148b4a4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:35:45.917787 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1210f96c-fdfa-4f92-8ce5-d635148b4a4f admin admin] REQUEST_METHOD: `PUT` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:45.918005 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1210f96c-fdfa-4f92-8ce5-d635148b4a4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:45.918607 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1210f96c-fdfa-4f92-8ce5-d635148b4a4f admin admin] PATH_INFO: `/v3/projects/490a13a3925247de929c65ebff61499f/users/c267699eb7d747b3a3d8024bb5003a41/roles/cd5b42ed3b754b58817a62bbe74651b4` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:45.942720 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1210f96c-fdfa-4f92-8ce5-d635148b4a4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=490a13a3925247de929c65ebff61499f, user_id=c267699eb7d747b3a3d8024bb5003a41, role_id=cd5b42ed3b754b58817a62bbe74651b4)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:35:45.946066 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1210f96c-fdfa-4f92-8ce5-d635148b4a4f admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:35:45.970322 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1346/2730] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 19 10:35:45 2022] PUT /identity/v3/projects/490a13a3925247de929c65ebff61499f/users/c267699eb7d747b3a3d8024bb5003a41/roles/cd5b42ed3b754b58817a62bbe74651b4 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:35:45.979852 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:35:45.987099 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcd59b5-afb5-4ecd-bb3c-25ccbc2da23d None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:45.987927 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcd59b5-afb5-4ecd-bb3c-25ccbc2da23d None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:45.989078 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcd59b5-afb5-4ecd-bb3c-25ccbc2da23d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:45.993230 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-c061ca71-e158-45bc-a927-26cf881bfac5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e85a0482fd6449f4af0d7178033ac350', 'request_id': 'req-c061ca71-e158-45bc-a927-26cf881bfac5'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:46.004940 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-c061ca71-e158-45bc-a927-26cf881bfac5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e85a0482fd6449f4af0d7178033ac350', 'request_id': 'req-c061ca71-e158-45bc-a927-26cf881bfac5'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:46.024144 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-c061ca71-e158-45bc-a927-26cf881bfac5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e85a0482fd6449f4af0d7178033ac350', 'request_id': 'req-c061ca71-e158-45bc-a927-26cf881bfac5'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:46.036232 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-6fcd59b5-afb5-4ecd-bb3c-25ccbc2da23d None None] MFA Rules not processed for user `c267699eb7d747b3a3d8024bb5003a41`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:35:46.037538 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-6fcd59b5-afb5-4ecd-bb3c-25ccbc2da23d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:35:46.044877 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-c061ca71-e158-45bc-a927-26cf881bfac5 admin admin] The token cache is being invalidate because project e85a0482fd6449f4af0d7178033ac350 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 10:35:46.045173 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-c061ca71-e158-45bc-a927-26cf881bfac5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:46.046448 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-c061ca71-e158-45bc-a927-26cf881bfac5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:46.050483 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1385/2731] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 19 10:35:45 2022] DELETE /identity/v3/projects/e85a0482fd6449f4af0d7178033ac350 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:35:46.055512 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023f6b2c-e443-45d5-9c86-39e2a41a6878 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:46.055788 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023f6b2c-e443-45d5-9c86-39e2a41a6878 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:46.056084 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023f6b2c-e443-45d5-9c86-39e2a41a6878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:46.101588 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-023f6b2c-e443-45d5-9c86-39e2a41a6878 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:35:46.103141 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-023f6b2c-e443-45d5-9c86-39e2a41a6878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:35:46.132067 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1347/2732] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:35:45 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:35:46.140304 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcd59b5-afb5-4ecd-bb3c-25ccbc2da23d None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:35:46.143940 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-6fcd59b5-afb5-4ecd-bb3c-25ccbc2da23d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:35:46.229703 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1386/2733] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:35:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:35:46.242054 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcd59b5-afb5-4ecd-bb3c-25ccbc2da23d None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:35:46.244313 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b961f20-8b24-48d6-8c91-8a35f8186a85 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:46.245296 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b961f20-8b24-48d6-8c91-8a35f8186a85 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:46.245803 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b961f20-8b24-48d6-8c91-8a35f8186a85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:46.250613 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fedab6-55fb-4afc-84b9-032adfd0fb08 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f95c0d9f2414f3ca2fa2d1546d47f1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:35:46.251502 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fedab6-55fb-4afc-84b9-032adfd0fb08 service glance] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:46.251786 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fedab6-55fb-4afc-84b9-032adfd0fb08 service glance] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:46.252279 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fedab6-55fb-4afc-84b9-032adfd0fb08 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:46.264747 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fedab6-55fb-4afc-84b9-032adfd0fb08 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:35:46.266209 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fedab6-55fb-4afc-84b9-032adfd0fb08 service glance] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:35:46.283659 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-8b961f20-8b24-48d6-8c91-8a35f8186a85 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:35:46.284566 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1348/2734] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:35:46 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:35:46.285831 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-8b961f20-8b24-48d6-8c91-8a35f8186a85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:35:46.294668 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1387/2735] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:35:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:35:46.299521 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fedab6-55fb-4afc-84b9-032adfd0fb08 service glance] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:35:46.325221 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fedab6-55fb-4afc-84b9-032adfd0fb08 service glance] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:35:46.331447 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531a0d60-8094-4237-bc7a-5afdfc342633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:35:46.332129 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531a0d60-8094-4237-bc7a-5afdfc342633 admin admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:46.334008 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531a0d60-8094-4237-bc7a-5afdfc342633 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:46.334305 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531a0d60-8094-4237-bc7a-5afdfc342633 admin admin] PATH_INFO: `/v3/domains` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:46.336014 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531a0d60-8094-4237-bc7a-5afdfc342633 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:35:46.336445 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531a0d60-8094-4237-bc7a-5afdfc342633 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:35:46.350228 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531a0d60-8094-4237-bc7a-5afdfc342633 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:35:46.383204 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1349/2736] 10.222.0.66 () {58 vars in 1153 bytes} [Mon Sep 19 10:35:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:35:46.384835 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b961f20-8b24-48d6-8c91-8a35f8186a85 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:35:46.395843 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b961f20-8b24-48d6-8c91-8a35f8186a85 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:35:46.404858 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df65936d-77b3-4518-b3dc-2e80ed35d436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:35:46.405481 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df65936d-77b3-4518-b3dc-2e80ed35d436 admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:46.405844 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df65936d-77b3-4518-b3dc-2e80ed35d436 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:46.406290 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df65936d-77b3-4518-b3dc-2e80ed35d436 admin admin] PATH_INFO: `/v3/projects` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:46.406947 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df65936d-77b3-4518-b3dc-2e80ed35d436 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:35:46.413858 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df65936d-77b3-4518-b3dc-2e80ed35d436 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:35:46.480797 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1388/2737] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 19 10:35:46 2022] POST /identity/v3/projects => generated 383 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:35:46.482416 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531a0d60-8094-4237-bc7a-5afdfc342633 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:35:46.494324 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531a0d60-8094-4237-bc7a-5afdfc342633 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:35:46.525090 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:35:46.607872 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996b0b54-a110-4c65-9de1-46628cb68a0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:35:46.608919 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996b0b54-a110-4c65-9de1-46628cb68a0c admin admin] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:46.609401 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996b0b54-a110-4c65-9de1-46628cb68a0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:46.609868 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996b0b54-a110-4c65-9de1-46628cb68a0c admin admin] PATH_INFO: `/v3/users` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:46.610746 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996b0b54-a110-4c65-9de1-46628cb68a0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:35:46.614022 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996b0b54-a110-4c65-9de1-46628cb68a0c admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:35:46.642849 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1350/2738] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 19 10:35:46 2022] POST /identity/v3/users => generated 292 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:35:46.651229 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df65936d-77b3-4518-b3dc-2e80ed35d436 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:35:46.664097 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df65936d-77b3-4518-b3dc-2e80ed35d436 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:35:46.675771 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4128f13f-0b55-4aa7-bf8c-ef4e0c0084e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:35:46.676435 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4128f13f-0b55-4aa7-bf8c-ef4e0c0084e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:46.677332 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4128f13f-0b55-4aa7-bf8c-ef4e0c0084e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:46.677332 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4128f13f-0b55-4aa7-bf8c-ef4e0c0084e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:46.677642 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4128f13f-0b55-4aa7-bf8c-ef4e0c0084e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:35:46.679243 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4128f13f-0b55-4aa7-bf8c-ef4e0c0084e6 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:35:46.705818 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1389/2739] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:35:46 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 10:35:46.711391 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996b0b54-a110-4c65-9de1-46628cb68a0c admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:35:46.724640 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996b0b54-a110-4c65-9de1-46628cb68a0c admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:35:46.730463 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed91cfeb-78e3-40e6-9907-8ef47f7f23ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:35:46.731572 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed91cfeb-78e3-40e6-9907-8ef47f7f23ca admin admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:46.732379 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed91cfeb-78e3-40e6-9907-8ef47f7f23ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:46.732881 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed91cfeb-78e3-40e6-9907-8ef47f7f23ca admin admin] PATH_INFO: `/v3/roles` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:46.733918 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed91cfeb-78e3-40e6-9907-8ef47f7f23ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:35:46.737750 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed91cfeb-78e3-40e6-9907-8ef47f7f23ca admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:35:46.752543 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1351/2740] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:35:46 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 10:35:46.758347 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4128f13f-0b55-4aa7-bf8c-ef4e0c0084e6 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:35:46.773263 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4128f13f-0b55-4aa7-bf8c-ef4e0c0084e6 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:35:46.779920 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9545b4be-83d0-4552-8c20-41fd72af072b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:35:46.780634 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9545b4be-83d0-4552-8c20-41fd72af072b admin admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:46.780907 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9545b4be-83d0-4552-8c20-41fd72af072b admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:46.781177 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9545b4be-83d0-4552-8c20-41fd72af072b admin admin] PATH_INFO: `/v3/projects/87e5518341d2410393c9f7d34ac8dcc7/users/ec793e182dfa4ae3bd8a57c41f1e0077/roles/cd5b42ed3b754b58817a62bbe74651b4` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:46.806435 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9545b4be-83d0-4552-8c20-41fd72af072b admin admin] RBAC: Authorizing `identity:create_grant(project_id=87e5518341d2410393c9f7d34ac8dcc7, user_id=ec793e182dfa4ae3bd8a57c41f1e0077, role_id=cd5b42ed3b754b58817a62bbe74651b4)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:35:46.810116 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9545b4be-83d0-4552-8c20-41fd72af072b admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:35:46.839825 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1390/2741] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 19 10:35:46 2022] PUT /identity/v3/projects/87e5518341d2410393c9f7d34ac8dcc7/users/ec793e182dfa4ae3bd8a57c41f1e0077/roles/cd5b42ed3b754b58817a62bbe74651b4 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:35:46.842338 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1421e9b-4b66-4a76-b91f-6691a9773491 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:46.842691 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1421e9b-4b66-4a76-b91f-6691a9773491 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:46.842691 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1421e9b-4b66-4a76-b91f-6691a9773491 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:46.867463 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-f1421e9b-4b66-4a76-b91f-6691a9773491 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:35:46.868798 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-f1421e9b-4b66-4a76-b91f-6691a9773491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:35:46.964457 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1352/2742] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:35:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:35:46.975051 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9545b4be-83d0-4552-8c20-41fd72af072b admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:35:46.977309 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-9545b4be-83d0-4552-8c20-41fd72af072b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:35:47.104443 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9545b4be-83d0-4552-8c20-41fd72af072b admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:35:47.117630 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085346fc-477b-4b39-898c-f0dbc0d59694 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c1289b015854c6bb6aee8fed6b807db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:35:47.119396 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085346fc-477b-4b39-898c-f0dbc0d59694 service neutron] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:47.119691 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085346fc-477b-4b39-898c-f0dbc0d59694 service neutron] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:47.119974 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085346fc-477b-4b39-898c-f0dbc0d59694 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:47.138258 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085346fc-477b-4b39-898c-f0dbc0d59694 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:35:47.142006 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085346fc-477b-4b39-898c-f0dbc0d59694 service neutron] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:35:47.170680 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1391/2743] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:35:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:35:48.561617 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2688097-f7c7-4a06-8e79-4b073ba5ced3 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:48.562662 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2688097-f7c7-4a06-8e79-4b073ba5ced3 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:48.564310 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2688097-f7c7-4a06-8e79-4b073ba5ced3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:48.620537 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-c2688097-f7c7-4a06-8e79-4b073ba5ced3 None None] MFA Rules not processed for user `ec793e182dfa4ae3bd8a57c41f1e0077`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:35:48.622440 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-c2688097-f7c7-4a06-8e79-4b073ba5ced3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:35:48.760224 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1353/2744] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:35:48 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 10:35:48.767163 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085346fc-477b-4b39-898c-f0dbc0d59694 service neutron] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:35:48.773397 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-085346fc-477b-4b39-898c-f0dbc0d59694 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:35:48.823940 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:DELETE=4,keystone:SELECT=93,keystone:INSERT=3 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:35:48.888728 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085346fc-477b-4b39-898c-f0dbc0d59694 service neutron] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:35:48.892656 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa38a11-b8ba-4809-862c-c147dd10b205 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa4d004fd44482cae761c4b3bdfab31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:35:48.894716 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa38a11-b8ba-4809-862c-c147dd10b205 service cinder] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:48.895169 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa38a11-b8ba-4809-862c-c147dd10b205 service cinder] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:48.895523 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa38a11-b8ba-4809-862c-c147dd10b205 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:48.918011 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa38a11-b8ba-4809-862c-c147dd10b205 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:35:48.920383 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa38a11-b8ba-4809-862c-c147dd10b205 service cinder] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:35:48.945321 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1392/2745] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:35:48 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 10:35:50.572307 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89a40d3-07e5-4c6c-9d36-c2f6562f3b1d None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:50.573322 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89a40d3-07e5-4c6c-9d36-c2f6562f3b1d None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:50.573818 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89a40d3-07e5-4c6c-9d36-c2f6562f3b1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:50.606148 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-d89a40d3-07e5-4c6c-9d36-c2f6562f3b1d None None] MFA Rules not processed for user `ec793e182dfa4ae3bd8a57c41f1e0077`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:35:50.607671 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-d89a40d3-07e5-4c6c-9d36-c2f6562f3b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:35:50.616063 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1354/2746] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:35:50 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:35:54.488262 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa38a11-b8ba-4809-862c-c147dd10b205 service cinder] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:35:54.489767 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-2fa38a11-b8ba-4809-862c-c147dd10b205 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:35:54.505965 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa38a11-b8ba-4809-862c-c147dd10b205 service cinder] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:35:54.510994 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc55573b-138f-4e8d-bafb-d6671e4030d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:35:54.511642 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc55573b-138f-4e8d-bafb-d6671e4030d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:54.511927 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc55573b-138f-4e8d-bafb-d6671e4030d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:54.512232 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc55573b-138f-4e8d-bafb-d6671e4030d7 admin admin] PATH_INFO: `/v3/users/699aa0a0199f4e908d90a4e1ef5efc15` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:54.513373 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc55573b-138f-4e8d-bafb-d6671e4030d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=699aa0a0199f4e908d90a4e1ef5efc15)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:35:54.515318 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc55573b-138f-4e8d-bafb-d6671e4030d7 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:35:54.570306 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-bc55573b-138f-4e8d-bafb-d6671e4030d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '699aa0a0199f4e908d90a4e1ef5efc15'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:54.578564 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-bc55573b-138f-4e8d-bafb-d6671e4030d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '699aa0a0199f4e908d90a4e1ef5efc15'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:54.579486 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-bc55573b-138f-4e8d-bafb-d6671e4030d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '699aa0a0199f4e908d90a4e1ef5efc15'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:54.580030 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-bc55573b-138f-4e8d-bafb-d6671e4030d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '699aa0a0199f4e908d90a4e1ef5efc15'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:54.587066 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-bc55573b-138f-4e8d-bafb-d6671e4030d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '699aa0a0199f4e908d90a4e1ef5efc15'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:54.605854 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1393/2747] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 19 10:35:54 2022] DELETE /identity/v3/users/699aa0a0199f4e908d90a4e1ef5efc15 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:35:54.805609 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89a40d3-07e5-4c6c-9d36-c2f6562f3b1d None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:35:54.822087 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89a40d3-07e5-4c6c-9d36-c2f6562f3b1d None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:35:54.845060 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:35:54.889324 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ddc230-56eb-4941-b428-9271c97d6314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:35:54.889966 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ddc230-56eb-4941-b428-9271c97d6314 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:54.890256 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ddc230-56eb-4941-b428-9271c97d6314 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:54.890533 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ddc230-56eb-4941-b428-9271c97d6314 admin admin] PATH_INFO: `/v3/projects/ae0b96965a0b4564a4cc19028bf55123` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:54.891667 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ddc230-56eb-4941-b428-9271c97d6314 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae0b96965a0b4564a4cc19028bf55123)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:35:54.894209 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ddc230-56eb-4941-b428-9271c97d6314 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:35:54.940540 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-53ddc230-56eb-4941-b428-9271c97d6314 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae0b96965a0b4564a4cc19028bf55123', 'request_id': 'req-53ddc230-56eb-4941-b428-9271c97d6314'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:54.947515 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-53ddc230-56eb-4941-b428-9271c97d6314 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae0b96965a0b4564a4cc19028bf55123', 'request_id': 'req-53ddc230-56eb-4941-b428-9271c97d6314'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:54.955468 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-53ddc230-56eb-4941-b428-9271c97d6314 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae0b96965a0b4564a4cc19028bf55123', 'request_id': 'req-53ddc230-56eb-4941-b428-9271c97d6314'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:54.966471 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-53ddc230-56eb-4941-b428-9271c97d6314 admin admin] The token cache is being invalidate because project ae0b96965a0b4564a4cc19028bf55123 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 10:35:54.966700 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-53ddc230-56eb-4941-b428-9271c97d6314 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:54.967334 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-53ddc230-56eb-4941-b428-9271c97d6314 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:54.968843 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1355/2748] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 19 10:35:54 2022] DELETE /identity/v3/projects/ae0b96965a0b4564a4cc19028bf55123 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:35:54.972909 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc55573b-138f-4e8d-bafb-d6671e4030d7 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:35:54.974357 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-bc55573b-138f-4e8d-bafb-d6671e4030d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:35:54.987938 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc55573b-138f-4e8d-bafb-d6671e4030d7 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:35:55.046123 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74084ba2-5edf-48b4-a870-56e6aec6fea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:35:55.046768 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74084ba2-5edf-48b4-a870-56e6aec6fea4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:55.047053 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74084ba2-5edf-48b4-a870-56e6aec6fea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:55.047325 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74084ba2-5edf-48b4-a870-56e6aec6fea4 admin admin] PATH_INFO: `/v3/users/ab574e9d27254a81a9e8eb09a6c263e1` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:55.048490 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74084ba2-5edf-48b4-a870-56e6aec6fea4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab574e9d27254a81a9e8eb09a6c263e1)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:35:55.050987 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74084ba2-5edf-48b4-a870-56e6aec6fea4 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:35:55.085151 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:35:55.100074 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-74084ba2-5edf-48b4-a870-56e6aec6fea4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab574e9d27254a81a9e8eb09a6c263e1'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:55.112993 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-74084ba2-5edf-48b4-a870-56e6aec6fea4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab574e9d27254a81a9e8eb09a6c263e1'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:55.114035 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-74084ba2-5edf-48b4-a870-56e6aec6fea4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab574e9d27254a81a9e8eb09a6c263e1'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:55.115017 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-74084ba2-5edf-48b4-a870-56e6aec6fea4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab574e9d27254a81a9e8eb09a6c263e1'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:55.123544 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-74084ba2-5edf-48b4-a870-56e6aec6fea4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab574e9d27254a81a9e8eb09a6c263e1'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:55.142443 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1394/2749] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 19 10:35:54 2022] DELETE /identity/v3/users/ab574e9d27254a81a9e8eb09a6c263e1 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:35:55.335946 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ddc230-56eb-4941-b428-9271c97d6314 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:35:55.337883 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-53ddc230-56eb-4941-b428-9271c97d6314 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:35:55.356393 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ddc230-56eb-4941-b428-9271c97d6314 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:35:55.431009 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0e118f-8b63-4e74-b428-bd95a9136573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:35:55.431880 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0e118f-8b63-4e74-b428-bd95a9136573 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:55.432298 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0e118f-8b63-4e74-b428-bd95a9136573 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:55.432574 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0e118f-8b63-4e74-b428-bd95a9136573 admin admin] PATH_INFO: `/v3/projects/49d4a70e46734aea96f73796d7d4c5e9` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:55.433743 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0e118f-8b63-4e74-b428-bd95a9136573 admin admin] RBAC: Authorizing `identity:delete_project(project_id=49d4a70e46734aea96f73796d7d4c5e9)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:35:55.435669 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0e118f-8b63-4e74-b428-bd95a9136573 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:35:55.481478 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-7a0e118f-8b63-4e74-b428-bd95a9136573 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49d4a70e46734aea96f73796d7d4c5e9', 'request_id': 'req-7a0e118f-8b63-4e74-b428-bd95a9136573'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:55.488891 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-7a0e118f-8b63-4e74-b428-bd95a9136573 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49d4a70e46734aea96f73796d7d4c5e9', 'request_id': 'req-7a0e118f-8b63-4e74-b428-bd95a9136573'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:55.491664 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:35:55.498882 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-7a0e118f-8b63-4e74-b428-bd95a9136573 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49d4a70e46734aea96f73796d7d4c5e9', 'request_id': 'req-7a0e118f-8b63-4e74-b428-bd95a9136573'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:55.510686 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-7a0e118f-8b63-4e74-b428-bd95a9136573 admin admin] The token cache is being invalidate because project 49d4a70e46734aea96f73796d7d4c5e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 10:35:55.510974 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-7a0e118f-8b63-4e74-b428-bd95a9136573 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:55.511607 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-7a0e118f-8b63-4e74-b428-bd95a9136573 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:35:55.513120 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1356/2750] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 19 10:35:55 2022] DELETE /identity/v3/projects/49d4a70e46734aea96f73796d7d4c5e9 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:35:56.792629 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ed5e3d-acfb-4b3d-a954-8fc9d94a3ff0 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:56.794800 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ed5e3d-acfb-4b3d-a954-8fc9d94a3ff0 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:56.795401 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ed5e3d-acfb-4b3d-a954-8fc9d94a3ff0 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:56.797075 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1395/2751] 10.222.0.66 () {54 vars in 921 bytes} [Mon Sep 19 10:35:56 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:35:56.804484 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3151a7-765e-4cbe-9c0a-fc7f362a924d None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:56.805060 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3151a7-765e-4cbe-9c0a-fc7f362a924d None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:56.805276 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3151a7-765e-4cbe-9c0a-fc7f362a924d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:56.825644 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-1d3151a7-765e-4cbe-9c0a-fc7f362a924d None None] MFA Rules not processed for user `15c70bfb085a44e9b84942b480ff22f1`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:35:56.826893 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-1d3151a7-765e-4cbe-9c0a-fc7f362a924d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:35:56.910342 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1357/2752] 10.222.0.66 () {58 vars in 1018 bytes} [Mon Sep 19 10:35:56 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:35:56.930207 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ed5e3d-acfb-4b3d-a954-8fc9d94a3ff0 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:35:56.932299 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-f4ed5e3d-acfb-4b3d-a954-8fc9d94a3ff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:35:56.997346 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ed5e3d-acfb-4b3d-a954-8fc9d94a3ff0 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:35:57.004201 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9388fb0e-d29c-40a0-a0e6-bc0553509d04 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f95c0d9f2414f3ca2fa2d1546d47f1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:35:57.006976 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9388fb0e-d29c-40a0-a0e6-bc0553509d04 service glance] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:57.007516 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9388fb0e-d29c-40a0-a0e6-bc0553509d04 service glance] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:57.008034 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9388fb0e-d29c-40a0-a0e6-bc0553509d04 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:57.023516 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9388fb0e-d29c-40a0-a0e6-bc0553509d04 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:35:57.025174 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9388fb0e-d29c-40a0-a0e6-bc0553509d04 service glance] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:35:57.037512 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1396/2753] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:35:56 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:35:57.120308 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ebf14f-cae7-4bbd-a0b5-f14c58eeddcb None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:57.120603 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ebf14f-cae7-4bbd-a0b5-f14c58eeddcb None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:57.120883 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ebf14f-cae7-4bbd-a0b5-f14c58eeddcb None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:57.122440 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1358/2754] 10.222.0.66 () {54 vars in 921 bytes} [Mon Sep 19 10:35:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:35:57.127188 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8d0cbd-9dd4-48de-a47d-43eecb765665 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:57.128281 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8d0cbd-9dd4-48de-a47d-43eecb765665 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:57.128636 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8d0cbd-9dd4-48de-a47d-43eecb765665 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:57.150652 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-df8d0cbd-9dd4-48de-a47d-43eecb765665 None None] MFA Rules not processed for user `0c1289b015854c6bb6aee8fed6b807db`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:35:57.151888 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-df8d0cbd-9dd4-48de-a47d-43eecb765665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:35:57.235075 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1397/2755] 10.222.0.66 () {58 vars in 1018 bytes} [Mon Sep 19 10:35:57 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:35:57.247555 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ebf14f-cae7-4bbd-a0b5-f14c58eeddcb None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:35:57.249462 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-00ebf14f-cae7-4bbd-a0b5-f14c58eeddcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:35:57.262712 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ebf14f-cae7-4bbd-a0b5-f14c58eeddcb None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:35:57.266358 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6599ba1d-f54b-4662-b0d4-1f419e822841 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c1289b015854c6bb6aee8fed6b807db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:35:57.267031 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6599ba1d-f54b-4662-b0d4-1f419e822841 service neutron] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:57.267381 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6599ba1d-f54b-4662-b0d4-1f419e822841 service neutron] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:57.267718 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6599ba1d-f54b-4662-b0d4-1f419e822841 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:57.275576 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6599ba1d-f54b-4662-b0d4-1f419e822841 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:35:57.277127 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6599ba1d-f54b-4662-b0d4-1f419e822841 service neutron] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:35:57.286092 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1359/2756] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:35:57 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:35:57.374915 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a93b509-978a-488d-b18b-de878a7359b2 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:57.375288 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a93b509-978a-488d-b18b-de878a7359b2 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:57.375571 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a93b509-978a-488d-b18b-de878a7359b2 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:57.377025 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1398/2757] 10.222.0.66 () {54 vars in 921 bytes} [Mon Sep 19 10:35:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:35:57.383283 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1103aa-bf2e-4358-a1c2-f93856630647 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:57.383650 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1103aa-bf2e-4358-a1c2-f93856630647 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:57.383997 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1103aa-bf2e-4358-a1c2-f93856630647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:57.406517 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-1c1103aa-bf2e-4358-a1c2-f93856630647 None None] MFA Rules not processed for user `15c70bfb085a44e9b84942b480ff22f1`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:35:57.408023 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-1c1103aa-bf2e-4358-a1c2-f93856630647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:35:57.419408 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1360/2758] 10.222.0.66 () {58 vars in 1018 bytes} [Mon Sep 19 10:35:57 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:35:57.433871 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a93b509-978a-488d-b18b-de878a7359b2 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:35:57.445687 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a93b509-978a-488d-b18b-de878a7359b2 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:35:57.449344 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d47aca-9c98-4feb-ae75-1e3c4a358fa5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c1289b015854c6bb6aee8fed6b807db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:35:57.450043 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d47aca-9c98-4feb-ae75-1e3c4a358fa5 service neutron] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:35:57.450385 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d47aca-9c98-4feb-ae75-1e3c4a358fa5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:35:57.450722 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d47aca-9c98-4feb-ae75-1e3c4a358fa5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:35:57.465160 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d47aca-9c98-4feb-ae75-1e3c4a358fa5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:35:57.466891 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d47aca-9c98-4feb-ae75-1e3c4a358fa5 service neutron] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:35:57.481243 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1399/2759] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:35:57 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:36:01.349358 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a64425d-28d0-4e12-9621-9043644df6b8 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:36:01.349904 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a64425d-28d0-4e12-9621-9043644df6b8 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:36:01.349904 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a64425d-28d0-4e12-9621-9043644df6b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:36:01.371290 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-3a64425d-28d0-4e12-9621-9043644df6b8 None None] MFA Rules not processed for user `e4d1160b71a84e2fa44a8ca6edf1846e`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:36:01.372845 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-3a64425d-28d0-4e12-9621-9043644df6b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:36:01.435586 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1361/2760] 10.222.0.66 () {58 vars in 1009 bytes} [Mon Sep 19 10:36:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:36:01.448086 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d47aca-9c98-4feb-ae75-1e3c4a358fa5 service neutron] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:36:01.449502 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-f3d47aca-9c98-4feb-ae75-1e3c4a358fa5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:36:01.501440 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:36:01.525391 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d47aca-9c98-4feb-ae75-1e3c4a358fa5 service neutron] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:36:01.534688 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5d0fd1-e1ad-4062-83d4-49be053f2ffb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6677354e36614c9fb3d03413749be5ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:36:01.535297 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5d0fd1-e1ad-4062-83d4-49be053f2ffb service swift] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:36:01.535572 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5d0fd1-e1ad-4062-83d4-49be053f2ffb service swift] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:36:01.535839 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5d0fd1-e1ad-4062-83d4-49be053f2ffb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:36:01.544757 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5d0fd1-e1ad-4062-83d4-49be053f2ffb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:36:01.546267 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5d0fd1-e1ad-4062-83d4-49be053f2ffb service swift] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:36:01.554988 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1400/2761] 10.222.0.66 () {60 vars in 1384 bytes} [Mon Sep 19 10:36:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 19 10:36:11.429039 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:DELETE=3,keystone:SELECT=69 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:36:11.551639 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=11 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:36:12.110045 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a64425d-28d0-4e12-9621-9043644df6b8 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:36:12.111497 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-3a64425d-28d0-4e12-9621-9043644df6b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:36:12.177904 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a64425d-28d0-4e12-9621-9043644df6b8 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:36:12.182539 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e62f399-04fb-4211-9470-5608c2e96f82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:36:12.183185 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e62f399-04fb-4211-9470-5608c2e96f82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:36:12.183693 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e62f399-04fb-4211-9470-5608c2e96f82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:36:12.183807 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e62f399-04fb-4211-9470-5608c2e96f82 admin admin] PATH_INFO: `/v3/users/c267699eb7d747b3a3d8024bb5003a41` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:36:12.185019 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e62f399-04fb-4211-9470-5608c2e96f82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c267699eb7d747b3a3d8024bb5003a41)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:36:12.189612 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e62f399-04fb-4211-9470-5608c2e96f82 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:36:12.259186 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-7e62f399-04fb-4211-9470-5608c2e96f82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c267699eb7d747b3a3d8024bb5003a41'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:36:12.269985 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-7e62f399-04fb-4211-9470-5608c2e96f82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c267699eb7d747b3a3d8024bb5003a41'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:36:12.270693 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-7e62f399-04fb-4211-9470-5608c2e96f82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c267699eb7d747b3a3d8024bb5003a41'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:36:12.271383 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-7e62f399-04fb-4211-9470-5608c2e96f82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c267699eb7d747b3a3d8024bb5003a41'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:36:12.278993 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-7e62f399-04fb-4211-9470-5608c2e96f82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c267699eb7d747b3a3d8024bb5003a41'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:36:12.301890 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1362/2762] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 19 10:36:12 2022] DELETE /identity/v3/users/c267699eb7d747b3a3d8024bb5003a41 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:36:12.306376 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96fbde0-ff05-4f44-a8aa-6080284b3313 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:36:12.306891 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96fbde0-ff05-4f44-a8aa-6080284b3313 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:36:12.307171 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96fbde0-ff05-4f44-a8aa-6080284b3313 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:36:12.327573 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-b96fbde0-ff05-4f44-a8aa-6080284b3313 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:36:12.328847 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-b96fbde0-ff05-4f44-a8aa-6080284b3313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:36:12.392379 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1401/2763] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:36:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 10:36:12.402624 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e62f399-04fb-4211-9470-5608c2e96f82 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:36:12.404103 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-7e62f399-04fb-4211-9470-5608c2e96f82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:36:12.469373 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e62f399-04fb-4211-9470-5608c2e96f82 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:36:12.474491 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e5795e-0e00-47ec-9426-00109b71d754 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c1289b015854c6bb6aee8fed6b807db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:36:12.475106 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e5795e-0e00-47ec-9426-00109b71d754 service neutron] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:36:12.475388 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e5795e-0e00-47ec-9426-00109b71d754 service neutron] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:36:12.475667 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e5795e-0e00-47ec-9426-00109b71d754 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:36:12.485521 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e5795e-0e00-47ec-9426-00109b71d754 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:36:12.487152 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e5795e-0e00-47ec-9426-00109b71d754 service neutron] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:36:12.499565 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1363/2764] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:36:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:36:12.799325 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96fbde0-ff05-4f44-a8aa-6080284b3313 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:36:12.800882 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-b96fbde0-ff05-4f44-a8aa-6080284b3313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:36:12.813975 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96fbde0-ff05-4f44-a8aa-6080284b3313 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:36:12.819585 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f000e4-0175-4cde-b161-a7cccf031ed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:36:12.820369 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f000e4-0175-4cde-b161-a7cccf031ed4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:36:12.820705 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f000e4-0175-4cde-b161-a7cccf031ed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:36:12.821048 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f000e4-0175-4cde-b161-a7cccf031ed4 admin admin] PATH_INFO: `/v3/projects/490a13a3925247de929c65ebff61499f` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:36:12.822293 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f000e4-0175-4cde-b161-a7cccf031ed4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=490a13a3925247de929c65ebff61499f)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:36:12.824348 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f000e4-0175-4cde-b161-a7cccf031ed4 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:36:12.876226 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-63f000e4-0175-4cde-b161-a7cccf031ed4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '490a13a3925247de929c65ebff61499f', 'request_id': 'req-63f000e4-0175-4cde-b161-a7cccf031ed4'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:36:12.883437 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-63f000e4-0175-4cde-b161-a7cccf031ed4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '490a13a3925247de929c65ebff61499f', 'request_id': 'req-63f000e4-0175-4cde-b161-a7cccf031ed4'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:36:12.891856 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-63f000e4-0175-4cde-b161-a7cccf031ed4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '490a13a3925247de929c65ebff61499f', 'request_id': 'req-63f000e4-0175-4cde-b161-a7cccf031ed4'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:36:12.906817 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-63f000e4-0175-4cde-b161-a7cccf031ed4 admin admin] The token cache is being invalidate because project 490a13a3925247de929c65ebff61499f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 10:36:12.907174 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-63f000e4-0175-4cde-b161-a7cccf031ed4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:36:12.907891 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-63f000e4-0175-4cde-b161-a7cccf031ed4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:36:12.909504 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1402/2765] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 19 10:36:12 2022] DELETE /identity/v3/projects/490a13a3925247de929c65ebff61499f => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:36:12.914672 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71f4d8d-bd27-4169-a8e3-2102ab187a84 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:36:12.914958 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71f4d8d-bd27-4169-a8e3-2102ab187a84 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:36:12.915234 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71f4d8d-bd27-4169-a8e3-2102ab187a84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:36:12.934583 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-e71f4d8d-bd27-4169-a8e3-2102ab187a84 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:36:12.935775 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-e71f4d8d-bd27-4169-a8e3-2102ab187a84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:36:12.952636 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:36:13.001132 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1364/2766] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:36:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:36:13.011027 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aea3c7-2d7e-488c-b3a9-10f0becdd758 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:36:13.011315 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aea3c7-2d7e-488c-b3a9-10f0becdd758 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:36:13.011614 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aea3c7-2d7e-488c-b3a9-10f0becdd758 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:36:13.031368 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-c9aea3c7-2d7e-488c-b3a9-10f0becdd758 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:36:13.032647 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-c9aea3c7-2d7e-488c-b3a9-10f0becdd758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:36:13.040530 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1403/2767] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:36:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:36:13.045053 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71f4d8d-bd27-4169-a8e3-2102ab187a84 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:36:13.055343 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71f4d8d-bd27-4169-a8e3-2102ab187a84 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:36:13.060107 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e800ef9f-adf5-42bf-bb38-f0d37f6ad599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:36:13.060857 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e800ef9f-adf5-42bf-bb38-f0d37f6ad599 admin admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:36:13.061140 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e800ef9f-adf5-42bf-bb38-f0d37f6ad599 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:36:13.061433 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e800ef9f-adf5-42bf-bb38-f0d37f6ad599 admin admin] PATH_INFO: `/v3/domains` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:36:13.062062 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e800ef9f-adf5-42bf-bb38-f0d37f6ad599 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:36:13.062360 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e800ef9f-adf5-42bf-bb38-f0d37f6ad599 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:36:13.063950 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e800ef9f-adf5-42bf-bb38-f0d37f6ad599 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:36:13.076328 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1365/2768] 10.222.0.66 () {58 vars in 1153 bytes} [Mon Sep 19 10:36:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:36:13.080678 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9aea3c7-2d7e-488c-b3a9-10f0becdd758 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:36:13.090117 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9aea3c7-2d7e-488c-b3a9-10f0becdd758 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:36:13.094791 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cf652c-9b93-4ea0-a97d-cb0b4503fe56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:36:13.095387 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cf652c-9b93-4ea0-a97d-cb0b4503fe56 admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:36:13.095666 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cf652c-9b93-4ea0-a97d-cb0b4503fe56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:36:13.095937 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cf652c-9b93-4ea0-a97d-cb0b4503fe56 admin admin] PATH_INFO: `/v3/projects` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:36:13.096613 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cf652c-9b93-4ea0-a97d-cb0b4503fe56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:36:13.098581 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cf652c-9b93-4ea0-a97d-cb0b4503fe56 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:36:13.125894 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1404/2769] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 19 10:36:13 2022] POST /identity/v3/projects => generated 391 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:36:13.130973 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e800ef9f-adf5-42bf-bb38-f0d37f6ad599 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:36:13.140826 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e800ef9f-adf5-42bf-bb38-f0d37f6ad599 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:36:13.197314 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d550e1b-5fcd-4dc1-a9af-a4af1e12f450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:36:13.197925 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d550e1b-5fcd-4dc1-a9af-a4af1e12f450 admin admin] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:36:13.198241 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d550e1b-5fcd-4dc1-a9af-a4af1e12f450 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:36:13.198516 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d550e1b-5fcd-4dc1-a9af-a4af1e12f450 admin admin] PATH_INFO: `/v3/users` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:36:13.199159 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d550e1b-5fcd-4dc1-a9af-a4af1e12f450 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:36:13.201151 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d550e1b-5fcd-4dc1-a9af-a4af1e12f450 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:36:13.222469 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1366/2770] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 19 10:36:13 2022] POST /identity/v3/users => generated 296 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:36:13.226492 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cf652c-9b93-4ea0-a97d-cb0b4503fe56 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:36:13.237457 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cf652c-9b93-4ea0-a97d-cb0b4503fe56 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:36:13.242959 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795da23f-9517-4132-bafb-a968c6453704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:36:13.243563 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795da23f-9517-4132-bafb-a968c6453704 admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:36:13.243898 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795da23f-9517-4132-bafb-a968c6453704 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:36:13.244190 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795da23f-9517-4132-bafb-a968c6453704 admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:36:13.244846 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795da23f-9517-4132-bafb-a968c6453704 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:36:13.246476 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795da23f-9517-4132-bafb-a968c6453704 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:36:13.257651 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1405/2771] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:36:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 10:36:13.261788 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d550e1b-5fcd-4dc1-a9af-a4af1e12f450 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:36:13.271769 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d550e1b-5fcd-4dc1-a9af-a4af1e12f450 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:36:13.276344 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81164c6f-6f1a-4988-8192-fa63e27901e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:36:13.276930 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81164c6f-6f1a-4988-8192-fa63e27901e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:36:13.277206 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81164c6f-6f1a-4988-8192-fa63e27901e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:36:13.277481 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81164c6f-6f1a-4988-8192-fa63e27901e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:36:13.278106 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81164c6f-6f1a-4988-8192-fa63e27901e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:36:13.279680 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81164c6f-6f1a-4988-8192-fa63e27901e5 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:36:13.290230 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1367/2772] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:36:13 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 10:36:13.294525 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795da23f-9517-4132-bafb-a968c6453704 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:36:13.305206 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795da23f-9517-4132-bafb-a968c6453704 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:36:13.309915 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10740708-38c6-469c-ab7d-a4a1509dbfad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:36:13.310561 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10740708-38c6-469c-ab7d-a4a1509dbfad admin admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:36:13.310839 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10740708-38c6-469c-ab7d-a4a1509dbfad admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:36:13.311110 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10740708-38c6-469c-ab7d-a4a1509dbfad admin admin] PATH_INFO: `/v3/projects/2a75bae005a34ed5bb2aad0f3e3e79d6/users/42eaf5c2bf624450be2f09329596e0e5/roles/cd5b42ed3b754b58817a62bbe74651b4` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:36:13.326204 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10740708-38c6-469c-ab7d-a4a1509dbfad admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a75bae005a34ed5bb2aad0f3e3e79d6, user_id=42eaf5c2bf624450be2f09329596e0e5, role_id=cd5b42ed3b754b58817a62bbe74651b4)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:36:13.329081 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10740708-38c6-469c-ab7d-a4a1509dbfad admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:36:13.343947 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1406/2773] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 19 10:36:13 2022] PUT /identity/v3/projects/2a75bae005a34ed5bb2aad0f3e3e79d6/users/42eaf5c2bf624450be2f09329596e0e5/roles/cd5b42ed3b754b58817a62bbe74651b4 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:36:13.355983 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e982cc3c-e431-4d20-a847-b4c27485a4f6 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:36:13.356399 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e982cc3c-e431-4d20-a847-b4c27485a4f6 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:36:13.356769 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e982cc3c-e431-4d20-a847-b4c27485a4f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:36:13.390125 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-e982cc3c-e431-4d20-a847-b4c27485a4f6 None None] MFA Rules not processed for user `42eaf5c2bf624450be2f09329596e0e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:36:13.391536 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-e982cc3c-e431-4d20-a847-b4c27485a4f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:36:13.467196 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1368/2774] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:36:13 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:36:13.479999 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10740708-38c6-469c-ab7d-a4a1509dbfad admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:36:13.482232 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-10740708-38c6-469c-ab7d-a4a1509dbfad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:36:13.507787 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:36:13.547788 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10740708-38c6-469c-ab7d-a4a1509dbfad admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:36:13.552295 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c2660e-f941-4f95-987d-b4a2d475b8ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa4d004fd44482cae761c4b3bdfab31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:36:13.552912 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c2660e-f941-4f95-987d-b4a2d475b8ab service cinder] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:36:13.553295 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c2660e-f941-4f95-987d-b4a2d475b8ab service cinder] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:36:13.553459 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c2660e-f941-4f95-987d-b4a2d475b8ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:36:13.562265 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c2660e-f941-4f95-987d-b4a2d475b8ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:36:13.563705 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c2660e-f941-4f95-987d-b4a2d475b8ab service cinder] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:36:13.573066 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1407/2775] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:36:13 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:36:19.032098 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065830f0-1923-4ab8-b8f9-2d66a913b5ce None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:36:19.032593 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065830f0-1923-4ab8-b8f9-2d66a913b5ce None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:36:19.032696 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065830f0-1923-4ab8-b8f9-2d66a913b5ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:36:19.055282 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-065830f0-1923-4ab8-b8f9-2d66a913b5ce None None] MFA Rules not processed for user `e4d1160b71a84e2fa44a8ca6edf1846e`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:36:19.056767 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-065830f0-1923-4ab8-b8f9-2d66a913b5ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:36:19.071547 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:36:19.123531 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1369/2776] 10.222.0.66 () {58 vars in 967 bytes} [Mon Sep 19 10:36:19 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:36:19.136632 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c2660e-f941-4f95-987d-b4a2d475b8ab service cinder] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:36:19.138119 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-a3c2660e-f941-4f95-987d-b4a2d475b8ab service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:36:19.214411 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c2660e-f941-4f95-987d-b4a2d475b8ab service cinder] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:36:19.219549 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70635ffe-2b64-4db2-a0a0-c68164482720 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6677354e36614c9fb3d03413749be5ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:36:19.220179 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70635ffe-2b64-4db2-a0a0-c68164482720 service swift] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:36:19.220468 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70635ffe-2b64-4db2-a0a0-c68164482720 service swift] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:36:19.220742 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70635ffe-2b64-4db2-a0a0-c68164482720 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:36:19.230106 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70635ffe-2b64-4db2-a0a0-c68164482720 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:36:19.231677 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70635ffe-2b64-4db2-a0a0-c68164482720 service swift] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:36:19.240240 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1408/2777] 10.222.0.66 () {60 vars in 1384 bytes} [Mon Sep 19 10:36:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 19 10:36:23.772890 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065830f0-1923-4ab8-b8f9-2d66a913b5ce None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:36:23.838928 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065830f0-1923-4ab8-b8f9-2d66a913b5ce None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:36:23.843413 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baa95a8-50dd-4111-8fdb-2786cd41a6f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:36:23.844048 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baa95a8-50dd-4111-8fdb-2786cd41a6f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:36:23.844355 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baa95a8-50dd-4111-8fdb-2786cd41a6f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:36:23.844630 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baa95a8-50dd-4111-8fdb-2786cd41a6f5 admin admin] PATH_INFO: `/v3/users/42eaf5c2bf624450be2f09329596e0e5` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:36:23.845870 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baa95a8-50dd-4111-8fdb-2786cd41a6f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=42eaf5c2bf624450be2f09329596e0e5)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:36:23.847823 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baa95a8-50dd-4111-8fdb-2786cd41a6f5 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:36:23.896509 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-6baa95a8-50dd-4111-8fdb-2786cd41a6f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42eaf5c2bf624450be2f09329596e0e5'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:36:23.904112 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-6baa95a8-50dd-4111-8fdb-2786cd41a6f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42eaf5c2bf624450be2f09329596e0e5'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:36:23.904763 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-6baa95a8-50dd-4111-8fdb-2786cd41a6f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42eaf5c2bf624450be2f09329596e0e5'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:36:23.905374 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-6baa95a8-50dd-4111-8fdb-2786cd41a6f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42eaf5c2bf624450be2f09329596e0e5'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:36:23.912868 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-6baa95a8-50dd-4111-8fdb-2786cd41a6f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42eaf5c2bf624450be2f09329596e0e5'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:36:23.933136 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1370/2778] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 19 10:36:23 2022] DELETE /identity/v3/users/42eaf5c2bf624450be2f09329596e0e5 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:36:23.937695 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d387a143-c05e-4f97-9fa0-30ca5edd1ce1 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:36:23.938160 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d387a143-c05e-4f97-9fa0-30ca5edd1ce1 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:36:23.938288 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d387a143-c05e-4f97-9fa0-30ca5edd1ce1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:36:23.957630 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-d387a143-c05e-4f97-9fa0-30ca5edd1ce1 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:36:23.959464 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-d387a143-c05e-4f97-9fa0-30ca5edd1ce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:36:24.023338 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1409/2779] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:36:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:36:24.033203 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baa95a8-50dd-4111-8fdb-2786cd41a6f5 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:36:24.034778 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-6baa95a8-50dd-4111-8fdb-2786cd41a6f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:36:24.080471 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:36:24.094240 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baa95a8-50dd-4111-8fdb-2786cd41a6f5 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:36:24.097905 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d2096e-7e04-4f36-aac9-d48ed82d26e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c1289b015854c6bb6aee8fed6b807db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:36:24.098507 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d2096e-7e04-4f36-aac9-d48ed82d26e7 service neutron] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:36:24.098783 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d2096e-7e04-4f36-aac9-d48ed82d26e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:36:24.099053 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d2096e-7e04-4f36-aac9-d48ed82d26e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:36:24.107892 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d2096e-7e04-4f36-aac9-d48ed82d26e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:36:24.109360 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d2096e-7e04-4f36-aac9-d48ed82d26e7 service neutron] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:36:24.119234 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1371/2780] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:36:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:36:24.400837 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d387a143-c05e-4f97-9fa0-30ca5edd1ce1 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:36:24.402358 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-d387a143-c05e-4f97-9fa0-30ca5edd1ce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:36:24.414367 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d387a143-c05e-4f97-9fa0-30ca5edd1ce1 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:36:24.420381 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f91f6a-ab48-4793-a1ab-1cb0a178f263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:36:24.421016 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f91f6a-ab48-4793-a1ab-1cb0a178f263 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:36:24.421480 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f91f6a-ab48-4793-a1ab-1cb0a178f263 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:36:24.421800 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f91f6a-ab48-4793-a1ab-1cb0a178f263 admin admin] PATH_INFO: `/v3/projects/2a75bae005a34ed5bb2aad0f3e3e79d6` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:36:24.423372 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f91f6a-ab48-4793-a1ab-1cb0a178f263 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a75bae005a34ed5bb2aad0f3e3e79d6)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:36:24.425764 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f91f6a-ab48-4793-a1ab-1cb0a178f263 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:36:24.475744 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:36:24.477047 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-48f91f6a-ab48-4793-a1ab-1cb0a178f263 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a75bae005a34ed5bb2aad0f3e3e79d6', 'request_id': 'req-48f91f6a-ab48-4793-a1ab-1cb0a178f263'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:36:24.485179 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-48f91f6a-ab48-4793-a1ab-1cb0a178f263 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a75bae005a34ed5bb2aad0f3e3e79d6', 'request_id': 'req-48f91f6a-ab48-4793-a1ab-1cb0a178f263'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:36:24.497932 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-48f91f6a-ab48-4793-a1ab-1cb0a178f263 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a75bae005a34ed5bb2aad0f3e3e79d6', 'request_id': 'req-48f91f6a-ab48-4793-a1ab-1cb0a178f263'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:36:24.512939 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-48f91f6a-ab48-4793-a1ab-1cb0a178f263 admin admin] The token cache is being invalidate because project 2a75bae005a34ed5bb2aad0f3e3e79d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 10:36:24.514412 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-48f91f6a-ab48-4793-a1ab-1cb0a178f263 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:36:24.514412 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-48f91f6a-ab48-4793-a1ab-1cb0a178f263 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:36:24.515948 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1410/2781] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 19 10:36:24 2022] DELETE /identity/v3/projects/2a75bae005a34ed5bb2aad0f3e3e79d6 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 10:36:34.114582 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=7 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:36:34.508838 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=7,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:36:39.757259 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50875f3-bd82-40ee-a866-00671c8e2534 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:36:39.757814 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50875f3-bd82-40ee-a866-00671c8e2534 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:36:39.757814 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50875f3-bd82-40ee-a866-00671c8e2534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:36:39.777773 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-b50875f3-bd82-40ee-a866-00671c8e2534 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:36:39.778975 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-b50875f3-bd82-40ee-a866-00671c8e2534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:36:39.836308 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1372/2782] 10.222.0.55 () {58 vars in 1016 bytes} [Mon Sep 19 10:36:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:36:39.875544 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f91f6a-ab48-4793-a1ab-1cb0a178f263 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:36:39.877459 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-48f91f6a-ab48-4793-a1ab-1cb0a178f263 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:36:39.962273 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f91f6a-ab48-4793-a1ab-1cb0a178f263 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:36:39.968251 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb8c342-4679-4863-bba2-714897f1b267 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15c70bfb085a44e9b84942b480ff22f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:36:39.968812 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb8c342-4679-4863-bba2-714897f1b267 service nova] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:36:39.969086 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb8c342-4679-4863-bba2-714897f1b267 service nova] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:36:39.969367 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb8c342-4679-4863-bba2-714897f1b267 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:36:39.977666 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb8c342-4679-4863-bba2-714897f1b267 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:36:39.979305 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb8c342-4679-4863-bba2-714897f1b267 service nova] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:36:39.989578 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1411/2783] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:36:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:36:42.721979 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66812498-c3e4-4e57-9eda-0aeacf875a68 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:36:42.722537 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66812498-c3e4-4e57-9eda-0aeacf875a68 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:36:42.722537 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66812498-c3e4-4e57-9eda-0aeacf875a68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:36:42.742932 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-66812498-c3e4-4e57-9eda-0aeacf875a68 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:36:42.744181 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-66812498-c3e4-4e57-9eda-0aeacf875a68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:36:42.753005 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1373/2784] 10.222.0.55 () {58 vars in 1016 bytes} [Mon Sep 19 10:36:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:36:42.778162 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb8c342-4679-4863-bba2-714897f1b267 service nova] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:36:42.779706 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-2bb8c342-4679-4863-bba2-714897f1b267 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:36:42.795943 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb8c342-4679-4863-bba2-714897f1b267 service nova] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:36:42.801373 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e83daf2-6bfe-40eb-8ae0-aac41394e2b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15c70bfb085a44e9b84942b480ff22f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:36:42.802442 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e83daf2-6bfe-40eb-8ae0-aac41394e2b1 service nova] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:36:42.802442 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e83daf2-6bfe-40eb-8ae0-aac41394e2b1 service nova] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:36:42.802680 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e83daf2-6bfe-40eb-8ae0-aac41394e2b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:36:42.810721 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e83daf2-6bfe-40eb-8ae0-aac41394e2b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:36:42.812313 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e83daf2-6bfe-40eb-8ae0-aac41394e2b1 service nova] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:36:42.821735 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1412/2785] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:36:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:36:45.982944 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee87815a-07e6-4b0d-9070-c28e801f8eb8 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:36:45.983495 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee87815a-07e6-4b0d-9070-c28e801f8eb8 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:36:45.983495 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee87815a-07e6-4b0d-9070-c28e801f8eb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:36:46.002838 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-ee87815a-07e6-4b0d-9070-c28e801f8eb8 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:36:46.004037 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-ee87815a-07e6-4b0d-9070-c28e801f8eb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:36:46.011821 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1374/2786] 10.222.0.55 () {58 vars in 1016 bytes} [Mon Sep 19 10:36:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:36:46.043146 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e83daf2-6bfe-40eb-8ae0-aac41394e2b1 service nova] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:36:46.054270 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e83daf2-6bfe-40eb-8ae0-aac41394e2b1 service nova] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:36:46.059782 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06311597-0bb1-4d00-a8bd-7139823f250b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15c70bfb085a44e9b84942b480ff22f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:36:46.060404 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06311597-0bb1-4d00-a8bd-7139823f250b service nova] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:36:46.060710 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06311597-0bb1-4d00-a8bd-7139823f250b service nova] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:36:46.060980 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06311597-0bb1-4d00-a8bd-7139823f250b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:36:46.069935 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06311597-0bb1-4d00-a8bd-7139823f250b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:36:46.071702 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06311597-0bb1-4d00-a8bd-7139823f250b service nova] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:36:46.081871 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1413/2787] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:36:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 10:36:49.048772 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56436f1-3d20-4d7c-8686-00cc9869b41d None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:36:49.049369 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56436f1-3d20-4d7c-8686-00cc9869b41d None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:36:49.049369 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56436f1-3d20-4d7c-8686-00cc9869b41d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:36:49.069067 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-b56436f1-3d20-4d7c-8686-00cc9869b41d None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:36:49.070282 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-b56436f1-3d20-4d7c-8686-00cc9869b41d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:36:49.078282 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1375/2788] 10.222.0.55 () {58 vars in 1016 bytes} [Mon Sep 19 10:36:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:36:49.104213 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06311597-0bb1-4d00-a8bd-7139823f250b service nova] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:36:49.116070 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06311597-0bb1-4d00-a8bd-7139823f250b service nova] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:36:49.121648 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c00b80-2019-4735-9612-555b764f600f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15c70bfb085a44e9b84942b480ff22f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:36:49.122260 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c00b80-2019-4735-9612-555b764f600f service nova] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:36:49.122525 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c00b80-2019-4735-9612-555b764f600f service nova] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:36:49.122800 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c00b80-2019-4735-9612-555b764f600f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:36:49.130993 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c00b80-2019-4735-9612-555b764f600f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:36:49.132612 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c00b80-2019-4735-9612-555b764f600f service nova] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:36:49.142569 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1414/2789] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:36:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:36:53.245087 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b56b20-8430-41d1-a4a4-59f5a5775614 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:36:53.245652 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b56b20-8430-41d1-a4a4-59f5a5775614 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:36:53.245652 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b56b20-8430-41d1-a4a4-59f5a5775614 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:36:53.264951 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-f0b56b20-8430-41d1-a4a4-59f5a5775614 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:36:53.266155 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-f0b56b20-8430-41d1-a4a4-59f5a5775614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:36:53.273950 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1376/2790] 10.222.0.55 () {58 vars in 1016 bytes} [Mon Sep 19 10:36:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:36:53.304414 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c00b80-2019-4735-9612-555b764f600f service nova] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:36:53.315553 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c00b80-2019-4735-9612-555b764f600f service nova] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:36:53.320962 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b50b2c-2842-4b96-8ad1-1e6170e50db4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15c70bfb085a44e9b84942b480ff22f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:36:53.321555 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b50b2c-2842-4b96-8ad1-1e6170e50db4 service nova] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:36:53.321837 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b50b2c-2842-4b96-8ad1-1e6170e50db4 service nova] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:36:53.322108 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b50b2c-2842-4b96-8ad1-1e6170e50db4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:36:53.330517 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b50b2c-2842-4b96-8ad1-1e6170e50db4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:36:53.332096 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b50b2c-2842-4b96-8ad1-1e6170e50db4 service nova] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:36:53.342278 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1415/2791] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:36:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 10:36:57.435615 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4daa68-4ccc-45fa-98c5-454a9f78b7ec None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:36:57.436206 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4daa68-4ccc-45fa-98c5-454a9f78b7ec None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:36:57.436206 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4daa68-4ccc-45fa-98c5-454a9f78b7ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:36:57.455933 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-ce4daa68-4ccc-45fa-98c5-454a9f78b7ec None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:36:57.457166 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-ce4daa68-4ccc-45fa-98c5-454a9f78b7ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:36:57.465587 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1377/2792] 10.222.0.55 () {58 vars in 1016 bytes} [Mon Sep 19 10:36:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:36:57.496634 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b50b2c-2842-4b96-8ad1-1e6170e50db4 service nova] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:36:57.508492 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b50b2c-2842-4b96-8ad1-1e6170e50db4 service nova] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:36:57.515102 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cb2c0c-85b5-422f-9948-46ef96f48194 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15c70bfb085a44e9b84942b480ff22f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:36:57.515697 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cb2c0c-85b5-422f-9948-46ef96f48194 service nova] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:36:57.515976 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cb2c0c-85b5-422f-9948-46ef96f48194 service nova] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:36:57.516282 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cb2c0c-85b5-422f-9948-46ef96f48194 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:36:57.524662 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cb2c0c-85b5-422f-9948-46ef96f48194 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:36:57.526164 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cb2c0c-85b5-422f-9948-46ef96f48194 service nova] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:36:57.536063 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1416/2793] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:36:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:37:07.451169 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=42 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:37:07.531958 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=64 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:37:08.968658 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4daa68-4ccc-45fa-98c5-454a9f78b7ec None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:37:08.970052 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-ce4daa68-4ccc-45fa-98c5-454a9f78b7ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:37:09.026140 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4daa68-4ccc-45fa-98c5-454a9f78b7ec None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:37:09.029773 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3344af30-2968-46a3-9428-7ea4068c5250 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c1289b015854c6bb6aee8fed6b807db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:37:09.030456 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3344af30-2968-46a3-9428-7ea4068c5250 service neutron] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:37:09.030738 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3344af30-2968-46a3-9428-7ea4068c5250 service neutron] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:37:09.031011 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3344af30-2968-46a3-9428-7ea4068c5250 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:37:09.032787 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-3344af30-2968-46a3-9428-7ea4068c5250 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:37:09.049110 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3344af30-2968-46a3-9428-7ea4068c5250 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:37:09.050566 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3344af30-2968-46a3-9428-7ea4068c5250 service neutron] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:37:09.062554 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1378/2794] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:37:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:37:11.536127 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cb2c0c-85b5-422f-9948-46ef96f48194 service nova] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:37:11.537560 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-51cb2c0c-85b5-422f-9948-46ef96f48194 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:37:11.595054 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cb2c0c-85b5-422f-9948-46ef96f48194 service nova] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:37:11.598710 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b4eca8-414f-4d2d-af88-51fe2a2e7cb5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa4d004fd44482cae761c4b3bdfab31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:37:11.599316 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b4eca8-414f-4d2d-af88-51fe2a2e7cb5 service cinder] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:37:11.599596 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b4eca8-414f-4d2d-af88-51fe2a2e7cb5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:37:11.599869 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b4eca8-414f-4d2d-af88-51fe2a2e7cb5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:37:11.601652 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-95b4eca8-414f-4d2d-af88-51fe2a2e7cb5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:37:11.616100 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b4eca8-414f-4d2d-af88-51fe2a2e7cb5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:37:11.617556 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b4eca8-414f-4d2d-af88-51fe2a2e7cb5 service cinder] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:37:11.628705 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1417/2795] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:37:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:37:14.985565 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a376bc29-184c-4b16-a50b-22bbe40eeddc None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:37:14.986122 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a376bc29-184c-4b16-a50b-22bbe40eeddc None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:37:14.986122 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a376bc29-184c-4b16-a50b-22bbe40eeddc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:37:15.005457 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-a376bc29-184c-4b16-a50b-22bbe40eeddc None None] MFA Rules not processed for user `ec793e182dfa4ae3bd8a57c41f1e0077`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:37:15.006775 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-a376bc29-184c-4b16-a50b-22bbe40eeddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:37:15.063185 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1379/2796] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:37:14 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:37:20.246952 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83391f32-8dfe-400d-8ad6-d6e84a2dd9f1 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:37:20.247611 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83391f32-8dfe-400d-8ad6-d6e84a2dd9f1 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:37:20.247611 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83391f32-8dfe-400d-8ad6-d6e84a2dd9f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:37:20.267745 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-83391f32-8dfe-400d-8ad6-d6e84a2dd9f1 None None] MFA Rules not processed for user `32c1b3f5141e43a3ae0af5ca2317ad3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:37:20.268973 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-83391f32-8dfe-400d-8ad6-d6e84a2dd9f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:37:20.322464 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1418/2797] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:37:20 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:37:25.056478 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=51 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:37:30.315691 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=51 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:37:30.564934 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f935d7-2272-41db-8376-fef4366d663d None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:37:30.565374 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f935d7-2272-41db-8376-fef4366d663d None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:37:30.565471 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f935d7-2272-41db-8376-fef4366d663d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:37:30.585664 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-a9f935d7-2272-41db-8376-fef4366d663d None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:37:30.586870 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-a9f935d7-2272-41db-8376-fef4366d663d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:37:30.594672 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1380/2798] 10.222.0.55 () {58 vars in 1016 bytes} [Mon Sep 19 10:37:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:37:30.622576 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83391f32-8dfe-400d-8ad6-d6e84a2dd9f1 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:37:30.635837 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83391f32-8dfe-400d-8ad6-d6e84a2dd9f1 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:37:30.652874 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a93732-309a-4177-acb4-eb543a723364 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15c70bfb085a44e9b84942b480ff22f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:37:30.653501 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a93732-309a-4177-acb4-eb543a723364 service nova] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:37:30.653784 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a93732-309a-4177-acb4-eb543a723364 service nova] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:37:30.654058 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a93732-309a-4177-acb4-eb543a723364 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:37:30.663503 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a93732-309a-4177-acb4-eb543a723364 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:37:30.665117 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a93732-309a-4177-acb4-eb543a723364 service nova] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:37:30.675945 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1419/2799] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:37:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:37:34.898640 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d61ba36-c72b-4cab-861d-7f1906fd8200 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:37:34.899233 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d61ba36-c72b-4cab-861d-7f1906fd8200 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:37:34.899233 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d61ba36-c72b-4cab-861d-7f1906fd8200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:37:34.918613 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-6d61ba36-c72b-4cab-861d-7f1906fd8200 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:37:34.919812 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-6d61ba36-c72b-4cab-861d-7f1906fd8200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:37:34.927580 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1381/2800] 10.222.0.55 () {58 vars in 1016 bytes} [Mon Sep 19 10:37:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:37:34.963533 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a93732-309a-4177-acb4-eb543a723364 service nova] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:37:34.974962 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a93732-309a-4177-acb4-eb543a723364 service nova] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:37:34.980361 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b4227b-59e5-428d-8bfe-c8f50cf90916 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15c70bfb085a44e9b84942b480ff22f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:37:34.981016 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b4227b-59e5-428d-8bfe-c8f50cf90916 service nova] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:37:34.981333 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b4227b-59e5-428d-8bfe-c8f50cf90916 service nova] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:37:34.981587 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b4227b-59e5-428d-8bfe-c8f50cf90916 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:37:34.989695 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b4227b-59e5-428d-8bfe-c8f50cf90916 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:37:34.991251 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b4227b-59e5-428d-8bfe-c8f50cf90916 service nova] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:37:35.001440 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1420/2801] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:37:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:37:37.935602 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a9dab5-03b6-42fa-955b-d8e4a33d96d0 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:37:37.936209 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a9dab5-03b6-42fa-955b-d8e4a33d96d0 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:37:37.936209 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a9dab5-03b6-42fa-955b-d8e4a33d96d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:37:37.955397 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-79a9dab5-03b6-42fa-955b-d8e4a33d96d0 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:37:37.956550 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-79a9dab5-03b6-42fa-955b-d8e4a33d96d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:37:37.964387 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1382/2802] 10.222.0.55 () {58 vars in 1016 bytes} [Mon Sep 19 10:37:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:37:37.993485 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b4227b-59e5-428d-8bfe-c8f50cf90916 service nova] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:37:38.004806 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b4227b-59e5-428d-8bfe-c8f50cf90916 service nova] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:37:38.010243 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf83022c-42d7-4f1e-bb41-febecff7697b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15c70bfb085a44e9b84942b480ff22f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:37:38.010855 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf83022c-42d7-4f1e-bb41-febecff7697b service nova] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:37:38.011128 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf83022c-42d7-4f1e-bb41-febecff7697b service nova] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:37:38.011399 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf83022c-42d7-4f1e-bb41-febecff7697b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:37:38.019462 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf83022c-42d7-4f1e-bb41-febecff7697b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:37:38.021060 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf83022c-42d7-4f1e-bb41-febecff7697b service nova] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:37:38.030800 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1421/2803] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:37:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:37:41.085545 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6012af5b-4aca-4397-a9a5-3ac2e6728bfd None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:37:41.086054 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6012af5b-4aca-4397-a9a5-3ac2e6728bfd None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:37:41.086155 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6012af5b-4aca-4397-a9a5-3ac2e6728bfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:37:41.105171 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-6012af5b-4aca-4397-a9a5-3ac2e6728bfd None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:37:41.106350 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-6012af5b-4aca-4397-a9a5-3ac2e6728bfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:37:41.113980 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1383/2804] 10.222.0.55 () {58 vars in 1016 bytes} [Mon Sep 19 10:37:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:37:41.142581 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf83022c-42d7-4f1e-bb41-febecff7697b service nova] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:37:41.153840 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf83022c-42d7-4f1e-bb41-febecff7697b service nova] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:37:41.159359 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fa6627-e3a1-4e13-ab06-83905faac8be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15c70bfb085a44e9b84942b480ff22f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:37:41.159954 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fa6627-e3a1-4e13-ab06-83905faac8be service nova] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:37:41.160270 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fa6627-e3a1-4e13-ab06-83905faac8be service nova] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:37:41.160545 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fa6627-e3a1-4e13-ab06-83905faac8be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:37:41.168906 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fa6627-e3a1-4e13-ab06-83905faac8be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:37:41.170957 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fa6627-e3a1-4e13-ab06-83905faac8be service nova] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:37:41.180253 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1422/2805] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:37:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:37:44.258634 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b893a839-7616-414e-933b-909511c2d0ea None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:37:44.259267 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b893a839-7616-414e-933b-909511c2d0ea None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:37:44.259450 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b893a839-7616-414e-933b-909511c2d0ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:37:44.279942 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-b893a839-7616-414e-933b-909511c2d0ea None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:37:44.281373 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-b893a839-7616-414e-933b-909511c2d0ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:37:44.289522 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1384/2806] 10.222.0.55 () {58 vars in 1016 bytes} [Mon Sep 19 10:37:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:37:44.321985 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fa6627-e3a1-4e13-ab06-83905faac8be service nova] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:37:44.333227 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fa6627-e3a1-4e13-ab06-83905faac8be service nova] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:37:44.338666 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032a183d-68bb-41f8-8304-a6b2d4927f47 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15c70bfb085a44e9b84942b480ff22f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:37:44.339259 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032a183d-68bb-41f8-8304-a6b2d4927f47 service nova] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:37:44.339537 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032a183d-68bb-41f8-8304-a6b2d4927f47 service nova] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:37:44.339844 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032a183d-68bb-41f8-8304-a6b2d4927f47 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:37:44.348415 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032a183d-68bb-41f8-8304-a6b2d4927f47 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:37:44.350013 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032a183d-68bb-41f8-8304-a6b2d4927f47 service nova] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:37:44.360820 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1423/2807] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:37:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:37:54.275936 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=15 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:37:54.355503 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=30 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:38:04.367886 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b893a839-7616-414e-933b-909511c2d0ea None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:38:04.378267 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b893a839-7616-414e-933b-909511c2d0ea None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:38:04.381928 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef77579a-5ac8-4d0d-bc72-e4a8b620eb10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c1289b015854c6bb6aee8fed6b807db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:38:04.382518 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef77579a-5ac8-4d0d-bc72-e4a8b620eb10 service neutron] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:38:04.382795 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef77579a-5ac8-4d0d-bc72-e4a8b620eb10 service neutron] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:38:04.383066 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef77579a-5ac8-4d0d-bc72-e4a8b620eb10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:38:04.384785 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-ef77579a-5ac8-4d0d-bc72-e4a8b620eb10 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:38:04.394229 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef77579a-5ac8-4d0d-bc72-e4a8b620eb10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:38:04.395651 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef77579a-5ac8-4d0d-bc72-e4a8b620eb10 service neutron] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:38:04.403551 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1385/2808] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:38:04 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:38:14.399971 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=6 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:38:14.535168 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032a183d-68bb-41f8-8304-a6b2d4927f47 service nova] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:38:14.536803 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-032a183d-68bb-41f8-8304-a6b2d4927f47 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:38:14.550811 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032a183d-68bb-41f8-8304-a6b2d4927f47 service nova] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:38:14.555770 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4543038b-5121-4f9a-b34e-db84d2e76533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:38:14.556445 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4543038b-5121-4f9a-b34e-db84d2e76533 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:38:14.556731 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4543038b-5121-4f9a-b34e-db84d2e76533 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:38:14.557014 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4543038b-5121-4f9a-b34e-db84d2e76533 admin admin] PATH_INFO: `/v3/users/ec793e182dfa4ae3bd8a57c41f1e0077` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:38:14.559514 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4543038b-5121-4f9a-b34e-db84d2e76533 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec793e182dfa4ae3bd8a57c41f1e0077)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:38:14.562779 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4543038b-5121-4f9a-b34e-db84d2e76533 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:38:14.613888 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-4543038b-5121-4f9a-b34e-db84d2e76533 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec793e182dfa4ae3bd8a57c41f1e0077'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:38:14.621686 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-4543038b-5121-4f9a-b34e-db84d2e76533 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec793e182dfa4ae3bd8a57c41f1e0077'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:38:14.622413 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-4543038b-5121-4f9a-b34e-db84d2e76533 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec793e182dfa4ae3bd8a57c41f1e0077'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:38:14.623116 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-4543038b-5121-4f9a-b34e-db84d2e76533 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec793e182dfa4ae3bd8a57c41f1e0077'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:38:14.631028 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-4543038b-5121-4f9a-b34e-db84d2e76533 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec793e182dfa4ae3bd8a57c41f1e0077'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:38:14.651170 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1424/2809] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 19 10:38:14 2022] DELETE /identity/v3/users/ec793e182dfa4ae3bd8a57c41f1e0077 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:38:14.837042 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef77579a-5ac8-4d0d-bc72-e4a8b620eb10 service neutron] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:38:14.850068 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef77579a-5ac8-4d0d-bc72-e4a8b620eb10 service neutron] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:38:14.912272 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bceb9ce-8735-4eac-8817-c16ce1666979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:38:14.912580 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bceb9ce-8735-4eac-8817-c16ce1666979 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:38:14.912912 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bceb9ce-8735-4eac-8817-c16ce1666979 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:38:14.913187 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bceb9ce-8735-4eac-8817-c16ce1666979 admin admin] PATH_INFO: `/v3/projects/87e5518341d2410393c9f7d34ac8dcc7` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:38:14.914353 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bceb9ce-8735-4eac-8817-c16ce1666979 admin admin] RBAC: Authorizing `identity:delete_project(project_id=87e5518341d2410393c9f7d34ac8dcc7)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:38:14.916359 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bceb9ce-8735-4eac-8817-c16ce1666979 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:38:14.963638 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-5bceb9ce-8735-4eac-8817-c16ce1666979 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87e5518341d2410393c9f7d34ac8dcc7', 'request_id': 'req-5bceb9ce-8735-4eac-8817-c16ce1666979'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:38:14.970089 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-5bceb9ce-8735-4eac-8817-c16ce1666979 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87e5518341d2410393c9f7d34ac8dcc7', 'request_id': 'req-5bceb9ce-8735-4eac-8817-c16ce1666979'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:38:14.978197 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-5bceb9ce-8735-4eac-8817-c16ce1666979 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87e5518341d2410393c9f7d34ac8dcc7', 'request_id': 'req-5bceb9ce-8735-4eac-8817-c16ce1666979'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:38:14.989556 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-5bceb9ce-8735-4eac-8817-c16ce1666979 admin admin] The token cache is being invalidate because project 87e5518341d2410393c9f7d34ac8dcc7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 10:38:14.989845 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-5bceb9ce-8735-4eac-8817-c16ce1666979 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:38:14.990480 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-5bceb9ce-8735-4eac-8817-c16ce1666979 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:38:14.991967 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1386/2810] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 19 10:38:14 2022] DELETE /identity/v3/projects/87e5518341d2410393c9f7d34ac8dcc7 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:38:24.647418 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=29,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:38:24.986422 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=51,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:38:39.124882 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4543038b-5121-4f9a-b34e-db84d2e76533 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:38:39.126856 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-4543038b-5121-4f9a-b34e-db84d2e76533 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:38:39.216523 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4543038b-5121-4f9a-b34e-db84d2e76533 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:38:39.216887 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1461d132-ba4e-44ae-a397-a20a10ba9148 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:38:39.217336 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1461d132-ba4e-44ae-a397-a20a10ba9148 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:38:39.217636 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1461d132-ba4e-44ae-a397-a20a10ba9148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:38:39.271019 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-1461d132-ba4e-44ae-a397-a20a10ba9148 None None] MFA Rules not processed for user `e4d1160b71a84e2fa44a8ca6edf1846e`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:38:39.272435 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-1461d132-ba4e-44ae-a397-a20a10ba9148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:38:39.282035 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8399ea39-dc2d-4d2f-943e-b0ee40d09149 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15c70bfb085a44e9b84942b480ff22f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:38:39.282751 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8399ea39-dc2d-4d2f-943e-b0ee40d09149 service nova] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:38:39.283033 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8399ea39-dc2d-4d2f-943e-b0ee40d09149 service nova] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:38:39.283306 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8399ea39-dc2d-4d2f-943e-b0ee40d09149 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:38:39.285054 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-8399ea39-dc2d-4d2f-943e-b0ee40d09149 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:38:39.298053 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8399ea39-dc2d-4d2f-943e-b0ee40d09149 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:38:39.300053 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8399ea39-dc2d-4d2f-943e-b0ee40d09149 service nova] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:38:39.311969 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1425/2811] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:38:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:38:39.341206 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1387/2812] 10.222.0.66 () {58 vars in 1009 bytes} [Mon Sep 19 10:38:39 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:38:39.389018 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8399ea39-dc2d-4d2f-943e-b0ee40d09149 service nova] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:38:39.390430 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-8399ea39-dc2d-4d2f-943e-b0ee40d09149 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:38:39.481802 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8399ea39-dc2d-4d2f-943e-b0ee40d09149 service nova] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:38:39.486922 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e4f6b7-660c-44b0-b2f7-25f19eb97918 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6677354e36614c9fb3d03413749be5ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:38:39.487532 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e4f6b7-660c-44b0-b2f7-25f19eb97918 service swift] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:38:39.487816 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e4f6b7-660c-44b0-b2f7-25f19eb97918 service swift] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:38:39.488088 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e4f6b7-660c-44b0-b2f7-25f19eb97918 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:38:39.493252 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:38:39.498126 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e4f6b7-660c-44b0-b2f7-25f19eb97918 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:38:39.499704 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e4f6b7-660c-44b0-b2f7-25f19eb97918 service swift] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:38:39.508868 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1426/2813] 10.222.0.66 () {60 vars in 1384 bytes} [Mon Sep 19 10:38:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 19 10:38:49.338111 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=40 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:38:49.505274 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=3 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:38:54.091352 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0daab4-2df7-4314-9bc5-877f0716cc89 None None] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:38:54.091904 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0daab4-2df7-4314-9bc5-877f0716cc89 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:38:54.091904 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0daab4-2df7-4314-9bc5-877f0716cc89 None None] PATH_INFO: `/` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:38:54.093299 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1388/2814] 10.222.0.66 () {54 vars in 921 bytes} [Mon Sep 19 10:38:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:38:54.098170 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79a1660-cc48-48b7-a217-fb963e80d1c1 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:38:54.098617 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79a1660-cc48-48b7-a217-fb963e80d1c1 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:38:54.098725 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79a1660-cc48-48b7-a217-fb963e80d1c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:38:54.139780 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-d79a1660-cc48-48b7-a217-fb963e80d1c1 None None] MFA Rules not processed for user `15c70bfb085a44e9b84942b480ff22f1`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:38:54.140938 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-d79a1660-cc48-48b7-a217-fb963e80d1c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:38:54.150418 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1427/2815] 10.222.0.66 () {58 vars in 1018 bytes} [Mon Sep 19 10:38:54 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 10:38:54.162853 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0daab4-2df7-4314-9bc5-877f0716cc89 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:38:54.164586 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-3d0daab4-2df7-4314-9bc5-877f0716cc89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:38:54.247705 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0daab4-2df7-4314-9bc5-877f0716cc89 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:38:54.251395 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2544f0-1017-410d-b1f6-dda4fc8b69e7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f95c0d9f2414f3ca2fa2d1546d47f1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:38:54.251998 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2544f0-1017-410d-b1f6-dda4fc8b69e7 service glance] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:38:54.252384 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2544f0-1017-410d-b1f6-dda4fc8b69e7 service glance] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:38:54.252569 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2544f0-1017-410d-b1f6-dda4fc8b69e7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:38:54.262535 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2544f0-1017-410d-b1f6-dda4fc8b69e7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:38:54.263981 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2544f0-1017-410d-b1f6-dda4fc8b69e7 service glance] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:38:54.274919 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1389/2816] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:38:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:38:54.346655 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79a1660-cc48-48b7-a217-fb963e80d1c1 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:38:54.348092 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-d79a1660-cc48-48b7-a217-fb963e80d1c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:38:54.403693 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79a1660-cc48-48b7-a217-fb963e80d1c1 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:38:54.408385 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae0c6a4-88bf-44bd-9767-2971f6ed325b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c1289b015854c6bb6aee8fed6b807db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:38:54.408999 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae0c6a4-88bf-44bd-9767-2971f6ed325b service neutron] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:38:54.409276 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae0c6a4-88bf-44bd-9767-2971f6ed325b service neutron] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:38:54.409550 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae0c6a4-88bf-44bd-9767-2971f6ed325b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:38:54.411321 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-2ae0c6a4-88bf-44bd-9767-2971f6ed325b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:38:54.421328 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae0c6a4-88bf-44bd-9767-2971f6ed325b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:38:54.423382 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae0c6a4-88bf-44bd-9767-2971f6ed325b service neutron] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:38:54.431545 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1428/2817] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:38:54 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:38:54.505454 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2544f0-1017-410d-b1f6-dda4fc8b69e7 service glance] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:38:54.514756 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2544f0-1017-410d-b1f6-dda4fc8b69e7 service glance] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:38:54.518807 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ebd157-ef33-45ea-84e2-f5495f4ee558 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c1289b015854c6bb6aee8fed6b807db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:38:54.519398 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ebd157-ef33-45ea-84e2-f5495f4ee558 service neutron] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:38:54.519678 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ebd157-ef33-45ea-84e2-f5495f4ee558 service neutron] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:38:54.519951 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ebd157-ef33-45ea-84e2-f5495f4ee558 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:38:54.521731 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-e9ebd157-ef33-45ea-84e2-f5495f4ee558 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:38:54.535404 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ebd157-ef33-45ea-84e2-f5495f4ee558 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:38:54.536905 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ebd157-ef33-45ea-84e2-f5495f4ee558 service neutron] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:38:54.551196 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1390/2818] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:38:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:38:54.611552 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae0c6a4-88bf-44bd-9767-2971f6ed325b service neutron] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:38:54.613010 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-2ae0c6a4-88bf-44bd-9767-2971f6ed325b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:38:54.682241 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae0c6a4-88bf-44bd-9767-2971f6ed325b service neutron] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:38:54.687472 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c29274f-04a1-42f7-9a7e-68cd37a903ad service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46b78120cac64f09bd0f4cdc42424163', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:38:54.688090 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c29274f-04a1-42f7-9a7e-68cd37a903ad service placement] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:38:54.688405 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c29274f-04a1-42f7-9a7e-68cd37a903ad service placement] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:38:54.688679 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c29274f-04a1-42f7-9a7e-68cd37a903ad service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:38:54.690426 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-7c29274f-04a1-42f7-9a7e-68cd37a903ad service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:38:54.702369 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c29274f-04a1-42f7-9a7e-68cd37a903ad service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:38:54.704476 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c29274f-04a1-42f7-9a7e-68cd37a903ad service placement] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:38:54.714486 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1429/2819] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:38:54 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:38:56.472449 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d15a3f-55ec-4f10-873d-1c34d4e7c433 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:38:56.472969 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d15a3f-55ec-4f10-873d-1c34d4e7c433 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:38:56.473083 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d15a3f-55ec-4f10-873d-1c34d4e7c433 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:38:56.492625 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-33d15a3f-55ec-4f10-873d-1c34d4e7c433 None None] MFA Rules not processed for user `e4d1160b71a84e2fa44a8ca6edf1846e`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:38:56.493767 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-33d15a3f-55ec-4f10-873d-1c34d4e7c433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:38:56.501450 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1391/2820] 10.222.0.66 () {58 vars in 1009 bytes} [Mon Sep 19 10:38:56 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:38:56.514042 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c29274f-04a1-42f7-9a7e-68cd37a903ad service placement] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:38:56.526822 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c29274f-04a1-42f7-9a7e-68cd37a903ad service placement] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:38:56.532062 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d084681d-f245-491b-b07c-c8c9d89363b5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6677354e36614c9fb3d03413749be5ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:38:56.532462 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d084681d-f245-491b-b07c-c8c9d89363b5 service swift] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:38:56.532768 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d084681d-f245-491b-b07c-c8c9d89363b5 service swift] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:38:56.533037 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d084681d-f245-491b-b07c-c8c9d89363b5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:38:56.541442 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d084681d-f245-491b-b07c-c8c9d89363b5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:38:56.543254 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d084681d-f245-491b-b07c-c8c9d89363b5 service swift] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:38:56.552222 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1430/2821] 10.222.0.66 () {60 vars in 1384 bytes} [Mon Sep 19 10:38:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 19 10:38:57.615763 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d15a3f-55ec-4f10-873d-1c34d4e7c433 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:38:57.617269 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-33d15a3f-55ec-4f10-873d-1c34d4e7c433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:38:57.632692 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d15a3f-55ec-4f10-873d-1c34d4e7c433 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:38:57.638040 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c27123e-5cfb-432b-b1a3-d628625e4458 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15c70bfb085a44e9b84942b480ff22f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:38:57.638658 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c27123e-5cfb-432b-b1a3-d628625e4458 service nova] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:38:57.638938 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c27123e-5cfb-432b-b1a3-d628625e4458 service nova] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:38:57.639214 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c27123e-5cfb-432b-b1a3-d628625e4458 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:38:57.641428 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-4c27123e-5cfb-432b-b1a3-d628625e4458 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:38:57.717843 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c27123e-5cfb-432b-b1a3-d628625e4458 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:38:57.720129 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c27123e-5cfb-432b-b1a3-d628625e4458 service nova] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:38:57.731377 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1392/2822] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:38:57 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:39:06.549105 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=73 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:39:07.726211 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=72 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:39:12.954152 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06946228-1d6c-43c3-8872-53fe0a1ae5b9 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:39:12.954628 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06946228-1d6c-43c3-8872-53fe0a1ae5b9 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:39:12.954747 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06946228-1d6c-43c3-8872-53fe0a1ae5b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:39:12.974449 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-06946228-1d6c-43c3-8872-53fe0a1ae5b9 None None] MFA Rules not processed for user `e4d1160b71a84e2fa44a8ca6edf1846e`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:39:12.975666 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-06946228-1d6c-43c3-8872-53fe0a1ae5b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:39:12.982797 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1431/2823] 10.222.0.66 () {58 vars in 967 bytes} [Mon Sep 19 10:39:12 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:39:12.995677 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c27123e-5cfb-432b-b1a3-d628625e4458 service nova] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:39:13.007092 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c27123e-5cfb-432b-b1a3-d628625e4458 service nova] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:39:13.011834 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf5b2d6-534d-4ed4-98fc-d85a090855e8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6677354e36614c9fb3d03413749be5ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:39:13.012496 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf5b2d6-534d-4ed4-98fc-d85a090855e8 service swift] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:39:13.012778 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf5b2d6-534d-4ed4-98fc-d85a090855e8 service swift] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:39:13.013047 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf5b2d6-534d-4ed4-98fc-d85a090855e8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:39:13.021944 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf5b2d6-534d-4ed4-98fc-d85a090855e8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:39:13.023533 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf5b2d6-534d-4ed4-98fc-d85a090855e8 service swift] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:39:13.031739 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1393/2824] 10.222.0.66 () {60 vars in 1384 bytes} [Mon Sep 19 10:39:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 19 10:39:22.968536 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=3 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:39:23.028427 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=6 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:39:55.825378 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06946228-1d6c-43c3-8872-53fe0a1ae5b9 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:39:55.840739 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06946228-1d6c-43c3-8872-53fe0a1ae5b9 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:39:55.848586 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0aa82fb-76dc-40c1-9457-c283d6d7f658 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15c70bfb085a44e9b84942b480ff22f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:39:55.849271 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aa82fb-76dc-40c1-9457-c283d6d7f658 service nova] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:39:55.849592 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aa82fb-76dc-40c1-9457-c283d6d7f658 service nova] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:39:55.849872 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aa82fb-76dc-40c1-9457-c283d6d7f658 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:39:55.851732 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-c0aa82fb-76dc-40c1-9457-c283d6d7f658 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:39:55.866894 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0aa82fb-76dc-40c1-9457-c283d6d7f658 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:39:55.868593 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0aa82fb-76dc-40c1-9457-c283d6d7f658 service nova] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:39:55.884897 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1432/2825] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:39:55 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:40:01.028829 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf5b2d6-534d-4ed4-98fc-d85a090855e8 service swift] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:40:01.030301 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-adf5b2d6-534d-4ed4-98fc-d85a090855e8 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:40:01.042508 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf5b2d6-534d-4ed4-98fc-d85a090855e8 service swift] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:40:01.046002 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db08015-1ac5-43b1-b287-2b5691359bff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c1289b015854c6bb6aee8fed6b807db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:40:01.046589 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db08015-1ac5-43b1-b287-2b5691359bff service neutron] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:40:01.046861 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db08015-1ac5-43b1-b287-2b5691359bff service neutron] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:40:01.047127 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db08015-1ac5-43b1-b287-2b5691359bff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:40:01.048886 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-9db08015-1ac5-43b1-b287-2b5691359bff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:40:01.109426 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db08015-1ac5-43b1-b287-2b5691359bff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:40:01.110857 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db08015-1ac5-43b1-b287-2b5691359bff service neutron] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:40:01.120480 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1394/2826] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:40:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:40:03.949697 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0aa82fb-76dc-40c1-9457-c283d6d7f658 service nova] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:40:03.962344 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0aa82fb-76dc-40c1-9457-c283d6d7f658 service nova] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:40:03.967562 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12bb5de-3a44-430b-bb4f-9567dfade967 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46b78120cac64f09bd0f4cdc42424163', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:40:03.968341 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12bb5de-3a44-430b-bb4f-9567dfade967 service placement] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:40:03.968680 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12bb5de-3a44-430b-bb4f-9567dfade967 service placement] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:40:03.969024 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12bb5de-3a44-430b-bb4f-9567dfade967 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:40:03.970911 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-a12bb5de-3a44-430b-bb4f-9567dfade967 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:40:03.982863 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12bb5de-3a44-430b-bb4f-9567dfade967 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:40:03.984594 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12bb5de-3a44-430b-bb4f-9567dfade967 service placement] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:40:03.998713 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1433/2827] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:40:03 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:40:04.009866 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db08015-1ac5-43b1-b287-2b5691359bff service neutron] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:40:04.012158 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-9db08015-1ac5-43b1-b287-2b5691359bff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:40:04.029535 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db08015-1ac5-43b1-b287-2b5691359bff service neutron] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:40:04.034574 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66e475a-adee-4deb-9a6d-76aca5dabb4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:40:04.035494 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66e475a-adee-4deb-9a6d-76aca5dabb4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:40:04.035688 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66e475a-adee-4deb-9a6d-76aca5dabb4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:40:04.035897 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66e475a-adee-4deb-9a6d-76aca5dabb4d admin admin] PATH_INFO: `/v3/users/32c1b3f5141e43a3ae0af5ca2317ad3f` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:40:04.037164 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66e475a-adee-4deb-9a6d-76aca5dabb4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=32c1b3f5141e43a3ae0af5ca2317ad3f)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:40:04.039076 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66e475a-adee-4deb-9a6d-76aca5dabb4d admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:40:04.089758 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-a66e475a-adee-4deb-9a6d-76aca5dabb4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32c1b3f5141e43a3ae0af5ca2317ad3f'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:40:04.098073 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-a66e475a-adee-4deb-9a6d-76aca5dabb4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32c1b3f5141e43a3ae0af5ca2317ad3f'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:40:04.098714 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-a66e475a-adee-4deb-9a6d-76aca5dabb4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32c1b3f5141e43a3ae0af5ca2317ad3f'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:40:04.099320 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-a66e475a-adee-4deb-9a6d-76aca5dabb4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32c1b3f5141e43a3ae0af5ca2317ad3f'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:40:04.107585 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-a66e475a-adee-4deb-9a6d-76aca5dabb4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32c1b3f5141e43a3ae0af5ca2317ad3f'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:40:04.126084 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1395/2828] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 19 10:40:04 2022] DELETE /identity/v3/users/32c1b3f5141e43a3ae0af5ca2317ad3f => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:40:04.300552 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12bb5de-3a44-430b-bb4f-9567dfade967 service placement] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:40:04.318514 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12bb5de-3a44-430b-bb4f-9567dfade967 service placement] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:40:04.374886 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4b3849-4664-46ae-8b6a-0e20de151386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:40:04.375521 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4b3849-4664-46ae-8b6a-0e20de151386 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:40:04.375802 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4b3849-4664-46ae-8b6a-0e20de151386 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:40:04.376137 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4b3849-4664-46ae-8b6a-0e20de151386 admin admin] PATH_INFO: `/v3/projects/9fd979da6f7749779f7f0d029da53e5a` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:40:04.377819 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4b3849-4664-46ae-8b6a-0e20de151386 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9fd979da6f7749779f7f0d029da53e5a)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:40:04.379725 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4b3849-4664-46ae-8b6a-0e20de151386 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:40:04.425137 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-0f4b3849-4664-46ae-8b6a-0e20de151386 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9fd979da6f7749779f7f0d029da53e5a', 'request_id': 'req-0f4b3849-4664-46ae-8b6a-0e20de151386'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:40:04.431354 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-0f4b3849-4664-46ae-8b6a-0e20de151386 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9fd979da6f7749779f7f0d029da53e5a', 'request_id': 'req-0f4b3849-4664-46ae-8b6a-0e20de151386'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:40:04.439210 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-0f4b3849-4664-46ae-8b6a-0e20de151386 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9fd979da6f7749779f7f0d029da53e5a', 'request_id': 'req-0f4b3849-4664-46ae-8b6a-0e20de151386'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:40:04.450615 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-0f4b3849-4664-46ae-8b6a-0e20de151386 admin admin] The token cache is being invalidate because project 9fd979da6f7749779f7f0d029da53e5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 10:40:04.450901 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-0f4b3849-4664-46ae-8b6a-0e20de151386 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:40:04.451556 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-0f4b3849-4664-46ae-8b6a-0e20de151386 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:40:04.454064 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1434/2829] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 19 10:40:04 2022] DELETE /identity/v3/projects/9fd979da6f7749779f7f0d029da53e5a => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:40:04.459654 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a834ca0a-d496-4ac7-8dc7-408d212055b8 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:40:04.459945 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a834ca0a-d496-4ac7-8dc7-408d212055b8 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:40:04.460266 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a834ca0a-d496-4ac7-8dc7-408d212055b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:40:04.480891 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-a834ca0a-d496-4ac7-8dc7-408d212055b8 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:40:04.482107 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-a834ca0a-d496-4ac7-8dc7-408d212055b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:40:04.541805 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1396/2830] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:40:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:40:04.550064 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbc4686-d883-4b0a-b7e2-cbb9b5063b05 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:40:04.550311 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbc4686-d883-4b0a-b7e2-cbb9b5063b05 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:40:04.550583 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbc4686-d883-4b0a-b7e2-cbb9b5063b05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:40:04.572208 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-1dbc4686-d883-4b0a-b7e2-cbb9b5063b05 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:40:04.573729 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-1dbc4686-d883-4b0a-b7e2-cbb9b5063b05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:40:04.582854 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1435/2831] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:40:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:40:04.587472 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a834ca0a-d496-4ac7-8dc7-408d212055b8 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:40:04.597851 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a834ca0a-d496-4ac7-8dc7-408d212055b8 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:40:04.602788 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce4d465-8a01-4a5c-bd96-5402d67b62fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:40:04.603394 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce4d465-8a01-4a5c-bd96-5402d67b62fe admin admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:40:04.603679 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce4d465-8a01-4a5c-bd96-5402d67b62fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:40:04.603959 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce4d465-8a01-4a5c-bd96-5402d67b62fe admin admin] PATH_INFO: `/v3/domains` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:40:04.604646 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce4d465-8a01-4a5c-bd96-5402d67b62fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:40:04.604949 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce4d465-8a01-4a5c-bd96-5402d67b62fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:40:04.606563 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce4d465-8a01-4a5c-bd96-5402d67b62fe admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:40:04.608076 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:40:04.620660 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1397/2832] 10.222.0.66 () {58 vars in 1153 bytes} [Mon Sep 19 10:40:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:40:04.625804 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbc4686-d883-4b0a-b7e2-cbb9b5063b05 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:40:04.637445 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbc4686-d883-4b0a-b7e2-cbb9b5063b05 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:40:04.642532 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21058d7d-4872-4ed0-9922-7f0e045dd65a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:40:04.643771 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21058d7d-4872-4ed0-9922-7f0e045dd65a admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:40:04.644112 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21058d7d-4872-4ed0-9922-7f0e045dd65a admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:40:04.644458 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21058d7d-4872-4ed0-9922-7f0e045dd65a admin admin] PATH_INFO: `/v3/projects` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:40:04.645133 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21058d7d-4872-4ed0-9922-7f0e045dd65a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:40:04.647617 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21058d7d-4872-4ed0-9922-7f0e045dd65a admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:40:04.685841 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1436/2833] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 19 10:40:04 2022] POST /identity/v3/projects => generated 403 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:40:04.690493 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce4d465-8a01-4a5c-bd96-5402d67b62fe admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:40:04.700866 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce4d465-8a01-4a5c-bd96-5402d67b62fe admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:40:04.759412 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94caf7df-1c6c-44e5-b4ae-146d628c186d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:40:04.760019 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94caf7df-1c6c-44e5-b4ae-146d628c186d admin admin] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:40:04.760340 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94caf7df-1c6c-44e5-b4ae-146d628c186d admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:40:04.760619 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94caf7df-1c6c-44e5-b4ae-146d628c186d admin admin] PATH_INFO: `/v3/users` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:40:04.761242 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94caf7df-1c6c-44e5-b4ae-146d628c186d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:40:04.763162 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94caf7df-1c6c-44e5-b4ae-146d628c186d admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:40:04.785050 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1398/2834] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 19 10:40:04 2022] POST /identity/v3/users => generated 302 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:40:04.790228 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21058d7d-4872-4ed0-9922-7f0e045dd65a admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:40:04.802382 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21058d7d-4872-4ed0-9922-7f0e045dd65a admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:40:04.807155 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e415ef61-88d4-4417-8c3b-6a699acfdcf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:40:04.807766 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e415ef61-88d4-4417-8c3b-6a699acfdcf6 admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:40:04.808043 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e415ef61-88d4-4417-8c3b-6a699acfdcf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:40:04.808355 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e415ef61-88d4-4417-8c3b-6a699acfdcf6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:40:04.808992 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e415ef61-88d4-4417-8c3b-6a699acfdcf6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:40:04.810595 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e415ef61-88d4-4417-8c3b-6a699acfdcf6 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:40:04.821226 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1437/2835] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:40:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 10:40:04.825427 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94caf7df-1c6c-44e5-b4ae-146d628c186d admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:40:04.836320 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94caf7df-1c6c-44e5-b4ae-146d628c186d admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:40:04.840990 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffb83e1-de83-4581-bbdb-f73824cfa4a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:40:04.841593 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffb83e1-de83-4581-bbdb-f73824cfa4a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:40:04.841874 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffb83e1-de83-4581-bbdb-f73824cfa4a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:40:04.842153 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffb83e1-de83-4581-bbdb-f73824cfa4a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:40:04.842844 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffb83e1-de83-4581-bbdb-f73824cfa4a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:40:04.844510 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffb83e1-de83-4581-bbdb-f73824cfa4a8 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:40:04.855235 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1399/2836] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:40:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 10:40:04.859422 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e415ef61-88d4-4417-8c3b-6a699acfdcf6 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:40:04.869676 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e415ef61-88d4-4417-8c3b-6a699acfdcf6 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:40:04.874302 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e1e53b-a425-4c79-8bac-c9d4be63fa0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:40:04.874950 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e1e53b-a425-4c79-8bac-c9d4be63fa0b admin admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:40:04.875228 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e1e53b-a425-4c79-8bac-c9d4be63fa0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:40:04.875503 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e1e53b-a425-4c79-8bac-c9d4be63fa0b admin admin] PATH_INFO: `/v3/projects/aacc53a518f14cffa39423401243d0dc/users/d584eacd0ef9469cbaa7a50bbf061c1c/roles/cd5b42ed3b754b58817a62bbe74651b4` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:40:04.888681 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:40:04.892331 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e1e53b-a425-4c79-8bac-c9d4be63fa0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=aacc53a518f14cffa39423401243d0dc, user_id=d584eacd0ef9469cbaa7a50bbf061c1c, role_id=cd5b42ed3b754b58817a62bbe74651b4)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:40:04.896418 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e1e53b-a425-4c79-8bac-c9d4be63fa0b admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:40:04.910145 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1438/2837] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 19 10:40:04 2022] PUT /identity/v3/projects/aacc53a518f14cffa39423401243d0dc/users/d584eacd0ef9469cbaa7a50bbf061c1c/roles/cd5b42ed3b754b58817a62bbe74651b4 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:40:04.915364 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f357b1b-2e45-4328-a351-54ebc96aa8a7 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:40:04.915655 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f357b1b-2e45-4328-a351-54ebc96aa8a7 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:40:04.915936 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f357b1b-2e45-4328-a351-54ebc96aa8a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:40:04.935532 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-8f357b1b-2e45-4328-a351-54ebc96aa8a7 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:40:04.936788 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-8f357b1b-2e45-4328-a351-54ebc96aa8a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:40:04.996280 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1400/2838] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:40:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 10:40:05.006024 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e1e53b-a425-4c79-8bac-c9d4be63fa0b admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:40:05.007940 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-e9e1e53b-a425-4c79-8bac-c9d4be63fa0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:40:05.065787 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e1e53b-a425-4c79-8bac-c9d4be63fa0b admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:40:05.069303 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1599c46d-fd19-40af-bc1b-a43553d1ec05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c1289b015854c6bb6aee8fed6b807db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:40:05.069908 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1599c46d-fd19-40af-bc1b-a43553d1ec05 service neutron] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:40:05.070190 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1599c46d-fd19-40af-bc1b-a43553d1ec05 service neutron] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:40:05.070467 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1599c46d-fd19-40af-bc1b-a43553d1ec05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:40:05.079388 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1599c46d-fd19-40af-bc1b-a43553d1ec05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:40:05.081323 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1599c46d-fd19-40af-bc1b-a43553d1ec05 service neutron] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:40:05.093157 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1439/2839] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:40:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:40:05.725099 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12574201-5f96-4828-9269-739f0dc92429 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:40:05.725634 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12574201-5f96-4828-9269-739f0dc92429 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:40:05.725754 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12574201-5f96-4828-9269-739f0dc92429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:40:05.756498 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-12574201-5f96-4828-9269-739f0dc92429 None None] MFA Rules not processed for user `d584eacd0ef9469cbaa7a50bbf061c1c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:40:05.758041 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-12574201-5f96-4828-9269-739f0dc92429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:40:05.826904 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1401/2840] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:40:05 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:40:05.831670 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1599c46d-fd19-40af-bc1b-a43553d1ec05 service neutron] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:40:05.842547 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1599c46d-fd19-40af-bc1b-a43553d1ec05 service neutron] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:40:05.846772 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a98eb9-f106-410f-8108-288aff6fce12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:40:05.847372 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a98eb9-f106-410f-8108-288aff6fce12 admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:40:05.847665 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a98eb9-f106-410f-8108-288aff6fce12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:40:05.847918 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a98eb9-f106-410f-8108-288aff6fce12 admin admin] PATH_INFO: `/v3/projects` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:40:05.848580 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a98eb9-f106-410f-8108-288aff6fce12 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:40:05.850526 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a98eb9-f106-410f-8108-288aff6fce12 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:40:05.882759 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1440/2841] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 19 10:40:05 2022] POST /identity/v3/projects => generated 403 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:40:05.884415 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12574201-5f96-4828-9269-739f0dc92429 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:40:05.891601 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:40:05.898525 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12574201-5f96-4828-9269-739f0dc92429 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:40:05.962501 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc1182d-8df7-4c69-83fc-e4cf5598f9d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:40:05.963114 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc1182d-8df7-4c69-83fc-e4cf5598f9d3 admin admin] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:40:05.963426 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc1182d-8df7-4c69-83fc-e4cf5598f9d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:40:05.963705 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc1182d-8df7-4c69-83fc-e4cf5598f9d3 admin admin] PATH_INFO: `/v3/users` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:40:05.964366 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc1182d-8df7-4c69-83fc-e4cf5598f9d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:40:05.966337 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc1182d-8df7-4c69-83fc-e4cf5598f9d3 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:40:05.988981 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1402/2842] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 19 10:40:05 2022] POST /identity/v3/users => generated 308 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:40:05.993094 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a98eb9-f106-410f-8108-288aff6fce12 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:40:06.003583 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a98eb9-f106-410f-8108-288aff6fce12 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:40:06.008139 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d376fb-25ea-4461-9905-3a75557f4b28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:40:06.008760 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d376fb-25ea-4461-9905-3a75557f4b28 admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:40:06.009025 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d376fb-25ea-4461-9905-3a75557f4b28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:40:06.009294 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d376fb-25ea-4461-9905-3a75557f4b28 admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:40:06.009924 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d376fb-25ea-4461-9905-3a75557f4b28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:40:06.011502 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d376fb-25ea-4461-9905-3a75557f4b28 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:40:06.022751 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1441/2843] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:40:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 10:40:06.027198 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc1182d-8df7-4c69-83fc-e4cf5598f9d3 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:40:06.038358 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc1182d-8df7-4c69-83fc-e4cf5598f9d3 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:40:06.045047 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104e8306-2685-4767-81eb-9275743f03df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:40:06.045704 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104e8306-2685-4767-81eb-9275743f03df admin admin] REQUEST_METHOD: `PUT` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:40:06.045986 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104e8306-2685-4767-81eb-9275743f03df admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:40:06.046260 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104e8306-2685-4767-81eb-9275743f03df admin admin] PATH_INFO: `/v3/projects/8235c9d22b13434bb337cd6fd88f1db1/users/3e03f1302a95484ba5159ab0b04b5d13/roles/5c8b89fae4fa45bd944cbeaf442136e1` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:40:06.064775 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104e8306-2685-4767-81eb-9275743f03df admin admin] RBAC: Authorizing `identity:create_grant(project_id=8235c9d22b13434bb337cd6fd88f1db1, user_id=3e03f1302a95484ba5159ab0b04b5d13, role_id=5c8b89fae4fa45bd944cbeaf442136e1)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:40:06.067541 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104e8306-2685-4767-81eb-9275743f03df admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:40:06.081527 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1403/2844] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 19 10:40:06 2022] PUT /identity/v3/projects/8235c9d22b13434bb337cd6fd88f1db1/users/3e03f1302a95484ba5159ab0b04b5d13/roles/5c8b89fae4fa45bd944cbeaf442136e1 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:40:06.085705 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d376fb-25ea-4461-9905-3a75557f4b28 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:40:06.095919 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d376fb-25ea-4461-9905-3a75557f4b28 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:40:06.154752 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc01d0a-de81-4bf2-80e8-7f868f7b8be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:40:06.155351 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc01d0a-de81-4bf2-80e8-7f868f7b8be0 admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:40:06.155650 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc01d0a-de81-4bf2-80e8-7f868f7b8be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:40:06.155902 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc01d0a-de81-4bf2-80e8-7f868f7b8be0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:40:06.156570 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc01d0a-de81-4bf2-80e8-7f868f7b8be0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:40:06.158154 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc01d0a-de81-4bf2-80e8-7f868f7b8be0 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:40:06.168389 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1442/2845] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:40:06 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 10:40:06.172528 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104e8306-2685-4767-81eb-9275743f03df admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:40:06.182992 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104e8306-2685-4767-81eb-9275743f03df admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:40:06.187581 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b482a6-55a5-4970-a3c5-1d9c16a04db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:40:06.188263 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b482a6-55a5-4970-a3c5-1d9c16a04db4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:40:06.188546 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b482a6-55a5-4970-a3c5-1d9c16a04db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:40:06.188837 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b482a6-55a5-4970-a3c5-1d9c16a04db4 admin admin] PATH_INFO: `/v3/projects/8235c9d22b13434bb337cd6fd88f1db1/users/3e03f1302a95484ba5159ab0b04b5d13/roles/5c8b89fae4fa45bd944cbeaf442136e1` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:40:06.191203 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b482a6-55a5-4970-a3c5-1d9c16a04db4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8235c9d22b13434bb337cd6fd88f1db1, user_id=3e03f1302a95484ba5159ab0b04b5d13, role_id=5c8b89fae4fa45bd944cbeaf442136e1)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:40:06.193871 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b482a6-55a5-4970-a3c5-1d9c16a04db4 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:40:06.203909 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1404/2846] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 19 10:40:06 2022] PUT /identity/v3/projects/8235c9d22b13434bb337cd6fd88f1db1/users/3e03f1302a95484ba5159ab0b04b5d13/roles/5c8b89fae4fa45bd944cbeaf442136e1 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:40:06.858461 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c847dc-442f-4502-bed0-88bb1066e4e0 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:40:06.858662 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c847dc-442f-4502-bed0-88bb1066e4e0 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:40:06.858943 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c847dc-442f-4502-bed0-88bb1066e4e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:40:06.889704 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-f8c847dc-442f-4502-bed0-88bb1066e4e0 None None] MFA Rules not processed for user `3e03f1302a95484ba5159ab0b04b5d13`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:40:06.891008 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-f8c847dc-442f-4502-bed0-88bb1066e4e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:40:06.938555 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:40:06.968266 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1443/2847] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:40:06 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:40:07.993205 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b482a6-55a5-4970-a3c5-1d9c16a04db4 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:40:08.058681 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b482a6-55a5-4970-a3c5-1d9c16a04db4 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:40:08.063286 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be8145d-e541-4a00-a8d4-5e989270082b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:40:08.063936 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be8145d-e541-4a00-a8d4-5e989270082b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:40:08.064298 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be8145d-e541-4a00-a8d4-5e989270082b admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:40:08.065203 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be8145d-e541-4a00-a8d4-5e989270082b admin admin] PATH_INFO: `/v3/users/d584eacd0ef9469cbaa7a50bbf061c1c` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:40:08.066446 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be8145d-e541-4a00-a8d4-5e989270082b admin admin] RBAC: Authorizing `identity:delete_user(user_id=d584eacd0ef9469cbaa7a50bbf061c1c)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:40:08.068682 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be8145d-e541-4a00-a8d4-5e989270082b admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:40:08.125997 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-1be8145d-e541-4a00-a8d4-5e989270082b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd584eacd0ef9469cbaa7a50bbf061c1c'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:40:08.133549 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-1be8145d-e541-4a00-a8d4-5e989270082b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd584eacd0ef9469cbaa7a50bbf061c1c'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:40:08.134165 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-1be8145d-e541-4a00-a8d4-5e989270082b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd584eacd0ef9469cbaa7a50bbf061c1c'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:40:08.134797 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-1be8145d-e541-4a00-a8d4-5e989270082b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd584eacd0ef9469cbaa7a50bbf061c1c'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:40:08.136834 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=86,keystone:INSERT=6,keystone:DELETE=8 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:40:08.144914 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-1be8145d-e541-4a00-a8d4-5e989270082b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd584eacd0ef9469cbaa7a50bbf061c1c'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:40:08.163057 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1405/2848] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 19 10:40:07 2022] DELETE /identity/v3/users/d584eacd0ef9469cbaa7a50bbf061c1c => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:40:08.333585 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c847dc-442f-4502-bed0-88bb1066e4e0 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:40:08.345220 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c847dc-442f-4502-bed0-88bb1066e4e0 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:40:08.403716 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98395e51-4a71-4810-af6e-5462389d2a71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:40:08.404396 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98395e51-4a71-4810-af6e-5462389d2a71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:40:08.404662 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98395e51-4a71-4810-af6e-5462389d2a71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:40:08.404933 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98395e51-4a71-4810-af6e-5462389d2a71 admin admin] PATH_INFO: `/v3/projects/aacc53a518f14cffa39423401243d0dc` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:40:08.406039 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98395e51-4a71-4810-af6e-5462389d2a71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aacc53a518f14cffa39423401243d0dc)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:40:08.408023 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98395e51-4a71-4810-af6e-5462389d2a71 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:40:08.454200 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-98395e51-4a71-4810-af6e-5462389d2a71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aacc53a518f14cffa39423401243d0dc', 'request_id': 'req-98395e51-4a71-4810-af6e-5462389d2a71'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:40:08.462421 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-98395e51-4a71-4810-af6e-5462389d2a71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aacc53a518f14cffa39423401243d0dc', 'request_id': 'req-98395e51-4a71-4810-af6e-5462389d2a71'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:40:08.468810 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-98395e51-4a71-4810-af6e-5462389d2a71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aacc53a518f14cffa39423401243d0dc', 'request_id': 'req-98395e51-4a71-4810-af6e-5462389d2a71'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:40:08.479195 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-98395e51-4a71-4810-af6e-5462389d2a71 admin admin] The token cache is being invalidate because project aacc53a518f14cffa39423401243d0dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 10:40:08.479482 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-98395e51-4a71-4810-af6e-5462389d2a71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:40:08.480101 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-98395e51-4a71-4810-af6e-5462389d2a71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:40:08.481927 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1444/2849] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 19 10:40:08 2022] DELETE /identity/v3/projects/aacc53a518f14cffa39423401243d0dc => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:40:08.486091 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be8145d-e541-4a00-a8d4-5e989270082b admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:40:08.487570 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-1be8145d-e541-4a00-a8d4-5e989270082b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:40:08.500852 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be8145d-e541-4a00-a8d4-5e989270082b admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:40:08.558878 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651bdbe7-b9e4-40e5-8bcb-2c20ed3139d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:40:08.559555 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651bdbe7-b9e4-40e5-8bcb-2c20ed3139d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:40:08.559835 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651bdbe7-b9e4-40e5-8bcb-2c20ed3139d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:40:08.560111 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651bdbe7-b9e4-40e5-8bcb-2c20ed3139d4 admin admin] PATH_INFO: `/v3/users/3e03f1302a95484ba5159ab0b04b5d13` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:40:08.561284 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651bdbe7-b9e4-40e5-8bcb-2c20ed3139d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e03f1302a95484ba5159ab0b04b5d13)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:40:08.563234 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651bdbe7-b9e4-40e5-8bcb-2c20ed3139d4 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:40:08.614093 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-651bdbe7-b9e4-40e5-8bcb-2c20ed3139d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e03f1302a95484ba5159ab0b04b5d13'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:40:08.622586 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-651bdbe7-b9e4-40e5-8bcb-2c20ed3139d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e03f1302a95484ba5159ab0b04b5d13'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:40:08.623270 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-651bdbe7-b9e4-40e5-8bcb-2c20ed3139d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e03f1302a95484ba5159ab0b04b5d13'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:40:08.623971 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-651bdbe7-b9e4-40e5-8bcb-2c20ed3139d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e03f1302a95484ba5159ab0b04b5d13'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:40:08.632367 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-651bdbe7-b9e4-40e5-8bcb-2c20ed3139d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e03f1302a95484ba5159ab0b04b5d13'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:40:08.650658 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1406/2850] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 19 10:40:08 2022] DELETE /identity/v3/users/3e03f1302a95484ba5159ab0b04b5d13 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:40:08.834503 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98395e51-4a71-4810-af6e-5462389d2a71 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:40:08.836518 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-98395e51-4a71-4810-af6e-5462389d2a71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:40:08.849893 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98395e51-4a71-4810-af6e-5462389d2a71 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:40:08.909530 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebc58b8-a7e0-4c04-82bf-708c777d524c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:40:08.910172 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebc58b8-a7e0-4c04-82bf-708c777d524c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:40:08.910454 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebc58b8-a7e0-4c04-82bf-708c777d524c admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:40:08.910730 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebc58b8-a7e0-4c04-82bf-708c777d524c admin admin] PATH_INFO: `/v3/projects/8235c9d22b13434bb337cd6fd88f1db1` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:40:08.911882 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebc58b8-a7e0-4c04-82bf-708c777d524c admin admin] RBAC: Authorizing `identity:delete_project(project_id=8235c9d22b13434bb337cd6fd88f1db1)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:40:08.913838 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebc58b8-a7e0-4c04-82bf-708c777d524c admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:40:08.930168 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:40:08.962521 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-8ebc58b8-a7e0-4c04-82bf-708c777d524c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8235c9d22b13434bb337cd6fd88f1db1', 'request_id': 'req-8ebc58b8-a7e0-4c04-82bf-708c777d524c'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:40:08.968855 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-8ebc58b8-a7e0-4c04-82bf-708c777d524c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8235c9d22b13434bb337cd6fd88f1db1', 'request_id': 'req-8ebc58b8-a7e0-4c04-82bf-708c777d524c'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:40:08.977059 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-8ebc58b8-a7e0-4c04-82bf-708c777d524c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8235c9d22b13434bb337cd6fd88f1db1', 'request_id': 'req-8ebc58b8-a7e0-4c04-82bf-708c777d524c'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:40:08.987929 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-8ebc58b8-a7e0-4c04-82bf-708c777d524c admin admin] The token cache is being invalidate because project 8235c9d22b13434bb337cd6fd88f1db1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 10:40:08.988241 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-8ebc58b8-a7e0-4c04-82bf-708c777d524c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:40:08.988878 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-8ebc58b8-a7e0-4c04-82bf-708c777d524c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:40:08.990395 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1445/2851] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 19 10:40:08 2022] DELETE /identity/v3/projects/8235c9d22b13434bb337cd6fd88f1db1 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 10:40:08.995400 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fae5830-2778-4912-bedf-211bb19a79c5 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:40:08.995862 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fae5830-2778-4912-bedf-211bb19a79c5 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:40:08.996142 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fae5830-2778-4912-bedf-211bb19a79c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:40:09.015660 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-3fae5830-2778-4912-bedf-211bb19a79c5 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:40:09.016909 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-3fae5830-2778-4912-bedf-211bb19a79c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:40:09.063513 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:40:09.077031 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1407/2852] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:40:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:40:09.086997 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82651c4d-bd2f-4fa6-9902-c4f845a9aaa9 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:40:09.087295 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82651c4d-bd2f-4fa6-9902-c4f845a9aaa9 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:40:09.087664 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82651c4d-bd2f-4fa6-9902-c4f845a9aaa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:40:09.109016 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-82651c4d-bd2f-4fa6-9902-c4f845a9aaa9 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:40:09.110232 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-82651c4d-bd2f-4fa6-9902-c4f845a9aaa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:40:09.118332 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1446/2853] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:40:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:40:09.122513 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fae5830-2778-4912-bedf-211bb19a79c5 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:40:09.132627 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fae5830-2778-4912-bedf-211bb19a79c5 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:40:09.137235 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec88109-cc68-413e-bb7c-7e65c6b01fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:40:09.137834 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec88109-cc68-413e-bb7c-7e65c6b01fa2 admin admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:40:09.138112 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec88109-cc68-413e-bb7c-7e65c6b01fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:40:09.138388 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec88109-cc68-413e-bb7c-7e65c6b01fa2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:40:09.139028 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec88109-cc68-413e-bb7c-7e65c6b01fa2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:40:09.139331 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec88109-cc68-413e-bb7c-7e65c6b01fa2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:40:09.140968 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec88109-cc68-413e-bb7c-7e65c6b01fa2 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:40:09.152846 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1408/2854] 10.222.0.66 () {58 vars in 1153 bytes} [Mon Sep 19 10:40:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:40:09.157083 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82651c4d-bd2f-4fa6-9902-c4f845a9aaa9 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:40:09.166278 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82651c4d-bd2f-4fa6-9902-c4f845a9aaa9 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:40:09.171164 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34bc86f-ff85-4595-aec3-256508770795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:40:09.171754 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34bc86f-ff85-4595-aec3-256508770795 admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:40:09.172032 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34bc86f-ff85-4595-aec3-256508770795 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:40:09.172340 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34bc86f-ff85-4595-aec3-256508770795 admin admin] PATH_INFO: `/v3/projects` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:40:09.172972 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34bc86f-ff85-4595-aec3-256508770795 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:40:09.174895 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34bc86f-ff85-4595-aec3-256508770795 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:40:09.201358 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1447/2855] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 19 10:40:09 2022] POST /identity/v3/projects => generated 365 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:40:09.206279 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec88109-cc68-413e-bb7c-7e65c6b01fa2 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:40:09.216507 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec88109-cc68-413e-bb7c-7e65c6b01fa2 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:40:09.273411 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9178de47-bc67-482e-be40-9022af21a416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:40:09.274017 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9178de47-bc67-482e-be40-9022af21a416 admin admin] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:40:09.274302 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9178de47-bc67-482e-be40-9022af21a416 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:40:09.274580 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9178de47-bc67-482e-be40-9022af21a416 admin admin] PATH_INFO: `/v3/users` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:40:09.275205 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9178de47-bc67-482e-be40-9022af21a416 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:40:09.277190 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9178de47-bc67-482e-be40-9022af21a416 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:40:09.303548 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1409/2856] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 19 10:40:09 2022] POST /identity/v3/users => generated 283 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:40:09.304741 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34bc86f-ff85-4595-aec3-256508770795 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:40:09.316846 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34bc86f-ff85-4595-aec3-256508770795 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:40:09.321701 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f914d177-dfc3-44a5-b23b-46df68d504cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:40:09.322304 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f914d177-dfc3-44a5-b23b-46df68d504cf admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:40:09.322580 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f914d177-dfc3-44a5-b23b-46df68d504cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:40:09.322850 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f914d177-dfc3-44a5-b23b-46df68d504cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:40:09.323904 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f914d177-dfc3-44a5-b23b-46df68d504cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:40:09.325469 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f914d177-dfc3-44a5-b23b-46df68d504cf admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:40:09.336129 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1448/2857] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:40:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 10:40:09.340225 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9178de47-bc67-482e-be40-9022af21a416 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:40:09.350639 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9178de47-bc67-482e-be40-9022af21a416 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:40:09.355203 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9bd7cc-3f11-400d-9fb9-a7a97c3a6914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:40:09.355818 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9bd7cc-3f11-400d-9fb9-a7a97c3a6914 admin admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:40:09.356105 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9bd7cc-3f11-400d-9fb9-a7a97c3a6914 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:40:09.356409 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9bd7cc-3f11-400d-9fb9-a7a97c3a6914 admin admin] PATH_INFO: `/v3/roles` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:40:09.357041 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9bd7cc-3f11-400d-9fb9-a7a97c3a6914 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:40:09.358665 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9bd7cc-3f11-400d-9fb9-a7a97c3a6914 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:40:09.372454 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1410/2858] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:40:09 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 10:40:09.376814 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f914d177-dfc3-44a5-b23b-46df68d504cf admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:40:09.386869 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f914d177-dfc3-44a5-b23b-46df68d504cf admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:40:09.392022 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502cc0f0-dba2-48ea-a5d4-f552b91f36dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:40:09.392980 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502cc0f0-dba2-48ea-a5d4-f552b91f36dc admin admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:40:09.393239 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502cc0f0-dba2-48ea-a5d4-f552b91f36dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:40:09.393514 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502cc0f0-dba2-48ea-a5d4-f552b91f36dc admin admin] PATH_INFO: `/v3/projects/93dab9d615aa4219bb3e0ce9bf7e3c4f/users/933c0ce1e50449e9bf13dc68003713c3/roles/cd5b42ed3b754b58817a62bbe74651b4` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:40:09.410228 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502cc0f0-dba2-48ea-a5d4-f552b91f36dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=93dab9d615aa4219bb3e0ce9bf7e3c4f, user_id=933c0ce1e50449e9bf13dc68003713c3, role_id=cd5b42ed3b754b58817a62bbe74651b4)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:40:09.413215 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502cc0f0-dba2-48ea-a5d4-f552b91f36dc admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:40:09.427210 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1449/2859] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 19 10:40:09 2022] PUT /identity/v3/projects/93dab9d615aa4219bb3e0ce9bf7e3c4f/users/933c0ce1e50449e9bf13dc68003713c3/roles/cd5b42ed3b754b58817a62bbe74651b4 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:40:09.437657 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204e8b0d-0ba6-4c30-9230-1ddc59933f68 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:40:09.437947 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204e8b0d-0ba6-4c30-9230-1ddc59933f68 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:40:09.438235 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204e8b0d-0ba6-4c30-9230-1ddc59933f68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:40:09.467900 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-204e8b0d-0ba6-4c30-9230-1ddc59933f68 None None] MFA Rules not processed for user `933c0ce1e50449e9bf13dc68003713c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:40:09.469182 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-204e8b0d-0ba6-4c30-9230-1ddc59933f68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:40:09.540008 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1411/2860] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:40:09 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:40:09.544838 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502cc0f0-dba2-48ea-a5d4-f552b91f36dc admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:40:09.608366 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502cc0f0-dba2-48ea-a5d4-f552b91f36dc admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:40:09.613684 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e2778a-6f9f-48a8-85d1-0c1ad2dd2d0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:40:09.614288 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e2778a-6f9f-48a8-85d1-0c1ad2dd2d0b admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:40:09.614566 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e2778a-6f9f-48a8-85d1-0c1ad2dd2d0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:40:09.614837 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e2778a-6f9f-48a8-85d1-0c1ad2dd2d0b admin admin] PATH_INFO: `/v3/projects` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:40:09.615474 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e2778a-6f9f-48a8-85d1-0c1ad2dd2d0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:40:09.617430 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e2778a-6f9f-48a8-85d1-0c1ad2dd2d0b admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:40:09.644516 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1450/2861] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 19 10:40:09 2022] POST /identity/v3/projects => generated 365 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:40:09.648255 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204e8b0d-0ba6-4c30-9230-1ddc59933f68 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:40:09.659048 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204e8b0d-0ba6-4c30-9230-1ddc59933f68 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:40:09.704706 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:40:09.718108 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875c9a00-1f74-44b4-9e98-4a7c1daaf2a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:40:09.718724 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875c9a00-1f74-44b4-9e98-4a7c1daaf2a1 admin admin] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:40:09.718999 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875c9a00-1f74-44b4-9e98-4a7c1daaf2a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:40:09.719269 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875c9a00-1f74-44b4-9e98-4a7c1daaf2a1 admin admin] PATH_INFO: `/v3/users` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:40:09.719927 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875c9a00-1f74-44b4-9e98-4a7c1daaf2a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:40:09.721996 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875c9a00-1f74-44b4-9e98-4a7c1daaf2a1 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:40:09.743382 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1412/2862] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 19 10:40:09 2022] POST /identity/v3/users => generated 289 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 10:40:09.747400 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e2778a-6f9f-48a8-85d1-0c1ad2dd2d0b admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:40:09.758636 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e2778a-6f9f-48a8-85d1-0c1ad2dd2d0b admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:40:09.763358 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fb7a45-9974-4954-a561-40534ecd2d34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:40:09.763957 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fb7a45-9974-4954-a561-40534ecd2d34 admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:40:09.764287 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fb7a45-9974-4954-a561-40534ecd2d34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:40:09.764565 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fb7a45-9974-4954-a561-40534ecd2d34 admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:40:09.765201 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fb7a45-9974-4954-a561-40534ecd2d34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:40:09.766856 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fb7a45-9974-4954-a561-40534ecd2d34 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:40:09.777483 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1451/2863] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:40:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 10:40:09.781638 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875c9a00-1f74-44b4-9e98-4a7c1daaf2a1 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:40:09.792316 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875c9a00-1f74-44b4-9e98-4a7c1daaf2a1 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:40:09.796975 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a897e33-c3f7-4a10-b7a4-3326c484c9df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:40:09.797620 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a897e33-c3f7-4a10-b7a4-3326c484c9df admin admin] REQUEST_METHOD: `PUT` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:40:09.797903 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a897e33-c3f7-4a10-b7a4-3326c484c9df admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:40:09.798184 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a897e33-c3f7-4a10-b7a4-3326c484c9df admin admin] PATH_INFO: `/v3/projects/a85d8f0095ae45649a181da2fb29bc3d/users/abab7eb57e7a4756a0cd6c327c020202/roles/5c8b89fae4fa45bd944cbeaf442136e1` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:40:09.813530 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a897e33-c3f7-4a10-b7a4-3326c484c9df admin admin] RBAC: Authorizing `identity:create_grant(project_id=a85d8f0095ae45649a181da2fb29bc3d, user_id=abab7eb57e7a4756a0cd6c327c020202, role_id=5c8b89fae4fa45bd944cbeaf442136e1)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:40:09.816246 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a897e33-c3f7-4a10-b7a4-3326c484c9df admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:40:09.829163 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1413/2864] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 19 10:40:09 2022] PUT /identity/v3/projects/a85d8f0095ae45649a181da2fb29bc3d/users/abab7eb57e7a4756a0cd6c327c020202/roles/5c8b89fae4fa45bd944cbeaf442136e1 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:40:09.833206 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fb7a45-9974-4954-a561-40534ecd2d34 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:40:09.843320 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fb7a45-9974-4954-a561-40534ecd2d34 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:40:09.852579 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:40:09.901127 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c96470-48ed-4802-972f-466f71c92c2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:40:09.901643 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c96470-48ed-4802-972f-466f71c92c2c admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:40:09.901926 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c96470-48ed-4802-972f-466f71c92c2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:40:09.902202 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c96470-48ed-4802-972f-466f71c92c2c admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:40:09.902844 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c96470-48ed-4802-972f-466f71c92c2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:40:09.904479 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c96470-48ed-4802-972f-466f71c92c2c admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:40:09.915164 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1452/2865] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:40:09 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 10:40:09.919642 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a897e33-c3f7-4a10-b7a4-3326c484c9df admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:40:09.930463 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a897e33-c3f7-4a10-b7a4-3326c484c9df admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:40:09.935038 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6291f4b-f609-47a2-891c-e59c6635a2e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:40:09.935692 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6291f4b-f609-47a2-891c-e59c6635a2e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:40:09.935973 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6291f4b-f609-47a2-891c-e59c6635a2e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:40:09.936288 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6291f4b-f609-47a2-891c-e59c6635a2e8 admin admin] PATH_INFO: `/v3/projects/a85d8f0095ae45649a181da2fb29bc3d/users/abab7eb57e7a4756a0cd6c327c020202/roles/5c8b89fae4fa45bd944cbeaf442136e1` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:40:09.938206 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6291f4b-f609-47a2-891c-e59c6635a2e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a85d8f0095ae45649a181da2fb29bc3d, user_id=abab7eb57e7a4756a0cd6c327c020202, role_id=5c8b89fae4fa45bd944cbeaf442136e1)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:40:09.940885 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6291f4b-f609-47a2-891c-e59c6635a2e8 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:40:09.950972 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1414/2866] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 19 10:40:09 2022] PUT /identity/v3/projects/a85d8f0095ae45649a181da2fb29bc3d/users/abab7eb57e7a4756a0cd6c327c020202/roles/5c8b89fae4fa45bd944cbeaf442136e1 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:40:09.961188 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3e48f4-fcf2-4ca6-b390-8b97dc658d4c None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:40:09.961477 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3e48f4-fcf2-4ca6-b390-8b97dc658d4c None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:40:09.961754 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3e48f4-fcf2-4ca6-b390-8b97dc658d4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:40:09.990591 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-ca3e48f4-fcf2-4ca6-b390-8b97dc658d4c None None] MFA Rules not processed for user `abab7eb57e7a4756a0cd6c327c020202`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:40:09.992212 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-ca3e48f4-fcf2-4ca6-b390-8b97dc658d4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:40:10.062206 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1453/2867] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:40:09 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:40:10.073586 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6291f4b-f609-47a2-891c-e59c6635a2e8 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:40:10.075408 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-c6291f4b-f609-47a2-891c-e59c6635a2e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:40:10.132363 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6291f4b-f609-47a2-891c-e59c6635a2e8 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:40:10.136027 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3203b114-938f-4532-88c3-b41e3d6f39fb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa4d004fd44482cae761c4b3bdfab31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:40:10.136666 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3203b114-938f-4532-88c3-b41e3d6f39fb service cinder] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:40:10.136957 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3203b114-938f-4532-88c3-b41e3d6f39fb service cinder] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:40:10.137230 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3203b114-938f-4532-88c3-b41e3d6f39fb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:40:10.147380 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3203b114-938f-4532-88c3-b41e3d6f39fb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:40:10.148879 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3203b114-938f-4532-88c3-b41e3d6f39fb service cinder] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:40:10.158998 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1415/2868] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:40:10 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:40:10.236095 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3e48f4-fcf2-4ca6-b390-8b97dc658d4c None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:40:10.245892 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3e48f4-fcf2-4ca6-b390-8b97dc658d4c None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:40:10.249576 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6213d76e-2b7b-4507-9972-c2bac5513042 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa4d004fd44482cae761c4b3bdfab31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:40:10.250169 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6213d76e-2b7b-4507-9972-c2bac5513042 service cinder] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:40:10.250450 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6213d76e-2b7b-4507-9972-c2bac5513042 service cinder] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:40:10.250726 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6213d76e-2b7b-4507-9972-c2bac5513042 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:40:10.307599 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6213d76e-2b7b-4507-9972-c2bac5513042 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:40:10.309074 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6213d76e-2b7b-4507-9972-c2bac5513042 service cinder] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:40:10.318300 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1454/2869] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:40:10 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:40:13.058006 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3203b114-938f-4532-88c3-b41e3d6f39fb service cinder] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:40:13.121500 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3203b114-938f-4532-88c3-b41e3d6f39fb service cinder] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:40:13.125976 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820cb2c7-404f-4da4-8905-6ceede95cc0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:40:13.126602 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820cb2c7-404f-4da4-8905-6ceede95cc0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:40:13.126884 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820cb2c7-404f-4da4-8905-6ceede95cc0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:40:13.127159 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820cb2c7-404f-4da4-8905-6ceede95cc0a admin admin] PATH_INFO: `/v3/users/933c0ce1e50449e9bf13dc68003713c3` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:40:13.128347 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820cb2c7-404f-4da4-8905-6ceede95cc0a admin admin] RBAC: Authorizing `identity:delete_user(user_id=933c0ce1e50449e9bf13dc68003713c3)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:40:13.131162 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820cb2c7-404f-4da4-8905-6ceede95cc0a admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:40:13.174553 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:40:13.177046 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-820cb2c7-404f-4da4-8905-6ceede95cc0a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '933c0ce1e50449e9bf13dc68003713c3'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:40:13.185274 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-820cb2c7-404f-4da4-8905-6ceede95cc0a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '933c0ce1e50449e9bf13dc68003713c3'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:40:13.186094 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-820cb2c7-404f-4da4-8905-6ceede95cc0a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '933c0ce1e50449e9bf13dc68003713c3'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:40:13.187033 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-820cb2c7-404f-4da4-8905-6ceede95cc0a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '933c0ce1e50449e9bf13dc68003713c3'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:40:13.194887 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-820cb2c7-404f-4da4-8905-6ceede95cc0a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '933c0ce1e50449e9bf13dc68003713c3'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:40:13.212763 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1416/2870] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 19 10:40:13 2022] DELETE /identity/v3/users/933c0ce1e50449e9bf13dc68003713c3 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:40:13.217472 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35992cd-1757-450e-81b6-88b313d4fb6c None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:40:13.217946 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35992cd-1757-450e-81b6-88b313d4fb6c None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:40:13.218075 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35992cd-1757-450e-81b6-88b313d4fb6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:40:13.236992 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-f35992cd-1757-450e-81b6-88b313d4fb6c None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:40:13.238210 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-f35992cd-1757-450e-81b6-88b313d4fb6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:40:13.267285 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:40:13.297188 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1455/2871] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:40:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:40:13.307438 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820cb2c7-404f-4da4-8905-6ceede95cc0a admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:40:13.308860 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-820cb2c7-404f-4da4-8905-6ceede95cc0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:40:13.365400 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820cb2c7-404f-4da4-8905-6ceede95cc0a admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:40:13.369004 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151f0eed-f7b7-40aa-9eb7-dbd13e51ae40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c1289b015854c6bb6aee8fed6b807db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:40:13.369610 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151f0eed-f7b7-40aa-9eb7-dbd13e51ae40 service neutron] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:40:13.369893 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151f0eed-f7b7-40aa-9eb7-dbd13e51ae40 service neutron] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:40:13.370169 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151f0eed-f7b7-40aa-9eb7-dbd13e51ae40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:40:13.379101 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151f0eed-f7b7-40aa-9eb7-dbd13e51ae40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:40:13.381114 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151f0eed-f7b7-40aa-9eb7-dbd13e51ae40 service neutron] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:40:13.390592 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1417/2872] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:40:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 10:40:13.671043 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35992cd-1757-450e-81b6-88b313d4fb6c None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:40:13.672609 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-f35992cd-1757-450e-81b6-88b313d4fb6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:40:13.685751 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35992cd-1757-450e-81b6-88b313d4fb6c None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:40:13.697022 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8a9c31-fd5f-441f-adfa-335e1532c613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:40:13.697720 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8a9c31-fd5f-441f-adfa-335e1532c613 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:40:13.698005 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8a9c31-fd5f-441f-adfa-335e1532c613 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:40:13.698289 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8a9c31-fd5f-441f-adfa-335e1532c613 admin admin] PATH_INFO: `/v3/projects/93dab9d615aa4219bb3e0ce9bf7e3c4f` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:40:13.699447 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8a9c31-fd5f-441f-adfa-335e1532c613 admin admin] RBAC: Authorizing `identity:delete_project(project_id=93dab9d615aa4219bb3e0ce9bf7e3c4f)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:40:13.701461 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8a9c31-fd5f-441f-adfa-335e1532c613 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:40:13.752362 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-ec8a9c31-fd5f-441f-adfa-335e1532c613 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93dab9d615aa4219bb3e0ce9bf7e3c4f', 'request_id': 'req-ec8a9c31-fd5f-441f-adfa-335e1532c613'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:40:13.758831 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-ec8a9c31-fd5f-441f-adfa-335e1532c613 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93dab9d615aa4219bb3e0ce9bf7e3c4f', 'request_id': 'req-ec8a9c31-fd5f-441f-adfa-335e1532c613'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:40:13.766658 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-ec8a9c31-fd5f-441f-adfa-335e1532c613 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93dab9d615aa4219bb3e0ce9bf7e3c4f', 'request_id': 'req-ec8a9c31-fd5f-441f-adfa-335e1532c613'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:40:13.777617 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-ec8a9c31-fd5f-441f-adfa-335e1532c613 admin admin] The token cache is being invalidate because project 93dab9d615aa4219bb3e0ce9bf7e3c4f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 10:40:13.777900 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-ec8a9c31-fd5f-441f-adfa-335e1532c613 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:40:13.778534 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-ec8a9c31-fd5f-441f-adfa-335e1532c613 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:40:13.780026 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1456/2873] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 19 10:40:13 2022] DELETE /identity/v3/projects/93dab9d615aa4219bb3e0ce9bf7e3c4f => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:40:13.784086 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151f0eed-f7b7-40aa-9eb7-dbd13e51ae40 service neutron] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:40:13.794961 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151f0eed-f7b7-40aa-9eb7-dbd13e51ae40 service neutron] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:40:13.856215 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82725779-50e3-45f6-9c80-73ea2420b9e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:40:13.856856 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82725779-50e3-45f6-9c80-73ea2420b9e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:40:13.857181 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82725779-50e3-45f6-9c80-73ea2420b9e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:40:13.857433 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82725779-50e3-45f6-9c80-73ea2420b9e7 admin admin] PATH_INFO: `/v3/users/abab7eb57e7a4756a0cd6c327c020202` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:40:13.858552 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82725779-50e3-45f6-9c80-73ea2420b9e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=abab7eb57e7a4756a0cd6c327c020202)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:40:13.860523 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82725779-50e3-45f6-9c80-73ea2420b9e7 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:40:13.907003 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-82725779-50e3-45f6-9c80-73ea2420b9e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'abab7eb57e7a4756a0cd6c327c020202'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:40:13.914448 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-82725779-50e3-45f6-9c80-73ea2420b9e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'abab7eb57e7a4756a0cd6c327c020202'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:40:13.915167 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-82725779-50e3-45f6-9c80-73ea2420b9e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'abab7eb57e7a4756a0cd6c327c020202'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:40:13.915772 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-82725779-50e3-45f6-9c80-73ea2420b9e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'abab7eb57e7a4756a0cd6c327c020202'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:40:13.923089 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-82725779-50e3-45f6-9c80-73ea2420b9e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'abab7eb57e7a4756a0cd6c327c020202'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:40:13.927603 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:40:13.942635 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1418/2874] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 19 10:40:13 2022] DELETE /identity/v3/users/abab7eb57e7a4756a0cd6c327c020202 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:40:14.212508 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8a9c31-fd5f-441f-adfa-335e1532c613 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:40:14.214083 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-ec8a9c31-fd5f-441f-adfa-335e1532c613 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:40:14.227789 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8a9c31-fd5f-441f-adfa-335e1532c613 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:40:14.286666 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc8823e-07f1-4e1a-8da7-57abcaf2b831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:40:14.287318 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc8823e-07f1-4e1a-8da7-57abcaf2b831 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:40:14.287593 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc8823e-07f1-4e1a-8da7-57abcaf2b831 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:40:14.287914 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc8823e-07f1-4e1a-8da7-57abcaf2b831 admin admin] PATH_INFO: `/v3/projects/a85d8f0095ae45649a181da2fb29bc3d` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:40:14.289018 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc8823e-07f1-4e1a-8da7-57abcaf2b831 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a85d8f0095ae45649a181da2fb29bc3d)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:40:14.290909 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc8823e-07f1-4e1a-8da7-57abcaf2b831 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:40:14.338795 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-7fc8823e-07f1-4e1a-8da7-57abcaf2b831 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a85d8f0095ae45649a181da2fb29bc3d', 'request_id': 'req-7fc8823e-07f1-4e1a-8da7-57abcaf2b831'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:40:14.345474 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-7fc8823e-07f1-4e1a-8da7-57abcaf2b831 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a85d8f0095ae45649a181da2fb29bc3d', 'request_id': 'req-7fc8823e-07f1-4e1a-8da7-57abcaf2b831'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:40:14.349268 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:40:14.354671 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-7fc8823e-07f1-4e1a-8da7-57abcaf2b831 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a85d8f0095ae45649a181da2fb29bc3d', 'request_id': 'req-7fc8823e-07f1-4e1a-8da7-57abcaf2b831'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:40:14.366329 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-7fc8823e-07f1-4e1a-8da7-57abcaf2b831 admin admin] The token cache is being invalidate because project a85d8f0095ae45649a181da2fb29bc3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 10:40:14.366613 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-7fc8823e-07f1-4e1a-8da7-57abcaf2b831 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:40:14.367226 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-7fc8823e-07f1-4e1a-8da7-57abcaf2b831 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:40:14.368716 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1457/2875] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 19 10:40:14 2022] DELETE /identity/v3/projects/a85d8f0095ae45649a181da2fb29bc3d => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:40:14.373585 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effd7b9d-29b4-4a0f-9b20-fbe1f873c4c3 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:40:14.374053 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effd7b9d-29b4-4a0f-9b20-fbe1f873c4c3 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:40:14.374172 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effd7b9d-29b4-4a0f-9b20-fbe1f873c4c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:40:14.396273 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-effd7b9d-29b4-4a0f-9b20-fbe1f873c4c3 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:40:14.397487 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-effd7b9d-29b4-4a0f-9b20-fbe1f873c4c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:40:14.457499 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1419/2876] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:40:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:40:14.519754 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2c2207-8c39-4b90-85b8-fc672f2ae922 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:40:14.520139 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2c2207-8c39-4b90-85b8-fc672f2ae922 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:40:14.520449 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2c2207-8c39-4b90-85b8-fc672f2ae922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:40:14.540518 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-af2c2207-8c39-4b90-85b8-fc672f2ae922 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:40:14.541677 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-af2c2207-8c39-4b90-85b8-fc672f2ae922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:40:14.549866 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1458/2877] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:40:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:40:14.554870 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effd7b9d-29b4-4a0f-9b20-fbe1f873c4c3 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:40:14.564634 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effd7b9d-29b4-4a0f-9b20-fbe1f873c4c3 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:40:14.569176 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8db81fd-fcf8-4610-b811-bea667245e51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:40:14.569766 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8db81fd-fcf8-4610-b811-bea667245e51 admin admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:40:14.570041 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8db81fd-fcf8-4610-b811-bea667245e51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:40:14.570334 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8db81fd-fcf8-4610-b811-bea667245e51 admin admin] PATH_INFO: `/v3/domains` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:40:14.570991 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8db81fd-fcf8-4610-b811-bea667245e51 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:40:14.571291 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8db81fd-fcf8-4610-b811-bea667245e51 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:40:14.572927 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8db81fd-fcf8-4610-b811-bea667245e51 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:40:14.584706 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1420/2878] 10.222.0.66 () {58 vars in 1153 bytes} [Mon Sep 19 10:40:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:40:14.589165 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2c2207-8c39-4b90-85b8-fc672f2ae922 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:40:14.599149 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2c2207-8c39-4b90-85b8-fc672f2ae922 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:40:14.603902 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298b4d1c-8932-423f-a437-7b7bf5bf4607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:40:14.604530 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298b4d1c-8932-423f-a437-7b7bf5bf4607 admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:40:14.604811 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298b4d1c-8932-423f-a437-7b7bf5bf4607 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:40:14.605083 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298b4d1c-8932-423f-a437-7b7bf5bf4607 admin admin] PATH_INFO: `/v3/projects` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:40:14.605724 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298b4d1c-8932-423f-a437-7b7bf5bf4607 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:40:14.607625 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298b4d1c-8932-423f-a437-7b7bf5bf4607 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:40:14.634564 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1459/2879] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 19 10:40:14 2022] POST /identity/v3/projects => generated 367 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:40:14.639085 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8db81fd-fcf8-4610-b811-bea667245e51 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:40:14.650013 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8db81fd-fcf8-4610-b811-bea667245e51 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:40:14.711129 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a8fcbe-480d-4b0f-b57c-60ea68015c52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:40:14.711741 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a8fcbe-480d-4b0f-b57c-60ea68015c52 admin admin] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:40:14.712021 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a8fcbe-480d-4b0f-b57c-60ea68015c52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:40:14.712331 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a8fcbe-480d-4b0f-b57c-60ea68015c52 admin admin] PATH_INFO: `/v3/users` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:40:14.712997 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a8fcbe-480d-4b0f-b57c-60ea68015c52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:40:14.714922 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a8fcbe-480d-4b0f-b57c-60ea68015c52 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:40:14.735950 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1421/2880] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 19 10:40:14 2022] POST /identity/v3/users => generated 284 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:40:14.740232 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298b4d1c-8932-423f-a437-7b7bf5bf4607 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:40:14.750615 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298b4d1c-8932-423f-a437-7b7bf5bf4607 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:40:14.755172 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea50afcb-3118-4da1-9898-b56eb1b0f8f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:40:14.755756 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea50afcb-3118-4da1-9898-b56eb1b0f8f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:40:14.756032 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea50afcb-3118-4da1-9898-b56eb1b0f8f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:40:14.756338 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea50afcb-3118-4da1-9898-b56eb1b0f8f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:40:14.756966 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea50afcb-3118-4da1-9898-b56eb1b0f8f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:40:14.758561 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea50afcb-3118-4da1-9898-b56eb1b0f8f9 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:40:14.768855 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1460/2881] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:40:14 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 10:40:14.773269 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a8fcbe-480d-4b0f-b57c-60ea68015c52 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:40:14.783239 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a8fcbe-480d-4b0f-b57c-60ea68015c52 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:40:14.788500 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09c567a-55ad-4fde-92a5-f58985660fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:40:14.789099 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09c567a-55ad-4fde-92a5-f58985660fd8 admin admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:40:14.789376 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09c567a-55ad-4fde-92a5-f58985660fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:40:14.789775 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09c567a-55ad-4fde-92a5-f58985660fd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:40:14.790410 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09c567a-55ad-4fde-92a5-f58985660fd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:40:14.792330 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09c567a-55ad-4fde-92a5-f58985660fd8 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:40:14.803030 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1422/2882] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:40:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 10:40:14.807259 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea50afcb-3118-4da1-9898-b56eb1b0f8f9 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:40:14.817305 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea50afcb-3118-4da1-9898-b56eb1b0f8f9 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:40:14.821923 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25257f85-99af-4338-880c-a50a3de05386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:40:14.822658 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25257f85-99af-4338-880c-a50a3de05386 admin admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:40:14.823005 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25257f85-99af-4338-880c-a50a3de05386 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:40:14.823341 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25257f85-99af-4338-880c-a50a3de05386 admin admin] PATH_INFO: `/v3/projects/8e07aff3c6cd4d99ae6908c0905dbe41/users/dc12a9ebca59446691b038613019a065/roles/cd5b42ed3b754b58817a62bbe74651b4` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:40:14.838197 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25257f85-99af-4338-880c-a50a3de05386 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e07aff3c6cd4d99ae6908c0905dbe41, user_id=dc12a9ebca59446691b038613019a065, role_id=cd5b42ed3b754b58817a62bbe74651b4)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:40:14.840876 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25257f85-99af-4338-880c-a50a3de05386 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:40:14.855337 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1461/2883] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 19 10:40:14 2022] PUT /identity/v3/projects/8e07aff3c6cd4d99ae6908c0905dbe41/users/dc12a9ebca59446691b038613019a065/roles/cd5b42ed3b754b58817a62bbe74651b4 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:40:14.865974 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5923488-fae6-40da-a239-2dc29d6088d8 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:40:14.866258 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5923488-fae6-40da-a239-2dc29d6088d8 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:40:14.866593 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5923488-fae6-40da-a239-2dc29d6088d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:40:14.894827 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-a5923488-fae6-40da-a239-2dc29d6088d8 None None] MFA Rules not processed for user `dc12a9ebca59446691b038613019a065`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:40:14.896576 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-a5923488-fae6-40da-a239-2dc29d6088d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:40:14.939794 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:40:14.968175 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1423/2884] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:40:14 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:40:14.973099 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25257f85-99af-4338-880c-a50a3de05386 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:40:15.041161 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25257f85-99af-4338-880c-a50a3de05386 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:40:15.046132 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9c3490-de8f-4e30-a8ea-db9866202e87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:40:15.046669 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9c3490-de8f-4e30-a8ea-db9866202e87 admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:40:15.046949 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9c3490-de8f-4e30-a8ea-db9866202e87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:40:15.047222 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9c3490-de8f-4e30-a8ea-db9866202e87 admin admin] PATH_INFO: `/v3/projects` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:40:15.047854 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9c3490-de8f-4e30-a8ea-db9866202e87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:40:15.050098 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9c3490-de8f-4e30-a8ea-db9866202e87 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:40:15.076933 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1462/2885] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 19 10:40:14 2022] POST /identity/v3/projects => generated 367 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:40:15.082649 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5923488-fae6-40da-a239-2dc29d6088d8 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:40:15.095528 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5923488-fae6-40da-a239-2dc29d6088d8 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:40:15.152462 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f770ad-622e-4892-8958-c4b56d7209dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:40:15.153078 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f770ad-622e-4892-8958-c4b56d7209dd admin admin] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:40:15.153354 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f770ad-622e-4892-8958-c4b56d7209dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:40:15.153627 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f770ad-622e-4892-8958-c4b56d7209dd admin admin] PATH_INFO: `/v3/users` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:40:15.154256 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f770ad-622e-4892-8958-c4b56d7209dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:40:15.156201 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f770ad-622e-4892-8958-c4b56d7209dd admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:40:15.178593 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1424/2886] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 19 10:40:15 2022] POST /identity/v3/users => generated 290 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:40:15.183427 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9c3490-de8f-4e30-a8ea-db9866202e87 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:40:15.194226 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9c3490-de8f-4e30-a8ea-db9866202e87 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:40:15.198803 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bcf43f-2158-453e-afa8-600defe9ebbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:40:15.199418 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bcf43f-2158-453e-afa8-600defe9ebbe admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:40:15.199675 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bcf43f-2158-453e-afa8-600defe9ebbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:40:15.199942 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bcf43f-2158-453e-afa8-600defe9ebbe admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:40:15.200603 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bcf43f-2158-453e-afa8-600defe9ebbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:40:15.202192 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bcf43f-2158-453e-afa8-600defe9ebbe admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:40:15.215835 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1463/2887] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:40:15 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 10:40:15.220228 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f770ad-622e-4892-8958-c4b56d7209dd admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:40:15.230742 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f770ad-622e-4892-8958-c4b56d7209dd admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:40:15.235412 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73519099-523c-42c3-b179-168281e2da6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:40:15.236058 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73519099-523c-42c3-b179-168281e2da6d admin admin] REQUEST_METHOD: `PUT` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:40:15.236367 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73519099-523c-42c3-b179-168281e2da6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:40:15.236642 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73519099-523c-42c3-b179-168281e2da6d admin admin] PATH_INFO: `/v3/projects/19dc8ec477ac4fb69ca5d6805d10d676/users/a7329b0adfa84c52a274f271d4ba3a92/roles/5c8b89fae4fa45bd944cbeaf442136e1` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:40:15.254128 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73519099-523c-42c3-b179-168281e2da6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=19dc8ec477ac4fb69ca5d6805d10d676, user_id=a7329b0adfa84c52a274f271d4ba3a92, role_id=5c8b89fae4fa45bd944cbeaf442136e1)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:40:15.258474 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73519099-523c-42c3-b179-168281e2da6d admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:40:15.272640 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1425/2888] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 19 10:40:15 2022] PUT /identity/v3/projects/19dc8ec477ac4fb69ca5d6805d10d676/users/a7329b0adfa84c52a274f271d4ba3a92/roles/5c8b89fae4fa45bd944cbeaf442136e1 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:40:15.276746 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bcf43f-2158-453e-afa8-600defe9ebbe admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:40:15.287603 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bcf43f-2158-453e-afa8-600defe9ebbe admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:40:15.346393 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:40:15.353252 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7f94cd-b32d-4cc4-bcee-1060395fdfe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:40:15.353936 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7f94cd-b32d-4cc4-bcee-1060395fdfe7 admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:40:15.354270 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7f94cd-b32d-4cc4-bcee-1060395fdfe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:40:15.354734 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7f94cd-b32d-4cc4-bcee-1060395fdfe7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:40:15.355520 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7f94cd-b32d-4cc4-bcee-1060395fdfe7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:40:15.357536 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7f94cd-b32d-4cc4-bcee-1060395fdfe7 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:40:15.368249 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1464/2889] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:40:15 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 10:40:15.372433 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73519099-523c-42c3-b179-168281e2da6d admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:40:15.385412 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73519099-523c-42c3-b179-168281e2da6d admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:40:15.390377 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f753ea9d-e05d-4cd1-8b8a-d70fa2763241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:40:15.391034 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f753ea9d-e05d-4cd1-8b8a-d70fa2763241 admin admin] REQUEST_METHOD: `PUT` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:40:15.391317 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f753ea9d-e05d-4cd1-8b8a-d70fa2763241 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:40:15.391595 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f753ea9d-e05d-4cd1-8b8a-d70fa2763241 admin admin] PATH_INFO: `/v3/projects/19dc8ec477ac4fb69ca5d6805d10d676/users/a7329b0adfa84c52a274f271d4ba3a92/roles/5c8b89fae4fa45bd944cbeaf442136e1` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:40:15.393637 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f753ea9d-e05d-4cd1-8b8a-d70fa2763241 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19dc8ec477ac4fb69ca5d6805d10d676, user_id=a7329b0adfa84c52a274f271d4ba3a92, role_id=5c8b89fae4fa45bd944cbeaf442136e1)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:40:15.396973 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f753ea9d-e05d-4cd1-8b8a-d70fa2763241 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:40:15.409732 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1426/2890] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 19 10:40:15 2022] PUT /identity/v3/projects/19dc8ec477ac4fb69ca5d6805d10d676/users/a7329b0adfa84c52a274f271d4ba3a92/roles/5c8b89fae4fa45bd944cbeaf442136e1 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:40:15.421201 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3284d4-bbde-480b-88c4-b74e61abf05c None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:40:15.421523 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3284d4-bbde-480b-88c4-b74e61abf05c None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:40:15.421800 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3284d4-bbde-480b-88c4-b74e61abf05c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:40:15.454728 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-5c3284d4-bbde-480b-88c4-b74e61abf05c None None] MFA Rules not processed for user `a7329b0adfa84c52a274f271d4ba3a92`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:40:15.456333 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-5c3284d4-bbde-480b-88c4-b74e61abf05c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:40:15.532042 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1465/2891] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:40:15 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:40:15.544386 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f753ea9d-e05d-4cd1-8b8a-d70fa2763241 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:40:15.546157 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-f753ea9d-e05d-4cd1-8b8a-d70fa2763241 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:40:15.608859 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f753ea9d-e05d-4cd1-8b8a-d70fa2763241 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:40:15.613016 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715982fa-96bb-4b04-a4d2-b890b0ec197a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa4d004fd44482cae761c4b3bdfab31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:40:15.613627 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715982fa-96bb-4b04-a4d2-b890b0ec197a service cinder] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:40:15.613953 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715982fa-96bb-4b04-a4d2-b890b0ec197a service cinder] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:40:15.614301 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715982fa-96bb-4b04-a4d2-b890b0ec197a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:40:15.623945 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715982fa-96bb-4b04-a4d2-b890b0ec197a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:40:15.625454 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715982fa-96bb-4b04-a4d2-b890b0ec197a service cinder] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:40:15.635230 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1427/2892] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:40:15 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:40:15.733538 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3284d4-bbde-480b-88c4-b74e61abf05c None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:40:15.743789 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3284d4-bbde-480b-88c4-b74e61abf05c None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:40:15.747499 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e54e7ff-6de3-4d83-a310-06d8fdfac62a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa4d004fd44482cae761c4b3bdfab31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:40:15.748096 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e54e7ff-6de3-4d83-a310-06d8fdfac62a service cinder] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:40:15.748423 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e54e7ff-6de3-4d83-a310-06d8fdfac62a service cinder] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:40:15.748703 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e54e7ff-6de3-4d83-a310-06d8fdfac62a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:40:15.807308 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e54e7ff-6de3-4d83-a310-06d8fdfac62a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:40:15.808772 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e54e7ff-6de3-4d83-a310-06d8fdfac62a service cinder] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:40:15.818724 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1466/2893] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:40:15 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:40:20.537210 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715982fa-96bb-4b04-a4d2-b890b0ec197a service cinder] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:40:20.576501 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:40:20.600079 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715982fa-96bb-4b04-a4d2-b890b0ec197a service cinder] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:40:20.604673 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1aeb15c-1b33-4949-9c6a-17ed1dc76ab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:40:20.605295 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aeb15c-1b33-4949-9c6a-17ed1dc76ab4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:40:20.605575 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aeb15c-1b33-4949-9c6a-17ed1dc76ab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:40:20.605845 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aeb15c-1b33-4949-9c6a-17ed1dc76ab4 admin admin] PATH_INFO: `/v3/users/dc12a9ebca59446691b038613019a065` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:40:20.606952 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1aeb15c-1b33-4949-9c6a-17ed1dc76ab4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc12a9ebca59446691b038613019a065)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:40:20.608909 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1aeb15c-1b33-4949-9c6a-17ed1dc76ab4 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:40:20.654557 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-a1aeb15c-1b33-4949-9c6a-17ed1dc76ab4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc12a9ebca59446691b038613019a065'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:40:20.661811 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-a1aeb15c-1b33-4949-9c6a-17ed1dc76ab4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc12a9ebca59446691b038613019a065'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:40:20.662563 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-a1aeb15c-1b33-4949-9c6a-17ed1dc76ab4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc12a9ebca59446691b038613019a065'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:40:20.663196 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-a1aeb15c-1b33-4949-9c6a-17ed1dc76ab4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc12a9ebca59446691b038613019a065'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:40:20.670614 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-a1aeb15c-1b33-4949-9c6a-17ed1dc76ab4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc12a9ebca59446691b038613019a065'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:40:20.688951 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1428/2894] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 19 10:40:20 2022] DELETE /identity/v3/users/dc12a9ebca59446691b038613019a065 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:40:20.693476 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5dedf7-30ac-46be-9721-5a5477853fb8 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:40:20.693883 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5dedf7-30ac-46be-9721-5a5477853fb8 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:40:20.694026 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5dedf7-30ac-46be-9721-5a5477853fb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:40:20.713480 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-fa5dedf7-30ac-46be-9721-5a5477853fb8 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:40:20.714720 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-fa5dedf7-30ac-46be-9721-5a5477853fb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:40:20.773223 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1467/2895] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:40:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:40:20.782988 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1aeb15c-1b33-4949-9c6a-17ed1dc76ab4 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:40:20.784439 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-a1aeb15c-1b33-4949-9c6a-17ed1dc76ab4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:40:20.841652 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1aeb15c-1b33-4949-9c6a-17ed1dc76ab4 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:40:20.845316 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9222f193-27b4-4224-869b-2c9264f3c305 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c1289b015854c6bb6aee8fed6b807db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:40:20.845916 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9222f193-27b4-4224-869b-2c9264f3c305 service neutron] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:40:20.846192 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9222f193-27b4-4224-869b-2c9264f3c305 service neutron] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:40:20.846461 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9222f193-27b4-4224-869b-2c9264f3c305 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:40:20.856022 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9222f193-27b4-4224-869b-2c9264f3c305 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:40:20.857495 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9222f193-27b4-4224-869b-2c9264f3c305 service neutron] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:40:20.867422 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1429/2896] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:40:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:40:21.132632 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5dedf7-30ac-46be-9721-5a5477853fb8 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:40:21.134202 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-fa5dedf7-30ac-46be-9721-5a5477853fb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:40:21.147509 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5dedf7-30ac-46be-9721-5a5477853fb8 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:40:21.152389 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e4d1e8-099b-450e-be1a-ab315a5585bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:40:21.153031 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e4d1e8-099b-450e-be1a-ab315a5585bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:40:21.153313 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e4d1e8-099b-450e-be1a-ab315a5585bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:40:21.153584 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e4d1e8-099b-450e-be1a-ab315a5585bf admin admin] PATH_INFO: `/v3/projects/8e07aff3c6cd4d99ae6908c0905dbe41` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:40:21.154715 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e4d1e8-099b-450e-be1a-ab315a5585bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e07aff3c6cd4d99ae6908c0905dbe41)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:40:21.156686 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e4d1e8-099b-450e-be1a-ab315a5585bf admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:40:21.169217 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:40:21.205336 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-61e4d1e8-099b-450e-be1a-ab315a5585bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e07aff3c6cd4d99ae6908c0905dbe41', 'request_id': 'req-61e4d1e8-099b-450e-be1a-ab315a5585bf'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:40:21.211818 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-61e4d1e8-099b-450e-be1a-ab315a5585bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e07aff3c6cd4d99ae6908c0905dbe41', 'request_id': 'req-61e4d1e8-099b-450e-be1a-ab315a5585bf'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:40:21.219509 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-61e4d1e8-099b-450e-be1a-ab315a5585bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e07aff3c6cd4d99ae6908c0905dbe41', 'request_id': 'req-61e4d1e8-099b-450e-be1a-ab315a5585bf'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:40:21.230612 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-61e4d1e8-099b-450e-be1a-ab315a5585bf admin admin] The token cache is being invalidate because project 8e07aff3c6cd4d99ae6908c0905dbe41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 10:40:21.230921 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-61e4d1e8-099b-450e-be1a-ab315a5585bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:40:21.231597 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-61e4d1e8-099b-450e-be1a-ab315a5585bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:40:21.233139 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1468/2897] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 19 10:40:21 2022] DELETE /identity/v3/projects/8e07aff3c6cd4d99ae6908c0905dbe41 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:40:21.237133 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9222f193-27b4-4224-869b-2c9264f3c305 service neutron] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:40:21.247384 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9222f193-27b4-4224-869b-2c9264f3c305 service neutron] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:40:21.297478 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:40:21.305166 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24b550d-a6ec-46b0-a901-3cbcf803153e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:40:21.306032 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24b550d-a6ec-46b0-a901-3cbcf803153e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:40:21.306338 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24b550d-a6ec-46b0-a901-3cbcf803153e admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:40:21.306762 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24b550d-a6ec-46b0-a901-3cbcf803153e admin admin] PATH_INFO: `/v3/users/a7329b0adfa84c52a274f271d4ba3a92` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:40:21.308009 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24b550d-a6ec-46b0-a901-3cbcf803153e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7329b0adfa84c52a274f271d4ba3a92)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:40:21.310006 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24b550d-a6ec-46b0-a901-3cbcf803153e admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:40:21.356902 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-f24b550d-a6ec-46b0-a901-3cbcf803153e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7329b0adfa84c52a274f271d4ba3a92'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:40:21.364309 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-f24b550d-a6ec-46b0-a901-3cbcf803153e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7329b0adfa84c52a274f271d4ba3a92'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:40:21.364919 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-f24b550d-a6ec-46b0-a901-3cbcf803153e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7329b0adfa84c52a274f271d4ba3a92'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:40:21.365545 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-f24b550d-a6ec-46b0-a901-3cbcf803153e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7329b0adfa84c52a274f271d4ba3a92'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:40:21.372560 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-f24b550d-a6ec-46b0-a901-3cbcf803153e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7329b0adfa84c52a274f271d4ba3a92'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:40:21.390790 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1430/2898] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 19 10:40:21 2022] DELETE /identity/v3/users/a7329b0adfa84c52a274f271d4ba3a92 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:40:21.669047 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e4d1e8-099b-450e-be1a-ab315a5585bf admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:40:21.670508 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-61e4d1e8-099b-450e-be1a-ab315a5585bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:40:21.684227 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e4d1e8-099b-450e-be1a-ab315a5585bf admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:40:21.747634 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e1ab45-5eff-4622-8ffb-ce255cef6c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:40:21.748358 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e1ab45-5eff-4622-8ffb-ce255cef6c70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:40:21.748473 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e1ab45-5eff-4622-8ffb-ce255cef6c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:40:21.748749 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e1ab45-5eff-4622-8ffb-ce255cef6c70 admin admin] PATH_INFO: `/v3/projects/19dc8ec477ac4fb69ca5d6805d10d676` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:40:21.749883 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e1ab45-5eff-4622-8ffb-ce255cef6c70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=19dc8ec477ac4fb69ca5d6805d10d676)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:40:21.751810 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e1ab45-5eff-4622-8ffb-ce255cef6c70 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:40:21.800212 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-96e1ab45-5eff-4622-8ffb-ce255cef6c70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19dc8ec477ac4fb69ca5d6805d10d676', 'request_id': 'req-96e1ab45-5eff-4622-8ffb-ce255cef6c70'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:40:21.806438 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-96e1ab45-5eff-4622-8ffb-ce255cef6c70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19dc8ec477ac4fb69ca5d6805d10d676', 'request_id': 'req-96e1ab45-5eff-4622-8ffb-ce255cef6c70'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:40:21.814035 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-96e1ab45-5eff-4622-8ffb-ce255cef6c70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19dc8ec477ac4fb69ca5d6805d10d676', 'request_id': 'req-96e1ab45-5eff-4622-8ffb-ce255cef6c70'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:40:21.825228 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-96e1ab45-5eff-4622-8ffb-ce255cef6c70 admin admin] The token cache is being invalidate because project 19dc8ec477ac4fb69ca5d6805d10d676 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 10:40:21.825511 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-96e1ab45-5eff-4622-8ffb-ce255cef6c70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:40:21.826137 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-96e1ab45-5eff-4622-8ffb-ce255cef6c70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:40:21.827601 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1469/2899] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 19 10:40:21 2022] DELETE /identity/v3/projects/19dc8ec477ac4fb69ca5d6805d10d676 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:40:21.832528 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c32a347-72bc-40a1-a617-cabd78d84b7c None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:40:21.833017 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c32a347-72bc-40a1-a617-cabd78d84b7c None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:40:21.833125 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c32a347-72bc-40a1-a617-cabd78d84b7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:40:21.853044 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-0c32a347-72bc-40a1-a617-cabd78d84b7c None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:40:21.854255 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-0c32a347-72bc-40a1-a617-cabd78d84b7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:40:21.914821 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1431/2900] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:40:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:40:21.923308 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc656203-28dd-4270-a35f-e0afea29933d None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:40:21.923657 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc656203-28dd-4270-a35f-e0afea29933d None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:40:21.923859 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc656203-28dd-4270-a35f-e0afea29933d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:40:21.943228 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-fc656203-28dd-4270-a35f-e0afea29933d None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:40:21.944948 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-fc656203-28dd-4270-a35f-e0afea29933d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:40:21.953380 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1470/2901] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:40:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:40:21.957801 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c32a347-72bc-40a1-a617-cabd78d84b7c None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:40:21.968013 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c32a347-72bc-40a1-a617-cabd78d84b7c None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:40:21.972563 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b30f430-682f-4565-9a04-f45093c39370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:40:21.973156 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b30f430-682f-4565-9a04-f45093c39370 admin admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:40:21.973437 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b30f430-682f-4565-9a04-f45093c39370 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:40:21.973714 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b30f430-682f-4565-9a04-f45093c39370 admin admin] PATH_INFO: `/v3/domains` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:40:21.974351 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b30f430-682f-4565-9a04-f45093c39370 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:40:21.974647 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b30f430-682f-4565-9a04-f45093c39370 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:40:21.976320 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b30f430-682f-4565-9a04-f45093c39370 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:40:21.987591 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1432/2902] 10.222.0.66 () {58 vars in 1153 bytes} [Mon Sep 19 10:40:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 10:40:21.992026 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc656203-28dd-4270-a35f-e0afea29933d None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:40:22.001625 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc656203-28dd-4270-a35f-e0afea29933d None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:40:22.006286 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64485b38-ca11-4a9e-9943-4b0e140fd8d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:40:22.007395 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64485b38-ca11-4a9e-9943-4b0e140fd8d4 admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:40:22.007676 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64485b38-ca11-4a9e-9943-4b0e140fd8d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:40:22.007990 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64485b38-ca11-4a9e-9943-4b0e140fd8d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:40:22.008658 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64485b38-ca11-4a9e-9943-4b0e140fd8d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:40:22.010555 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64485b38-ca11-4a9e-9943-4b0e140fd8d4 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:40:22.038415 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1471/2903] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 19 10:40:21 2022] POST /identity/v3/projects => generated 375 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:40:22.042891 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b30f430-682f-4565-9a04-f45093c39370 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:40:22.052962 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b30f430-682f-4565-9a04-f45093c39370 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:40:22.111421 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d37cfc-5897-4872-8d1f-b4aa9952ecac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:40:22.112037 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d37cfc-5897-4872-8d1f-b4aa9952ecac admin admin] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:40:22.112352 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d37cfc-5897-4872-8d1f-b4aa9952ecac admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:40:22.112630 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d37cfc-5897-4872-8d1f-b4aa9952ecac admin admin] PATH_INFO: `/v3/users` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:40:22.113266 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d37cfc-5897-4872-8d1f-b4aa9952ecac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:40:22.115589 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d37cfc-5897-4872-8d1f-b4aa9952ecac admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:40:22.130840 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:40:22.146009 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1433/2904] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 19 10:40:22 2022] POST /identity/v3/users => generated 288 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:40:22.147122 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64485b38-ca11-4a9e-9943-4b0e140fd8d4 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:40:22.152689 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:40:22.159175 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64485b38-ca11-4a9e-9943-4b0e140fd8d4 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:40:22.164963 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b904812-67af-428d-9e87-41a30345bc1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:40:22.165564 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b904812-67af-428d-9e87-41a30345bc1a admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:40:22.165845 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b904812-67af-428d-9e87-41a30345bc1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:40:22.166119 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b904812-67af-428d-9e87-41a30345bc1a admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:40:22.166754 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b904812-67af-428d-9e87-41a30345bc1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:40:22.168645 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b904812-67af-428d-9e87-41a30345bc1a admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:40:22.178470 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1472/2905] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:40:22 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 10:40:22.182939 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d37cfc-5897-4872-8d1f-b4aa9952ecac admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:40:22.192741 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d37cfc-5897-4872-8d1f-b4aa9952ecac admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:40:22.197997 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555ceaac-e917-4a68-aad9-c718dc52841c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:40:22.198587 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555ceaac-e917-4a68-aad9-c718dc52841c admin admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:40:22.198865 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555ceaac-e917-4a68-aad9-c718dc52841c admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:40:22.199137 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555ceaac-e917-4a68-aad9-c718dc52841c admin admin] PATH_INFO: `/v3/roles` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:40:22.199792 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555ceaac-e917-4a68-aad9-c718dc52841c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:40:22.201410 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555ceaac-e917-4a68-aad9-c718dc52841c admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:40:22.212005 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1434/2906] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:40:22 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 10:40:22.216082 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b904812-67af-428d-9e87-41a30345bc1a admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:40:22.227666 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b904812-67af-428d-9e87-41a30345bc1a admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:40:22.233040 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e426bd0-5e4f-46bb-83ef-d052dce74ca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:40:22.233713 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e426bd0-5e4f-46bb-83ef-d052dce74ca7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:40:22.233975 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e426bd0-5e4f-46bb-83ef-d052dce74ca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:40:22.234273 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e426bd0-5e4f-46bb-83ef-d052dce74ca7 admin admin] PATH_INFO: `/v3/projects/161abf739d3846cfa3776451c33bf91e/users/e65a8330c9dd477c96931f21285bb994/roles/cd5b42ed3b754b58817a62bbe74651b4` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:40:22.249321 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e426bd0-5e4f-46bb-83ef-d052dce74ca7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=161abf739d3846cfa3776451c33bf91e, user_id=e65a8330c9dd477c96931f21285bb994, role_id=cd5b42ed3b754b58817a62bbe74651b4)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:40:22.252038 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e426bd0-5e4f-46bb-83ef-d052dce74ca7 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:40:22.265294 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1473/2907] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 19 10:40:22 2022] PUT /identity/v3/projects/161abf739d3846cfa3776451c33bf91e/users/e65a8330c9dd477c96931f21285bb994/roles/cd5b42ed3b754b58817a62bbe74651b4 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:40:22.277304 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5d89db-52b4-4b59-adb4-1acf1bbf4108 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:40:22.277595 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5d89db-52b4-4b59-adb4-1acf1bbf4108 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:40:22.278270 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5d89db-52b4-4b59-adb4-1acf1bbf4108 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:40:22.310677 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-ed5d89db-52b4-4b59-adb4-1acf1bbf4108 None None] MFA Rules not processed for user `e65a8330c9dd477c96931f21285bb994`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:40:22.311904 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-ed5d89db-52b4-4b59-adb4-1acf1bbf4108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:40:22.376624 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1435/2908] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:40:22 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:40:22.381181 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e426bd0-5e4f-46bb-83ef-d052dce74ca7 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:40:22.450774 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e426bd0-5e4f-46bb-83ef-d052dce74ca7 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:40:22.455476 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ae9c0a-08a3-43cd-83c4-5d6d691d1d1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:40:22.456083 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ae9c0a-08a3-43cd-83c4-5d6d691d1d1f admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:40:22.456399 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ae9c0a-08a3-43cd-83c4-5d6d691d1d1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:40:22.456680 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ae9c0a-08a3-43cd-83c4-5d6d691d1d1f admin admin] PATH_INFO: `/v3/projects` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:40:22.457313 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ae9c0a-08a3-43cd-83c4-5d6d691d1d1f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:40:22.459224 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ae9c0a-08a3-43cd-83c4-5d6d691d1d1f admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:40:22.486216 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1474/2909] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 19 10:40:22 2022] POST /identity/v3/projects => generated 373 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:40:22.492182 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5d89db-52b4-4b59-adb4-1acf1bbf4108 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:40:22.502860 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5d89db-52b4-4b59-adb4-1acf1bbf4108 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:40:22.558579 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ac122a-282d-431d-a301-743348734230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:40:22.559178 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ac122a-282d-431d-a301-743348734230 admin admin] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:40:22.559455 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ac122a-282d-431d-a301-743348734230 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:40:22.559725 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ac122a-282d-431d-a301-743348734230 admin admin] PATH_INFO: `/v3/users` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:40:22.560372 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ac122a-282d-431d-a301-743348734230 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:40:22.562290 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ac122a-282d-431d-a301-743348734230 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:40:22.585829 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1436/2910] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 19 10:40:22 2022] POST /identity/v3/users => generated 293 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:40:22.589794 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ae9c0a-08a3-43cd-83c4-5d6d691d1d1f admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:40:22.601082 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ae9c0a-08a3-43cd-83c4-5d6d691d1d1f admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:40:22.605996 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321696ed-a770-458d-a77d-01159d07fe56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:40:22.606593 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321696ed-a770-458d-a77d-01159d07fe56 admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:40:22.606868 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321696ed-a770-458d-a77d-01159d07fe56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:40:22.607137 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321696ed-a770-458d-a77d-01159d07fe56 admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:40:22.607760 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321696ed-a770-458d-a77d-01159d07fe56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:40:22.609385 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321696ed-a770-458d-a77d-01159d07fe56 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:40:22.620763 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1475/2911] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:40:22 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 10:40:22.625409 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ac122a-282d-431d-a301-743348734230 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:40:22.635542 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ac122a-282d-431d-a301-743348734230 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:40:22.640080 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2ce5c5-bf81-4e25-866d-6493157f6054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:40:22.640760 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2ce5c5-bf81-4e25-866d-6493157f6054 admin admin] REQUEST_METHOD: `PUT` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:40:22.641041 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2ce5c5-bf81-4e25-866d-6493157f6054 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:40:22.641315 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2ce5c5-bf81-4e25-866d-6493157f6054 admin admin] PATH_INFO: `/v3/projects/eba4c4e548c649908395189c00030641/users/af967f42a3504e85b525ae56aaa92812/roles/5c8b89fae4fa45bd944cbeaf442136e1` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:40:22.656585 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2ce5c5-bf81-4e25-866d-6493157f6054 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eba4c4e548c649908395189c00030641, user_id=af967f42a3504e85b525ae56aaa92812, role_id=5c8b89fae4fa45bd944cbeaf442136e1)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:40:22.659225 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2ce5c5-bf81-4e25-866d-6493157f6054 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:40:22.674121 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1437/2912] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 19 10:40:22 2022] PUT /identity/v3/projects/eba4c4e548c649908395189c00030641/users/af967f42a3504e85b525ae56aaa92812/roles/5c8b89fae4fa45bd944cbeaf442136e1 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:40:22.678107 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321696ed-a770-458d-a77d-01159d07fe56 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:40:22.689112 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321696ed-a770-458d-a77d-01159d07fe56 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:40:22.745677 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1605e71-52ef-446d-a1a0-8755d49f4054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:40:22.746279 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1605e71-52ef-446d-a1a0-8755d49f4054 admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:40:22.746563 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1605e71-52ef-446d-a1a0-8755d49f4054 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:40:22.746839 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1605e71-52ef-446d-a1a0-8755d49f4054 admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:40:22.747473 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1605e71-52ef-446d-a1a0-8755d49f4054 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:40:22.749113 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1605e71-52ef-446d-a1a0-8755d49f4054 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:40:22.758868 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1476/2913] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:40:22 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 10:40:22.763083 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2ce5c5-bf81-4e25-866d-6493157f6054 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:40:22.774165 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2ce5c5-bf81-4e25-866d-6493157f6054 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:40:22.778731 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5888cfad-ae19-47e3-be9b-a68bc78480cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:40:22.779383 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5888cfad-ae19-47e3-be9b-a68bc78480cf admin admin] REQUEST_METHOD: `PUT` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:40:22.779664 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5888cfad-ae19-47e3-be9b-a68bc78480cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:40:22.779941 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5888cfad-ae19-47e3-be9b-a68bc78480cf admin admin] PATH_INFO: `/v3/projects/eba4c4e548c649908395189c00030641/users/af967f42a3504e85b525ae56aaa92812/roles/5c8b89fae4fa45bd944cbeaf442136e1` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:40:22.781891 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5888cfad-ae19-47e3-be9b-a68bc78480cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=eba4c4e548c649908395189c00030641, user_id=af967f42a3504e85b525ae56aaa92812, role_id=5c8b89fae4fa45bd944cbeaf442136e1)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:40:22.784636 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5888cfad-ae19-47e3-be9b-a68bc78480cf admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:40:22.795582 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1438/2914] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 19 10:40:22 2022] PUT /identity/v3/projects/eba4c4e548c649908395189c00030641/users/af967f42a3504e85b525ae56aaa92812/roles/5c8b89fae4fa45bd944cbeaf442136e1 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:40:22.807597 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93413c83-e1aa-496d-bab4-c4adec548fb0 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:40:22.807897 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93413c83-e1aa-496d-bab4-c4adec548fb0 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:40:22.808207 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93413c83-e1aa-496d-bab4-c4adec548fb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:40:22.837415 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-93413c83-e1aa-496d-bab4-c4adec548fb0 None None] MFA Rules not processed for user `af967f42a3504e85b525ae56aaa92812`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:40:22.838637 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-93413c83-e1aa-496d-bab4-c4adec548fb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:40:22.865268 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:40:22.910208 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1477/2915] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:40:22 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 10:40:22.923541 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5888cfad-ae19-47e3-be9b-a68bc78480cf admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:40:22.925383 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-5888cfad-ae19-47e3-be9b-a68bc78480cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:40:22.952960 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:40:22.985320 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5888cfad-ae19-47e3-be9b-a68bc78480cf admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:40:22.989046 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1238aa7-f617-47ff-a99c-a7ba4285ce8e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa4d004fd44482cae761c4b3bdfab31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:40:22.989650 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1238aa7-f617-47ff-a99c-a7ba4285ce8e service cinder] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:40:22.989930 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1238aa7-f617-47ff-a99c-a7ba4285ce8e service cinder] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:40:22.990206 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1238aa7-f617-47ff-a99c-a7ba4285ce8e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:40:23.045488 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1238aa7-f617-47ff-a99c-a7ba4285ce8e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:40:23.046936 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1238aa7-f617-47ff-a99c-a7ba4285ce8e service cinder] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:40:23.055823 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1439/2916] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:40:22 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:40:25.587665 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93413c83-e1aa-496d-bab4-c4adec548fb0 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:40:25.651125 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93413c83-e1aa-496d-bab4-c4adec548fb0 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:40:25.656304 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444efd68-5106-4771-9ebb-2ceb59f4bc44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:40:25.656932 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444efd68-5106-4771-9ebb-2ceb59f4bc44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:40:25.657212 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444efd68-5106-4771-9ebb-2ceb59f4bc44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:40:25.657485 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444efd68-5106-4771-9ebb-2ceb59f4bc44 admin admin] PATH_INFO: `/v3/users/e65a8330c9dd477c96931f21285bb994` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:40:25.658604 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444efd68-5106-4771-9ebb-2ceb59f4bc44 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e65a8330c9dd477c96931f21285bb994)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:40:25.660562 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444efd68-5106-4771-9ebb-2ceb59f4bc44 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:40:25.707406 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-444efd68-5106-4771-9ebb-2ceb59f4bc44 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e65a8330c9dd477c96931f21285bb994'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:40:25.714974 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-444efd68-5106-4771-9ebb-2ceb59f4bc44 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e65a8330c9dd477c96931f21285bb994'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:40:25.715608 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-444efd68-5106-4771-9ebb-2ceb59f4bc44 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e65a8330c9dd477c96931f21285bb994'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:40:25.716231 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-444efd68-5106-4771-9ebb-2ceb59f4bc44 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e65a8330c9dd477c96931f21285bb994'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:40:25.724897 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-444efd68-5106-4771-9ebb-2ceb59f4bc44 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e65a8330c9dd477c96931f21285bb994'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:40:25.743129 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1478/2917] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 19 10:40:25 2022] DELETE /identity/v3/users/e65a8330c9dd477c96931f21285bb994 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:40:25.747631 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ea1723-1cf9-49e5-92f4-9a40dbd4031a None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:40:25.748128 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ea1723-1cf9-49e5-92f4-9a40dbd4031a None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:40:25.748274 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ea1723-1cf9-49e5-92f4-9a40dbd4031a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:40:25.766763 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-c0ea1723-1cf9-49e5-92f4-9a40dbd4031a None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:40:25.767962 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-c0ea1723-1cf9-49e5-92f4-9a40dbd4031a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:40:25.826145 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1440/2918] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:40:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:40:25.837001 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444efd68-5106-4771-9ebb-2ceb59f4bc44 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:40:25.838447 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-444efd68-5106-4771-9ebb-2ceb59f4bc44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:40:25.886152 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:40:25.900343 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444efd68-5106-4771-9ebb-2ceb59f4bc44 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:40:25.904155 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dccdc3-47fd-47e9-86e0-6bcd0a4a8506 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c1289b015854c6bb6aee8fed6b807db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:40:25.904785 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dccdc3-47fd-47e9-86e0-6bcd0a4a8506 service neutron] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:40:25.905066 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dccdc3-47fd-47e9-86e0-6bcd0a4a8506 service neutron] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:40:25.905340 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dccdc3-47fd-47e9-86e0-6bcd0a4a8506 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:40:25.914899 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dccdc3-47fd-47e9-86e0-6bcd0a4a8506 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:40:25.916355 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dccdc3-47fd-47e9-86e0-6bcd0a4a8506 service neutron] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:40:25.926097 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1479/2919] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:40:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:40:26.185636 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ea1723-1cf9-49e5-92f4-9a40dbd4031a None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:40:26.187088 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-c0ea1723-1cf9-49e5-92f4-9a40dbd4031a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:40:26.199452 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ea1723-1cf9-49e5-92f4-9a40dbd4031a None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:40:26.204625 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6785d48a-0c2e-4391-bb8e-6b24f87c8bfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:40:26.205260 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6785d48a-0c2e-4391-bb8e-6b24f87c8bfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:40:26.205546 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6785d48a-0c2e-4391-bb8e-6b24f87c8bfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:40:26.205816 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6785d48a-0c2e-4391-bb8e-6b24f87c8bfc admin admin] PATH_INFO: `/v3/projects/161abf739d3846cfa3776451c33bf91e` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:40:26.206941 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6785d48a-0c2e-4391-bb8e-6b24f87c8bfc admin admin] RBAC: Authorizing `identity:delete_project(project_id=161abf739d3846cfa3776451c33bf91e)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:40:26.208889 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6785d48a-0c2e-4391-bb8e-6b24f87c8bfc admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:40:26.257651 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-6785d48a-0c2e-4391-bb8e-6b24f87c8bfc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '161abf739d3846cfa3776451c33bf91e', 'request_id': 'req-6785d48a-0c2e-4391-bb8e-6b24f87c8bfc'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:40:26.263859 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-6785d48a-0c2e-4391-bb8e-6b24f87c8bfc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '161abf739d3846cfa3776451c33bf91e', 'request_id': 'req-6785d48a-0c2e-4391-bb8e-6b24f87c8bfc'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:40:26.271345 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-6785d48a-0c2e-4391-bb8e-6b24f87c8bfc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '161abf739d3846cfa3776451c33bf91e', 'request_id': 'req-6785d48a-0c2e-4391-bb8e-6b24f87c8bfc'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:40:26.282422 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-6785d48a-0c2e-4391-bb8e-6b24f87c8bfc admin admin] The token cache is being invalidate because project 161abf739d3846cfa3776451c33bf91e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 10:40:26.282708 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-6785d48a-0c2e-4391-bb8e-6b24f87c8bfc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:40:26.283354 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-6785d48a-0c2e-4391-bb8e-6b24f87c8bfc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:40:26.284874 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1441/2920] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 19 10:40:26 2022] DELETE /identity/v3/projects/161abf739d3846cfa3776451c33bf91e => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:40:26.289499 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dccdc3-47fd-47e9-86e0-6bcd0a4a8506 service neutron] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:40:26.299201 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dccdc3-47fd-47e9-86e0-6bcd0a4a8506 service neutron] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:40:26.354781 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1972f25-f16f-4ff4-8ff1-2ce12574295a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:40:26.355424 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1972f25-f16f-4ff4-8ff1-2ce12574295a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:40:26.355706 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1972f25-f16f-4ff4-8ff1-2ce12574295a admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:40:26.355981 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1972f25-f16f-4ff4-8ff1-2ce12574295a admin admin] PATH_INFO: `/v3/users/af967f42a3504e85b525ae56aaa92812` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:40:26.357141 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1972f25-f16f-4ff4-8ff1-2ce12574295a admin admin] RBAC: Authorizing `identity:delete_user(user_id=af967f42a3504e85b525ae56aaa92812)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:40:26.359074 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1972f25-f16f-4ff4-8ff1-2ce12574295a admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:40:26.409162 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-d1972f25-f16f-4ff4-8ff1-2ce12574295a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af967f42a3504e85b525ae56aaa92812'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:40:26.417420 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-d1972f25-f16f-4ff4-8ff1-2ce12574295a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af967f42a3504e85b525ae56aaa92812'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:40:26.418202 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-d1972f25-f16f-4ff4-8ff1-2ce12574295a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af967f42a3504e85b525ae56aaa92812'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:40:26.418813 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-d1972f25-f16f-4ff4-8ff1-2ce12574295a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af967f42a3504e85b525ae56aaa92812'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:40:26.425996 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-d1972f25-f16f-4ff4-8ff1-2ce12574295a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af967f42a3504e85b525ae56aaa92812'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:40:26.444496 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1480/2921] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 19 10:40:26 2022] DELETE /identity/v3/users/af967f42a3504e85b525ae56aaa92812 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:40:26.960899 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6785d48a-0c2e-4391-bb8e-6b24f87c8bfc admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:40:26.962560 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-6785d48a-0c2e-4391-bb8e-6b24f87c8bfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:40:26.970801 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:40:26.976699 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6785d48a-0c2e-4391-bb8e-6b24f87c8bfc admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:40:27.035902 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1087078-26a3-4006-b572-a35e3c50d94f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:40:27.036598 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1087078-26a3-4006-b572-a35e3c50d94f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:40:27.036875 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1087078-26a3-4006-b572-a35e3c50d94f admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:40:27.037148 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1087078-26a3-4006-b572-a35e3c50d94f admin admin] PATH_INFO: `/v3/projects/eba4c4e548c649908395189c00030641` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:40:27.038317 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1087078-26a3-4006-b572-a35e3c50d94f admin admin] RBAC: Authorizing `identity:delete_project(project_id=eba4c4e548c649908395189c00030641)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:40:27.040323 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1087078-26a3-4006-b572-a35e3c50d94f admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:40:27.092540 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-f1087078-26a3-4006-b572-a35e3c50d94f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eba4c4e548c649908395189c00030641', 'request_id': 'req-f1087078-26a3-4006-b572-a35e3c50d94f'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:40:27.098786 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-f1087078-26a3-4006-b572-a35e3c50d94f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eba4c4e548c649908395189c00030641', 'request_id': 'req-f1087078-26a3-4006-b572-a35e3c50d94f'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:40:27.105607 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-f1087078-26a3-4006-b572-a35e3c50d94f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eba4c4e548c649908395189c00030641', 'request_id': 'req-f1087078-26a3-4006-b572-a35e3c50d94f'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:40:27.115840 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-f1087078-26a3-4006-b572-a35e3c50d94f admin admin] The token cache is being invalidate because project eba4c4e548c649908395189c00030641 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 10:40:27.116157 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-f1087078-26a3-4006-b572-a35e3c50d94f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:40:27.116808 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-f1087078-26a3-4006-b572-a35e3c50d94f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:40:27.118289 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1442/2922] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 19 10:40:26 2022] DELETE /identity/v3/projects/eba4c4e548c649908395189c00030641 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 10:40:27.123176 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea16e716-80a4-49df-9515-870a5998ebae None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:40:27.123642 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea16e716-80a4-49df-9515-870a5998ebae None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:40:27.123740 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea16e716-80a4-49df-9515-870a5998ebae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:40:27.143585 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-ea16e716-80a4-49df-9515-870a5998ebae None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:40:27.144836 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-ea16e716-80a4-49df-9515-870a5998ebae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:40:27.213279 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1481/2923] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:40:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:40:27.222158 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84af452-9ffe-4249-bee6-5b5a5a31a530 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:40:27.222470 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84af452-9ffe-4249-bee6-5b5a5a31a530 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:40:27.222736 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84af452-9ffe-4249-bee6-5b5a5a31a530 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:40:27.242603 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-f84af452-9ffe-4249-bee6-5b5a5a31a530 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:40:27.243817 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-f84af452-9ffe-4249-bee6-5b5a5a31a530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:40:27.251635 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1443/2924] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:40:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:40:27.255869 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea16e716-80a4-49df-9515-870a5998ebae None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:40:27.262458 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:40:27.266330 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea16e716-80a4-49df-9515-870a5998ebae None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:40:27.271793 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85157667-cfb2-4820-88ec-105eb0c9a4f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:40:27.273223 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85157667-cfb2-4820-88ec-105eb0c9a4f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:40:27.273658 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85157667-cfb2-4820-88ec-105eb0c9a4f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:40:27.274116 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85157667-cfb2-4820-88ec-105eb0c9a4f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:40:27.274761 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85157667-cfb2-4820-88ec-105eb0c9a4f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:40:27.275064 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85157667-cfb2-4820-88ec-105eb0c9a4f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:40:27.276717 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85157667-cfb2-4820-88ec-105eb0c9a4f0 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:40:27.288479 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1482/2925] 10.222.0.66 () {58 vars in 1153 bytes} [Mon Sep 19 10:40:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:40:27.293120 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84af452-9ffe-4249-bee6-5b5a5a31a530 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:40:27.302427 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84af452-9ffe-4249-bee6-5b5a5a31a530 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:40:27.307635 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272e378a-6995-4986-8378-5a19c54f0ff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:40:27.308277 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272e378a-6995-4986-8378-5a19c54f0ff3 admin admin] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:40:27.308560 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272e378a-6995-4986-8378-5a19c54f0ff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:40:27.308839 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272e378a-6995-4986-8378-5a19c54f0ff3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:40:27.309487 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272e378a-6995-4986-8378-5a19c54f0ff3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:40:27.311410 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272e378a-6995-4986-8378-5a19c54f0ff3 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:40:27.339145 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1444/2926] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 19 10:40:27 2022] POST /identity/v3/projects => generated 371 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:40:27.343333 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85157667-cfb2-4820-88ec-105eb0c9a4f0 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:40:27.353824 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85157667-cfb2-4820-88ec-105eb0c9a4f0 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:40:27.415370 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab49e2ae-c63d-49a4-bc55-2957eddc1cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:40:27.415973 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab49e2ae-c63d-49a4-bc55-2957eddc1cf3 admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:40:27.416280 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab49e2ae-c63d-49a4-bc55-2957eddc1cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:40:27.416553 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab49e2ae-c63d-49a4-bc55-2957eddc1cf3 admin admin] PATH_INFO: `/v3/users` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:40:27.417734 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab49e2ae-c63d-49a4-bc55-2957eddc1cf3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:40:27.419748 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab49e2ae-c63d-49a4-bc55-2957eddc1cf3 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:40:27.445784 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1483/2927] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 19 10:40:27 2022] POST /identity/v3/users => generated 286 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:40:27.449987 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272e378a-6995-4986-8378-5a19c54f0ff3 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:40:27.460416 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272e378a-6995-4986-8378-5a19c54f0ff3 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:40:27.465009 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5f0736-1caf-4bb3-b166-20549effb2b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:40:27.465544 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5f0736-1caf-4bb3-b166-20549effb2b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:40:27.465825 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5f0736-1caf-4bb3-b166-20549effb2b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:40:27.466099 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5f0736-1caf-4bb3-b166-20549effb2b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:40:27.466732 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5f0736-1caf-4bb3-b166-20549effb2b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:40:27.468365 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5f0736-1caf-4bb3-b166-20549effb2b5 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:40:27.478572 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1445/2928] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:40:27 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 10:40:27.482461 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab49e2ae-c63d-49a4-bc55-2957eddc1cf3 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:40:27.492812 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab49e2ae-c63d-49a4-bc55-2957eddc1cf3 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:40:27.497331 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd99611-3dc3-4b73-a1bb-db323a0236fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:40:27.497926 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd99611-3dc3-4b73-a1bb-db323a0236fb admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:40:27.498201 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd99611-3dc3-4b73-a1bb-db323a0236fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:40:27.498469 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd99611-3dc3-4b73-a1bb-db323a0236fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:40:27.499088 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd99611-3dc3-4b73-a1bb-db323a0236fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:40:27.500710 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd99611-3dc3-4b73-a1bb-db323a0236fb admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:40:27.511747 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1484/2929] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:40:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 10:40:27.516093 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5f0736-1caf-4bb3-b166-20549effb2b5 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:40:27.526158 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5f0736-1caf-4bb3-b166-20549effb2b5 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:40:27.530785 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b419d890-c937-468f-af82-a60cc55d795d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:40:27.531437 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b419d890-c937-468f-af82-a60cc55d795d admin admin] REQUEST_METHOD: `PUT` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:40:27.531720 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b419d890-c937-468f-af82-a60cc55d795d admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:40:27.531998 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b419d890-c937-468f-af82-a60cc55d795d admin admin] PATH_INFO: `/v3/projects/20a0fbe309a34aa0b29d8d700090079d/users/c77ae644f32946cab9e12a6cac409d6c/roles/cd5b42ed3b754b58817a62bbe74651b4` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:40:27.546751 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b419d890-c937-468f-af82-a60cc55d795d admin admin] RBAC: Authorizing `identity:create_grant(project_id=20a0fbe309a34aa0b29d8d700090079d, user_id=c77ae644f32946cab9e12a6cac409d6c, role_id=cd5b42ed3b754b58817a62bbe74651b4)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:40:27.549446 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b419d890-c937-468f-af82-a60cc55d795d admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:40:27.563331 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1446/2930] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 19 10:40:27 2022] PUT /identity/v3/projects/20a0fbe309a34aa0b29d8d700090079d/users/c77ae644f32946cab9e12a6cac409d6c/roles/cd5b42ed3b754b58817a62bbe74651b4 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:40:27.574242 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e49b14-c8fb-4e6e-8dd0-c2c5d6ac94e1 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:40:27.574522 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e49b14-c8fb-4e6e-8dd0-c2c5d6ac94e1 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:40:27.574797 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e49b14-c8fb-4e6e-8dd0-c2c5d6ac94e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:40:27.603721 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-81e49b14-c8fb-4e6e-8dd0-c2c5d6ac94e1 None None] MFA Rules not processed for user `c77ae644f32946cab9e12a6cac409d6c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:40:27.604992 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-81e49b14-c8fb-4e6e-8dd0-c2c5d6ac94e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:40:27.669252 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1485/2931] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:40:27 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:40:27.680476 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b419d890-c937-468f-af82-a60cc55d795d admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:40:27.682186 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-b419d890-c937-468f-af82-a60cc55d795d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:40:27.718080 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:40:27.747207 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b419d890-c937-468f-af82-a60cc55d795d admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:40:27.751080 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0267f5d-b564-427a-b2da-318a8d2f2907 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa4d004fd44482cae761c4b3bdfab31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:40:27.751723 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0267f5d-b564-427a-b2da-318a8d2f2907 service cinder] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:40:27.751991 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0267f5d-b564-427a-b2da-318a8d2f2907 service cinder] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:40:27.752304 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0267f5d-b564-427a-b2da-318a8d2f2907 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:40:27.761046 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0267f5d-b564-427a-b2da-318a8d2f2907 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:40:27.762672 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0267f5d-b564-427a-b2da-318a8d2f2907 service cinder] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:40:27.771471 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1447/2932] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:40:27 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:40:29.138290 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6cc412-8296-4ba4-9265-f4ccdbb56566 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:40:29.138810 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6cc412-8296-4ba4-9265-f4ccdbb56566 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:40:29.138910 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6cc412-8296-4ba4-9265-f4ccdbb56566 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:40:29.157699 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-ce6cc412-8296-4ba4-9265-f4ccdbb56566 None None] MFA Rules not processed for user `c77ae644f32946cab9e12a6cac409d6c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:40:29.158888 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-ce6cc412-8296-4ba4-9265-f4ccdbb56566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:40:29.166210 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1486/2933] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:40:29 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:40:37.767467 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=13 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:40:39.152482 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=73,keystone:INSERT=3 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:40:45.727151 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0267f5d-b564-427a-b2da-318a8d2f2907 service cinder] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:40:45.728586 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-c0267f5d-b564-427a-b2da-318a8d2f2907 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:40:45.801720 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0267f5d-b564-427a-b2da-318a8d2f2907 service cinder] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:40:45.806812 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0ce4a6-ef1d-4b15-b90b-44a61dc1779f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46b78120cac64f09bd0f4cdc42424163', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:40:45.807420 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0ce4a6-ef1d-4b15-b90b-44a61dc1779f service placement] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:40:45.807697 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0ce4a6-ef1d-4b15-b90b-44a61dc1779f service placement] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:40:45.807970 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0ce4a6-ef1d-4b15-b90b-44a61dc1779f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:40:45.809759 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-9e0ce4a6-ef1d-4b15-b90b-44a61dc1779f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:40:45.821884 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0ce4a6-ef1d-4b15-b90b-44a61dc1779f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:40:45.823474 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0ce4a6-ef1d-4b15-b90b-44a61dc1779f service placement] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:40:45.833662 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1448/2934] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:40:45 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:40:46.725869 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c80060-48e8-4b30-8ec8-25a7e14d0e7e None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:40:46.726468 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c80060-48e8-4b30-8ec8-25a7e14d0e7e None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:40:46.726468 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c80060-48e8-4b30-8ec8-25a7e14d0e7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:40:46.747290 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-f2c80060-48e8-4b30-8ec8-25a7e14d0e7e None None] MFA Rules not processed for user `e4d1160b71a84e2fa44a8ca6edf1846e`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:40:46.748522 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-f2c80060-48e8-4b30-8ec8-25a7e14d0e7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:40:46.805120 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1487/2935] 10.222.0.66 () {58 vars in 1009 bytes} [Mon Sep 19 10:40:46 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:40:46.855294 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0ce4a6-ef1d-4b15-b90b-44a61dc1779f service placement] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:40:46.857043 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-9e0ce4a6-ef1d-4b15-b90b-44a61dc1779f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:40:46.938787 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0ce4a6-ef1d-4b15-b90b-44a61dc1779f service placement] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:40:46.945309 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1675a251-4f23-4bf9-b32c-fa7aac6b5c3a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6677354e36614c9fb3d03413749be5ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:40:46.945990 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1675a251-4f23-4bf9-b32c-fa7aac6b5c3a service swift] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:40:46.946344 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1675a251-4f23-4bf9-b32c-fa7aac6b5c3a service swift] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:40:46.946699 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1675a251-4f23-4bf9-b32c-fa7aac6b5c3a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:40:46.956273 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1675a251-4f23-4bf9-b32c-fa7aac6b5c3a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:40:46.958204 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1675a251-4f23-4bf9-b32c-fa7aac6b5c3a service swift] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:40:46.967960 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1449/2936] 10.222.0.66 () {60 vars in 1384 bytes} [Mon Sep 19 10:40:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 19 10:40:47.519549 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6856eef9-ea06-4c14-87eb-013d654e0aa6 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:40:47.519816 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6856eef9-ea06-4c14-87eb-013d654e0aa6 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:40:47.520099 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6856eef9-ea06-4c14-87eb-013d654e0aa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:40:47.540710 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-6856eef9-ea06-4c14-87eb-013d654e0aa6 None None] MFA Rules not processed for user `e4d1160b71a84e2fa44a8ca6edf1846e`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:40:47.542176 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-6856eef9-ea06-4c14-87eb-013d654e0aa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:40:47.550131 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1488/2937] 10.222.0.66 () {58 vars in 967 bytes} [Mon Sep 19 10:40:47 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:40:47.563755 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1675a251-4f23-4bf9-b32c-fa7aac6b5c3a service swift] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:40:47.574411 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1675a251-4f23-4bf9-b32c-fa7aac6b5c3a service swift] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:40:47.579517 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4527da6d-5e06-4604-8568-5e38499eeadc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6677354e36614c9fb3d03413749be5ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:40:47.580112 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4527da6d-5e06-4604-8568-5e38499eeadc service swift] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:40:47.580425 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4527da6d-5e06-4604-8568-5e38499eeadc service swift] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:40:47.580699 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4527da6d-5e06-4604-8568-5e38499eeadc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:40:47.589321 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4527da6d-5e06-4604-8568-5e38499eeadc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:40:47.590895 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4527da6d-5e06-4604-8568-5e38499eeadc service swift] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:40:47.598869 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1450/2938] 10.222.0.66 () {60 vars in 1384 bytes} [Mon Sep 19 10:40:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 19 10:40:47.845410 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c27575-0105-4e8c-85d9-2303f9a147b4 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:40:47.845925 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c27575-0105-4e8c-85d9-2303f9a147b4 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:40:47.846031 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c27575-0105-4e8c-85d9-2303f9a147b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:40:47.866311 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-48c27575-0105-4e8c-85d9-2303f9a147b4 None None] MFA Rules not processed for user `e4d1160b71a84e2fa44a8ca6edf1846e`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:40:47.867516 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-48c27575-0105-4e8c-85d9-2303f9a147b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:40:47.874727 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1489/2939] 10.222.0.66 () {58 vars in 1009 bytes} [Mon Sep 19 10:40:47 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:40:47.888125 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4527da6d-5e06-4604-8568-5e38499eeadc service swift] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:40:47.900138 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4527da6d-5e06-4604-8568-5e38499eeadc service swift] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:40:47.905287 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78b56d7-5520-4016-901d-958bdb5ac09f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6677354e36614c9fb3d03413749be5ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:40:47.905914 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78b56d7-5520-4016-901d-958bdb5ac09f service swift] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:40:47.906196 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78b56d7-5520-4016-901d-958bdb5ac09f service swift] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:40:47.906470 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78b56d7-5520-4016-901d-958bdb5ac09f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:40:47.914829 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78b56d7-5520-4016-901d-958bdb5ac09f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:40:47.916540 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78b56d7-5520-4016-901d-958bdb5ac09f service swift] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:40:47.924821 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1451/2940] 10.222.0.66 () {60 vars in 1384 bytes} [Mon Sep 19 10:40:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 19 10:40:48.262528 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a09aa3-7819-4162-ba16-ac20e53d71b9 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:40:48.262815 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a09aa3-7819-4162-ba16-ac20e53d71b9 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:40:48.263091 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a09aa3-7819-4162-ba16-ac20e53d71b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:40:48.285121 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-b0a09aa3-7819-4162-ba16-ac20e53d71b9 None None] MFA Rules not processed for user `e4d1160b71a84e2fa44a8ca6edf1846e`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:40:48.286325 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-b0a09aa3-7819-4162-ba16-ac20e53d71b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:40:48.293842 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1490/2941] 10.222.0.66 () {58 vars in 967 bytes} [Mon Sep 19 10:40:48 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:40:48.306900 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78b56d7-5520-4016-901d-958bdb5ac09f service swift] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:40:48.317503 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78b56d7-5520-4016-901d-958bdb5ac09f service swift] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:40:48.323421 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28ed3a0-6d64-4a98-a439-117b3c755520 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6677354e36614c9fb3d03413749be5ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:40:48.324026 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28ed3a0-6d64-4a98-a439-117b3c755520 service swift] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:40:48.324326 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28ed3a0-6d64-4a98-a439-117b3c755520 service swift] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:40:48.324600 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28ed3a0-6d64-4a98-a439-117b3c755520 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:40:48.333085 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28ed3a0-6d64-4a98-a439-117b3c755520 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:40:48.334715 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28ed3a0-6d64-4a98-a439-117b3c755520 service swift] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:40:48.342868 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1452/2942] 10.222.0.66 () {60 vars in 1384 bytes} [Mon Sep 19 10:40:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 19 10:40:50.679744 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a09aa3-7819-4162-ba16-ac20e53d71b9 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:40:50.742531 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a09aa3-7819-4162-ba16-ac20e53d71b9 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:40:50.746987 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4203e9e-514c-46e4-b286-12887b594312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:40:50.747612 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4203e9e-514c-46e4-b286-12887b594312 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:40:50.747892 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4203e9e-514c-46e4-b286-12887b594312 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:40:50.748190 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4203e9e-514c-46e4-b286-12887b594312 admin admin] PATH_INFO: `/v3/users/c77ae644f32946cab9e12a6cac409d6c` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:40:50.749335 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4203e9e-514c-46e4-b286-12887b594312 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c77ae644f32946cab9e12a6cac409d6c)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:40:50.751242 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4203e9e-514c-46e4-b286-12887b594312 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:40:50.799480 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-a4203e9e-514c-46e4-b286-12887b594312 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c77ae644f32946cab9e12a6cac409d6c'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:40:50.807415 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-a4203e9e-514c-46e4-b286-12887b594312 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c77ae644f32946cab9e12a6cac409d6c'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:40:50.808067 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-a4203e9e-514c-46e4-b286-12887b594312 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c77ae644f32946cab9e12a6cac409d6c'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:40:50.808741 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-a4203e9e-514c-46e4-b286-12887b594312 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c77ae644f32946cab9e12a6cac409d6c'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:40:50.815617 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-a4203e9e-514c-46e4-b286-12887b594312 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c77ae644f32946cab9e12a6cac409d6c'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:40:50.834098 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1491/2943] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 19 10:40:50 2022] DELETE /identity/v3/users/c77ae644f32946cab9e12a6cac409d6c => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:40:50.839069 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d132d94-e4b6-48fb-8824-af5bad685e88 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:40:50.839571 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d132d94-e4b6-48fb-8824-af5bad685e88 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:40:50.839690 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d132d94-e4b6-48fb-8824-af5bad685e88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:40:50.859203 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-3d132d94-e4b6-48fb-8824-af5bad685e88 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:40:50.860432 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-3d132d94-e4b6-48fb-8824-af5bad685e88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:40:50.894990 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=100 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:40:50.922204 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1453/2944] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:40:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:40:50.932714 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4203e9e-514c-46e4-b286-12887b594312 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:40:50.934295 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-a4203e9e-514c-46e4-b286-12887b594312 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:40:50.941518 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:40:50.996672 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4203e9e-514c-46e4-b286-12887b594312 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:40:51.000747 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df912b98-7ae6-4e71-9938-1aaf430c8ff6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c1289b015854c6bb6aee8fed6b807db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:40:51.001429 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df912b98-7ae6-4e71-9938-1aaf430c8ff6 service neutron] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:40:51.001723 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df912b98-7ae6-4e71-9938-1aaf430c8ff6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:40:51.002043 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df912b98-7ae6-4e71-9938-1aaf430c8ff6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:40:51.011807 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df912b98-7ae6-4e71-9938-1aaf430c8ff6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:40:51.013491 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df912b98-7ae6-4e71-9938-1aaf430c8ff6 service neutron] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:40:51.024018 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1492/2945] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:40:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:40:51.196692 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d132d94-e4b6-48fb-8824-af5bad685e88 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:40:51.198467 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-3d132d94-e4b6-48fb-8824-af5bad685e88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:40:51.213402 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d132d94-e4b6-48fb-8824-af5bad685e88 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:40:51.218857 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098a5cb0-3e2c-4dde-a519-3e6c4ed5eaed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:40:51.219579 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098a5cb0-3e2c-4dde-a519-3e6c4ed5eaed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:40:51.219972 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098a5cb0-3e2c-4dde-a519-3e6c4ed5eaed admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:40:51.220391 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098a5cb0-3e2c-4dde-a519-3e6c4ed5eaed admin admin] PATH_INFO: `/v3/projects/20a0fbe309a34aa0b29d8d700090079d` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:40:51.221637 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098a5cb0-3e2c-4dde-a519-3e6c4ed5eaed admin admin] RBAC: Authorizing `identity:delete_project(project_id=20a0fbe309a34aa0b29d8d700090079d)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:40:51.223966 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098a5cb0-3e2c-4dde-a519-3e6c4ed5eaed admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:40:51.278097 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-098a5cb0-3e2c-4dde-a519-3e6c4ed5eaed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20a0fbe309a34aa0b29d8d700090079d', 'request_id': 'req-098a5cb0-3e2c-4dde-a519-3e6c4ed5eaed'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:40:51.285594 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-098a5cb0-3e2c-4dde-a519-3e6c4ed5eaed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20a0fbe309a34aa0b29d8d700090079d', 'request_id': 'req-098a5cb0-3e2c-4dde-a519-3e6c4ed5eaed'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:40:51.293961 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-098a5cb0-3e2c-4dde-a519-3e6c4ed5eaed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20a0fbe309a34aa0b29d8d700090079d', 'request_id': 'req-098a5cb0-3e2c-4dde-a519-3e6c4ed5eaed'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:40:51.304664 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-098a5cb0-3e2c-4dde-a519-3e6c4ed5eaed admin admin] The token cache is being invalidate because project 20a0fbe309a34aa0b29d8d700090079d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 10:40:51.304952 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-098a5cb0-3e2c-4dde-a519-3e6c4ed5eaed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:40:51.305578 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-098a5cb0-3e2c-4dde-a519-3e6c4ed5eaed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:40:51.307071 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1454/2946] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 19 10:40:51 2022] DELETE /identity/v3/projects/20a0fbe309a34aa0b29d8d700090079d => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:40:51.312437 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aba064d-bfc0-4732-97df-fdac5158b9ed None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:40:51.312771 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aba064d-bfc0-4732-97df-fdac5158b9ed None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:40:51.313102 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aba064d-bfc0-4732-97df-fdac5158b9ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:40:51.334473 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-8aba064d-bfc0-4732-97df-fdac5158b9ed None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:40:51.335803 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-8aba064d-bfc0-4732-97df-fdac5158b9ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:40:51.395958 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1493/2947] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:40:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:40:51.405054 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4209661-ab36-42d6-b8f1-985e1ba3662f None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:40:51.405392 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4209661-ab36-42d6-b8f1-985e1ba3662f None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:40:51.405698 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4209661-ab36-42d6-b8f1-985e1ba3662f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:40:51.427586 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-b4209661-ab36-42d6-b8f1-985e1ba3662f None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:40:51.428983 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-b4209661-ab36-42d6-b8f1-985e1ba3662f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:40:51.437497 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1455/2948] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:40:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:40:51.442176 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aba064d-bfc0-4732-97df-fdac5158b9ed None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:40:51.452826 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aba064d-bfc0-4732-97df-fdac5158b9ed None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:40:51.457591 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98c9c01-8218-4bb8-82de-cd249afa9750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:40:51.458200 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98c9c01-8218-4bb8-82de-cd249afa9750 admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:40:51.458501 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98c9c01-8218-4bb8-82de-cd249afa9750 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:40:51.459254 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98c9c01-8218-4bb8-82de-cd249afa9750 admin admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:40:51.459892 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98c9c01-8218-4bb8-82de-cd249afa9750 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:40:51.460212 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98c9c01-8218-4bb8-82de-cd249afa9750 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:40:51.461845 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98c9c01-8218-4bb8-82de-cd249afa9750 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:40:51.474093 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1494/2949] 10.222.0.66 () {58 vars in 1153 bytes} [Mon Sep 19 10:40:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:40:51.479142 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4209661-ab36-42d6-b8f1-985e1ba3662f None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:40:51.488432 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4209661-ab36-42d6-b8f1-985e1ba3662f None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:40:51.493425 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd933833-a8ff-4326-a98c-3e704c161478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:40:51.494020 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd933833-a8ff-4326-a98c-3e704c161478 admin admin] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:40:51.494298 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd933833-a8ff-4326-a98c-3e704c161478 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:40:51.494571 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd933833-a8ff-4326-a98c-3e704c161478 admin admin] PATH_INFO: `/v3/projects` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:40:51.495206 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd933833-a8ff-4326-a98c-3e704c161478 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:40:51.497151 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd933833-a8ff-4326-a98c-3e704c161478 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:40:51.527749 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1456/2950] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 19 10:40:51 2022] POST /identity/v3/projects => generated 399 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 10:40:51.531984 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98c9c01-8218-4bb8-82de-cd249afa9750 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:40:51.544864 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98c9c01-8218-4bb8-82de-cd249afa9750 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:40:51.610846 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f503a6-17d2-4d25-a6d6-dadaf8bac5ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:40:51.611533 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f503a6-17d2-4d25-a6d6-dadaf8bac5ca admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:40:51.611885 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f503a6-17d2-4d25-a6d6-dadaf8bac5ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:40:51.612268 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f503a6-17d2-4d25-a6d6-dadaf8bac5ca admin admin] PATH_INFO: `/v3/users` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:40:51.613025 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f503a6-17d2-4d25-a6d6-dadaf8bac5ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:40:51.615377 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f503a6-17d2-4d25-a6d6-dadaf8bac5ca admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:40:51.639579 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1495/2951] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 19 10:40:51 2022] POST /identity/v3/users => generated 300 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:40:51.644861 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd933833-a8ff-4326-a98c-3e704c161478 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:40:51.657105 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd933833-a8ff-4326-a98c-3e704c161478 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:40:51.661676 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2ca25a-d59d-4433-a3fe-3195dc3ccd8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:40:51.662313 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2ca25a-d59d-4433-a3fe-3195dc3ccd8f admin admin] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:40:51.662589 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2ca25a-d59d-4433-a3fe-3195dc3ccd8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:40:51.662859 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2ca25a-d59d-4433-a3fe-3195dc3ccd8f admin admin] PATH_INFO: `/v3/roles` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:40:51.663494 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2ca25a-d59d-4433-a3fe-3195dc3ccd8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:40:51.665127 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2ca25a-d59d-4433-a3fe-3195dc3ccd8f admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:40:51.675809 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1457/2952] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:40:51 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 10:40:51.681154 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f503a6-17d2-4d25-a6d6-dadaf8bac5ca admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:40:51.694460 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f503a6-17d2-4d25-a6d6-dadaf8bac5ca admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:40:51.699866 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de68d48-8993-4117-87a8-54b276d1110c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:40:51.700580 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de68d48-8993-4117-87a8-54b276d1110c admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:40:51.700930 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de68d48-8993-4117-87a8-54b276d1110c admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:40:51.701292 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de68d48-8993-4117-87a8-54b276d1110c admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:40:51.702046 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de68d48-8993-4117-87a8-54b276d1110c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:40:51.703982 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de68d48-8993-4117-87a8-54b276d1110c admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:40:51.717129 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1496/2953] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 19 10:40:51 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 10:40:51.721540 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2ca25a-d59d-4433-a3fe-3195dc3ccd8f admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:40:51.733095 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2ca25a-d59d-4433-a3fe-3195dc3ccd8f admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:40:51.738180 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283e880f-564a-4369-95bd-3bbf043a5cf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:40:51.738923 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283e880f-564a-4369-95bd-3bbf043a5cf1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:40:51.739242 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283e880f-564a-4369-95bd-3bbf043a5cf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:40:51.739551 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283e880f-564a-4369-95bd-3bbf043a5cf1 admin admin] PATH_INFO: `/v3/projects/b25c35926a744258a32249aaeef19830/users/77915969bd524238ba971b36923ba21c/roles/cd5b42ed3b754b58817a62bbe74651b4` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:40:51.756113 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283e880f-564a-4369-95bd-3bbf043a5cf1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b25c35926a744258a32249aaeef19830, user_id=77915969bd524238ba971b36923ba21c, role_id=cd5b42ed3b754b58817a62bbe74651b4)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:40:51.759288 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283e880f-564a-4369-95bd-3bbf043a5cf1 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:40:51.774362 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1458/2954] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 19 10:40:51 2022] PUT /identity/v3/projects/b25c35926a744258a32249aaeef19830/users/77915969bd524238ba971b36923ba21c/roles/cd5b42ed3b754b58817a62bbe74651b4 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:40:51.785861 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c263f28a-a020-4fbd-86d5-ad7f81925305 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:40:51.786148 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c263f28a-a020-4fbd-86d5-ad7f81925305 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:40:51.786427 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c263f28a-a020-4fbd-86d5-ad7f81925305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:40:51.814039 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:40:51.817451 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-c263f28a-a020-4fbd-86d5-ad7f81925305 None None] MFA Rules not processed for user `77915969bd524238ba971b36923ba21c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:40:51.820123 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-c263f28a-a020-4fbd-86d5-ad7f81925305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:40:51.889488 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1497/2955] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:40:51 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 10:40:51.902109 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283e880f-564a-4369-95bd-3bbf043a5cf1 admin admin] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:40:51.903829 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-283e880f-564a-4369-95bd-3bbf043a5cf1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:40:51.962570 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283e880f-564a-4369-95bd-3bbf043a5cf1 admin admin] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:40:51.966156 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c517d58-777b-4092-bdb7-aade1e54faa0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa4d004fd44482cae761c4b3bdfab31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:40:51.966758 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c517d58-777b-4092-bdb7-aade1e54faa0 service cinder] REQUEST_METHOD: `GET` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:40:51.967038 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c517d58-777b-4092-bdb7-aade1e54faa0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:40:51.967316 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c517d58-777b-4092-bdb7-aade1e54faa0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:40:51.975769 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c517d58-777b-4092-bdb7-aade1e54faa0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:40:51.977239 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c517d58-777b-4092-bdb7-aade1e54faa0 service cinder] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:40:51.986085 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1459/2956] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:40:51 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:40:57.029057 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c263f28a-a020-4fbd-86d5-ad7f81925305 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:40:57.093374 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c263f28a-a020-4fbd-86d5-ad7f81925305 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:40:57.097950 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67263904-dcaf-4650-9613-c525197695bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:40:57.098573 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67263904-dcaf-4650-9613-c525197695bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:40:57.098917 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67263904-dcaf-4650-9613-c525197695bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:40:57.099609 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67263904-dcaf-4650-9613-c525197695bb admin admin] PATH_INFO: `/v3/users/77915969bd524238ba971b36923ba21c` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:40:57.100760 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67263904-dcaf-4650-9613-c525197695bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=77915969bd524238ba971b36923ba21c)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:40:57.102667 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67263904-dcaf-4650-9613-c525197695bb admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:40:57.155046 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-67263904-dcaf-4650-9613-c525197695bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77915969bd524238ba971b36923ba21c'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:40:57.167774 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-67263904-dcaf-4650-9613-c525197695bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77915969bd524238ba971b36923ba21c'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:40:57.168678 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-67263904-dcaf-4650-9613-c525197695bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77915969bd524238ba971b36923ba21c'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:40:57.169656 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-67263904-dcaf-4650-9613-c525197695bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77915969bd524238ba971b36923ba21c'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:40:57.180387 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-67263904-dcaf-4650-9613-c525197695bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77915969bd524238ba971b36923ba21c'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:40:57.202324 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1498/2957] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 19 10:40:57 2022] DELETE /identity/v3/users/77915969bd524238ba971b36923ba21c => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 10:40:57.207896 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16a82a2-9fa9-4525-bf66-0a41441689c6 None None] REQUEST_METHOD: `POST` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:40:57.208609 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16a82a2-9fa9-4525-bf66-0a41441689c6 None None] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:40:57.208609 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16a82a2-9fa9-4525-bf66-0a41441689c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:40:57.216535 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:40:57.231967 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.auth.core [None req-c16a82a2-9fa9-4525-bf66-0a41441689c6 None None] MFA Rules not processed for user `a561b673cfae437daade9297a694cc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:40:57.233217 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-c16a82a2-9fa9-4525-bf66-0a41441689c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:40:57.294797 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1460/2958] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 19 10:40:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 10:40:57.305472 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67263904-dcaf-4650-9613-c525197695bb admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:40:57.307153 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-67263904-dcaf-4650-9613-c525197695bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:40:57.334475 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:40:57.366626 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67263904-dcaf-4650-9613-c525197695bb admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:40:57.370336 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6076b4c8-ce98-45db-938b-4c5ac94c0d11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c1289b015854c6bb6aee8fed6b807db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:40:57.370931 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6076b4c8-ce98-45db-938b-4c5ac94c0d11 service neutron] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:40:57.371206 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6076b4c8-ce98-45db-938b-4c5ac94c0d11 service neutron] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:40:57.371477 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6076b4c8-ce98-45db-938b-4c5ac94c0d11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:40:57.381312 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6076b4c8-ce98-45db-938b-4c5ac94c0d11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:40:57.383058 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6076b4c8-ce98-45db-938b-4c5ac94c0d11 service neutron] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:40:57.392413 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1499/2959] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:40:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 10:40:57.670923 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16a82a2-9fa9-4525-bf66-0a41441689c6 None None] Authenticating user token {{(pid=81352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:40:57.672450 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.fernet_utils [None req-c16a82a2-9fa9-4525-bf66-0a41441689c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:40:57.685554 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16a82a2-9fa9-4525-bf66-0a41441689c6 None None] Validating token access rules against request {{(pid=81352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:40:57.691045 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b8c6c9-f4dc-48ca-9c53-05359900ae07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a561b673cfae437daade9297a694cc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c18c45cef234ea9b13f7b650328fff6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:40:57.692036 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b8c6c9-f4dc-48ca-9c53-05359900ae07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:40:57.692209 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b8c6c9-f4dc-48ca-9c53-05359900ae07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:40:57.692575 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b8c6c9-f4dc-48ca-9c53-05359900ae07 admin admin] PATH_INFO: `/v3/projects/b25c35926a744258a32249aaeef19830` {{(pid=81352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:40:57.694360 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b8c6c9-f4dc-48ca-9c53-05359900ae07 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b25c35926a744258a32249aaeef19830)` {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:40:57.695789 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b8c6c9-f4dc-48ca-9c53-05359900ae07 admin admin] RBAC: Authorization granted {{(pid=81352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:40:57.746791 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-f8b8c6c9-f4dc-48ca-9c53-05359900ae07 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b25c35926a744258a32249aaeef19830', 'request_id': 'req-f8b8c6c9-f4dc-48ca-9c53-05359900ae07'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:40:57.753231 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-f8b8c6c9-f4dc-48ca-9c53-05359900ae07 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b25c35926a744258a32249aaeef19830', 'request_id': 'req-f8b8c6c9-f4dc-48ca-9c53-05359900ae07'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:40:57.760828 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-f8b8c6c9-f4dc-48ca-9c53-05359900ae07 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b25c35926a744258a32249aaeef19830', 'request_id': 'req-f8b8c6c9-f4dc-48ca-9c53-05359900ae07'} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:40:57.772953 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-f8b8c6c9-f4dc-48ca-9c53-05359900ae07 admin admin] The token cache is being invalidate because project b25c35926a744258a32249aaeef19830 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 10:40:57.773321 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-f8b8c6c9-f4dc-48ca-9c53-05359900ae07 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:40:57.774068 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG keystone.notifications [None req-f8b8c6c9-f4dc-48ca-9c53-05359900ae07 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 10:40:57.775789 dv-cinder-858275-1-smb devstack@keystone.service[81352]: [pid: 81352|app: 0|req: 1461/2960] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 19 10:40:57 2022] DELETE /identity/v3/projects/b25c35926a744258a32249aaeef19830 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 10:41:07.388218 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=16 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:41:07.770235 dv-cinder-858275-1-smb devstack@keystone.service[81352]: DEBUG dbcounter [-] [81352] Writing DB stats keystone:SELECT=53,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:46:13.625868 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6076b4c8-ce98-45db-938b-4c5ac94c0d11 service neutron] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:46:13.627408 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-6076b4c8-ce98-45db-938b-4c5ac94c0d11 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:46:13.781342 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6076b4c8-ce98-45db-938b-4c5ac94c0d11 service neutron] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:46:13.839877 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b48f69-5d49-43eb-a5c0-cd4093d477c9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46b78120cac64f09bd0f4cdc42424163', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be6b93ef3359434d9c776343f0aea333', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:46:13.840528 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b48f69-5d49-43eb-a5c0-cd4093d477c9 service placement] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:46:13.840804 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b48f69-5d49-43eb-a5c0-cd4093d477c9 service placement] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:46:13.841075 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b48f69-5d49-43eb-a5c0-cd4093d477c9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:46:13.842782 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-64b48f69-5d49-43eb-a5c0-cd4093d477c9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:46:13.854805 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b48f69-5d49-43eb-a5c0-cd4093d477c9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:46:13.856438 dv-cinder-858275-1-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b48f69-5d49-43eb-a5c0-cd4093d477c9 service placement] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:46:13.866689 dv-cinder-858275-1-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1500/2961] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 19 10:46:13 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)